Home // International Journal On Advances in Software, volume 8, numbers 1 and 2, 2015 // View article

A Feedback-Controlled Adaptive Middleware for Near-Time Bulk Data Processing

Authors:
Martin Swientek
Bernhard Humm
Paul Dowland
Udo Bleimann

Keywords: adaptive middleware; message aggregation; latency; throughput.

Abstract:
The processing type is usually a fixed property of an enterprise system that is decided when the architecture of the system is designed, prior to implementing the system. This choice depends on the non-functional requirements of the system. These requirements are not fixed and can change over time. In this article, the concept of a middleware is introduced that adapts its processing type fluently between batch processing and single-event processing using a feedback-control loop. By adjusting the data granularity at runtime, the system is able to minimize the end-to-end latency for different load scenarios. The proposed middleware concept has been implemented with a research prototype and has been evaluated. The results of the evaluation show that the concept is viable and is able to optimize the end-to-end latency of a system for bulk data processing.

Pages: 11 to 26

Copyright: Copyright (c) to authors, 2015. Used with permission.

Publication date: June 30, 2015

Published in: journal

ISSN: 1942-2628