|
|
Adaptive Load Balancing of Parallel Applications with Multi-Agent Reinforcement Learning on Heterogeneous Systems This publication appears in: Scientific Programming Authors: J. Parent, K. Verbeeck, J. Lemeire, E. Dirkx, A. Nowé and K. Steenhaut Volume: 12 Pages: 71-79 Publication Year: 2004
Abstract: We report on the improvements that can be achieved by applying machine learning techniques, in particular reinforcementlearning, for the dynamic load balancing of parallel applications. The applications being considered in this paper are coarsegrain data intensive applications. Such applications put high pressure on the interconnect of the hardware. Synchronization andload balancing in complex, heterogeneous networks need fast, flexible, adaptive load balancing algorithms. Viewing a parallelapplication as a one-state coordination game in the framework of multi-agent reinforcement learning, and by using a recentlyintroduced multi-agent exploration technique, we are able to improve upon the classic job farming approach. The improvementsare achieved with limited computation and communication overhead.
|
|
