Abstract
We consider a system of N servers inter-connected by some underlying graph topology GN. Tasks with unit-mean exponential processing times arrive at the various servers as independent Poisson processes of rate λ. Each incoming task is irrevocably assigned to whichever server has the smallest number of tasks among the one where it appears and its neighbors in GN.
The above model arises in the context of load balancing in large-scale cloud networks and data centers, and has been extensively investigated in the case GN is a clique. Since the servers are exchangeable in that case, mean-field limits apply, and in particular it has been proved that for any λ < 1, the fraction of servers with two or more tasks vanishes in the limit as N → ∞. For an arbitrary graph GN, mean-field techniques break down, complicating the analysis, and the queue length process tends to be worse than for a clique. Accordingly, a graph GN is said to be N-optimal or √N-optimal when the queue length process on GN is equivalent to that on a clique on an N-scale or √N-scale, respectively.
We prove that if GN is an Erdöo s-Rényi random graph with average degree d(N), then with high probability it is N-optimal and √N-optimal if d(N) → ∞ and d(N)/√Nlog(N)) → ∞ as N → ∞, respectively. This demonstrates that optimality can be maintained at N-scale and √N-scale while reducing the number of connections by nearly a factor N and √N/log(N) compared to a clique, provided the topology is suitably random. It is further shown that if GN contains Θ(N) bounded-degree nodes, then it cannot be N-optimal. In addition, we establish that an arbitrary graph GN is N-optimal when its minimum degree is N - o(N), and may not be N-optimal even when its minimum degree is cN + o(N) for any 0 < c < 1/2. Simulation experiments are conducted for various scenarios to corroborate the asymptotic results.
- M. Adler, S. Chakrabarti, M. Mitzenmacher, and L. Rasmussen. 1995. Parallel randomized load balancing. In Proc. STOC '95. 238--247. Google Scholar
Digital Library
- S. Albers, M. Charikar, and M. Mitzenmacher. 2001. Delayed information and action in on-line algorithms. Inform. Comput. Vol. 170, 2 (2001), 135--152. Google Scholar
Digital Library
Index Terms
Asymptotically Optimal Load Balancing Topologies
Recommendations
Asymptotically Optimal Load Balancing Topologies
SIGMETRICS '18We consider a system of N ~servers inter-connected by some underlying graph topology~G N . Tasks with unit-mean exponential processing times arrive at the various servers as independent Poisson processes of rate lambda. Each incoming task is irrevocably ...
Asymptotically Optimal Load Balancing Topologies
SIGMETRICS '18: Abstracts of the 2018 ACM International Conference on Measurement and Modeling of Computer SystemsWe consider a system of N ~servers inter-connected by some underlying graph topology~G N . Tasks with unit-mean exponential processing times arrive at the various servers as independent Poisson processes of rate lambda. Each incoming task is irrevocably ...
Asymptotically optimal control of N-systems with $$H_2^*$$H2ź service times under many-server heavy traffic
We address a control problem for a queueing system, known as the "N-system," under the Halfin---Whitt heavy-traffic regime. It has two customer classes and two server pools: servers from one pool can serve both customer classes, while servers from the ...






Comments