Using a Market Economy to Provision Compute Resources Across Planet-wide Clusters
Venue
Proceedings for the International Parallel and Distributed Processing Symposium 2009, IEEE, pp. 1-8
Publication Year
2009
Authors
Murray Stokely, Jim Winget, Ed Keyes, Carrie Grimes, Benjamin Yolken
BibTeX
Abstract
These ideas were implemented in an experimental resource market at Google. Our preliminary results demonstrate an efficient transition of users from more congested resource pools to less congested resources. The disparate engineering costs for users to reconfigure their jobs to run on less expensive resource pools was evidenced by the large price premiums some users were willing to pay for more expensive resources. The final resource allocations illustrated how this framework can lead to significant, beneficial changes in user behavior, reducing the excessive shortages and surpluses of more traditional allocation methods.
