Back to Search
Start Over
A Theory of Auto-Scaling for Resource Reservation in Cloud Services
- Source :
- Stochastic Systems. 12:227-252
- Publication Year :
- 2022
- Publisher :
- Institute for Operations Research and the Management Sciences (INFORMS), 2022.
-
Abstract
- We consider a distributed server system consisting of a large number of servers, each with limited capacity on multiple resources (CPU, memory, disk, etc.). Jobs with different rewards arrive over time and require certain amounts of resources for the duration of their service. When a job arrives, the system must decide whether to admit it or reject it, and if admitted, in which server to schedule the job. The objective is to maximize the expected total reward received by the system. This problem is motivated by control of cloud computing clusters, in which, jobs are requests for Virtual Machines or Containers that reserve resources for various services, and rewards represent service priority of requests or price paid per time unit of service by clients. We study this problem in an asymptotic regime where the number of servers and jobs' arrival rates scale by a factor L, as L becomes large. We propose a resource reservation policy that asymptotically achieves at least 1/2, and under certain monotone property on jobs' rewards and resources, at least 11/4 of the optimal expected reward. The policy automatically scales the number of VM slots for each job type as the demand changes, and decides in which servers the slots should be created in advance, without the knowledge of traffic rates. It effectively tracks a low-complexity greedy packing of existing jobs in the system while maintaining only a small number, g(L) = w(logL), of reserved VM slots for high priority jobs that pack well.
- Subjects :
- FOS: Computer and information sciences
Statistics and Probability
Schedule
Computer Networks and Communications
Computer science
Cloud computing
02 engineering and technology
Management Science and Operations Research
computer.software_genre
Resource (project management)
Server
FOS: Mathematics
0202 electrical engineering, electronic engineering, information engineering
Mathematics - Optimization and Control
Service (business)
Unit of time
business.industry
Reservation
020206 networking & telecommunications
Computer Science - Distributed, Parallel, and Cluster Computing
Optimization and Control (math.OC)
Hardware and Architecture
Virtual machine
Modeling and Simulation
020201 artificial intelligence & image processing
Distributed, Parallel, and Cluster Computing (cs.DC)
Statistics, Probability and Uncertainty
business
computer
Software
Computer network
Subjects
Details
- ISSN :
- 19465238
- Volume :
- 12
- Database :
- OpenAIRE
- Journal :
- Stochastic Systems
- Accession number :
- edsair.doi.dedup.....34a48d22a9966ce283f348ce34a2f611