Risk-Constrained Reinforcement Learning for SLO-Driven Cloud-Native Elastic Scaling

Authors
  • Peifeng Hu

    University of Southern California, Los Angeles, USA

  • Guy Uziel

    University of Illinois at Urbana Champagne, Champagne, USA

  • Xinyin Ma

    University of Illinois at Urbana Champagne, Champagne, USA

Abstract

Cloud native architectures enable on-demand scalability through containerization and automated orchestration. However, their highly dynamic operating environments and complex service dependencies make it difficult for rule-based or threshold-driven elastic scaling strategies to simultaneously ensure service quality and system stability. To address this challenge, this paper proposes a reinforcement learning based policy optimization method for cloud native elastic scaling. The resource adjustment process is modeled from a sequential decision perspective within a unified framework. System operational states are used as inputs, and policy learning captures the relationship between scaling actions and long-term operational outcomes. Service level objective constraints and risk constraints are jointly incorporated into the optimization objective to avoid unstable decisions driven solely by immediate reward. Service level objectives guide the policy to focus on global operational consistency and maintain close alignment with actual business experience. Risk constraints suppress aggressive actions under extreme conditions and reduce the probability of service level violations and system oscillations. Within the unified modeling framework, policy optimization balances performance assurance and resource efficiency and adapts to the dynamic characteristics of cloud native environments. Comparative analysis based on open source real cluster traces shows consistent and robust advantages across multiple key evaluation metrics, validating the effectiveness and practical value of combining service-level objective-driven learning with risk-constrained optimization for cloud native elastic scaling.

References
Cover Image
Downloads
Published
2024-02-28
Section
Articles
License
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.

How to Cite

Risk-Constrained Reinforcement Learning for SLO-Driven Cloud-Native Elastic Scaling. (2024). Journal of Computer Technology and Software, 3(1). https://doi.org/10.5281/zenodo.21528574