New auto-scaling framework hits 99.88% accuracy for serverless environments
Multi-model ensemble predicts resource demand and slashes costs by 20%...
Serverless computing promises automatic scaling, but dynamic workloads and cold-start latency make it hard. A new paper from researchers presents a dependency-aware autoscaling framework that tackles these issues head-on. It models serverless apps as directed dependency graphs, identifies bottleneck functions using weighted degree centrality, then combines lightweight MLP, LSTM, and CNN models via a performance-weighted probabilistic ensemble (inspired by Bayesian model averaging). The controller factors in cold-start penalties and costs to choose between scale-up, scale-down, or hold actions.
Experiments with real workload traces show supervised forecasting significantly outperforms unsupervised clustering. The proposed ensemble achieves 99.88% prediction accuracy, cutting forecasting errors compared to hybrid methods. Across multiple cloud pricing models, the framework consistently reduces infrastructure costs while hitting performance targets. This combination of dependency analysis, multi-expert forecasting, and cost-aware control offers a robust, practical solution for serverless autoscaling.
- Uses graph-based dependency analysis to identify critical serverless functions via weighted degree centrality.
- Combines MLP, LSTM, and CNN in a performance-weighted probabilistic ensemble for 99.88% prediction accuracy.
- Cost-aware controller with cold-start awareness reduces infrastructure costs across multiple cloud pricing models.
Why It Matters
A practical, cost-saving auto-scaling solution for serverless apps that handles real-world workload unpredictability.