Rethinking Trust Region Bayesian Optimization in High Dimensions

Trust Region Bayesian Optimization (TuRBO) is a popular method for tackling high-dimensional black-box optimization, but it suffers from a subtle flaw: its local Gaussian process (GP) model can become either overly complex or overly simple as the problem dimension and trust region size change. This degeneration leads to suboptimal performance, especially in high dimensions. To fix this, researchers Wei-Ting Tang and Joel A. Paulson from Ohio State University introduce AdaScale-TuRBO, a straightforward variant that dynamically scales the GP lengthscale with both the problem dimension and the trust region side length. This preserves kernel geometry and maintains consistent prior complexity, preventing the model from losing predictive power.

In empirical tests, AdaScale-TuRBO robustly outperforms standard TuRBO and other leading high-dimensional Bayesian optimization methods on synthetic benchmarks and a real-world trajectory planning task. The paper, titled "Rethinking Trust Region Bayesian Optimization in High Dimensions," is available on arXiv (2604.22967) and demonstrates that a simple scaling fix can yield significant gains in high-dimensional optimization. For professionals working on hyperparameter tuning, robotics, or design optimization, this means more reliable and efficient exploration of high-dimensional spaces without manual tuning of the GP model.