Summary of Simulation Based Bayesian Optimization, by Roi Naveiro et al.
Simulation Based Bayesian Optimization
by Roi Naveiro, Becky Tang
First submitted to arxiv on: 19 Jan 2024
Categories
- Main: Machine Learning (stat.ML)
- Secondary: Machine Learning (cs.LG)
GrooveSquid.com Paper Summaries
GrooveSquid.com’s goal is to make artificial intelligence research accessible by summarizing AI papers in simpler terms. Each summary below covers the same AI paper, written at different levels of difficulty. The medium difficulty and low difficulty versions are original summaries written by GrooveSquid.com, while the high difficulty version is the paper’s original abstract. Feel free to learn from the version that suits you best!
| Summary difficulty | Written by | Summary |
|---|---|---|
| High | Paper authors | High Difficulty Summary Read the original abstract here |
| Medium | GrooveSquid.com (original content) | Medium Difficulty Summary This paper introduces a novel approach to Bayesian Optimization (BO) called Simulation-Based Bayesian Optimization (SBBO). BO combines prior knowledge with ongoing function evaluations to optimize black-box functions. Traditional BO uses Gaussian Processes as the surrogate model, which is ideal for smooth continuous search spaces. However, in complex scenarios involving categorical or mixed covariate spaces, GPs may not be suitable. SBBO allows the use of surrogate probabilistic models tailored for combinatorial spaces with discrete variables. Any Bayesian model that relies on Markov chain Monte Carlo can be used as the surrogate model. The authors demonstrate the effectiveness of SBBO using various choices of surrogate models in applications involving combinatorial optimization. |
| Low | GrooveSquid.com (original content) | Low Difficulty Summary This paper makes it easier to optimize things, like finding the best combination of settings for a computer program or choosing the right medicine for a patient. It does this by creating a special kind of model that can work with different types of data. This new approach is called Simulation-Based Bayesian Optimization (SBBO). Before, scientists had to use a specific type of model that worked well only for certain kinds of problems. But SBBO lets them use any model that works with complex data, which makes it more powerful and useful. |
Keywords
* Artificial intelligence * Optimization
