Skip to content

Benchmark runner

Installing the package installs a banditry-bench CLI that exercises every agent on synthetic benchmarks:

banditry-bench --agent ofugp-gp    --benchmark branin            --n-iter 30 --seed 42
banditry-bench --agent ts-langevin --benchmark gaussian_valley   --n-iter 30 --seed 42
banditry-bench --agent ofugp-svgp  --benchmark contextual_branin --n-iter 30 --seed 42

Options

Flag Values Default
--agent ofugp-gp, ofugp-svgp, ts-langevin, ts-nuts ofugp-gp
--benchmark branin, contextual_branin, gaussian_valley, contextual_gaussian_valley gaussian_valley
--n-iter int 30
--seed int 42
--rand-sample warmup rounds 4
--noise-std-proxy float (OFUGP agents only) 1.0
--verbose flag off

The contextual_* variants sample one coordinate uniformly each round and pin it via fix_input, exercising the contextual path.

The benchmark functions themselves (branin, gaussian_valley, BENCHMARKS) are importable from banditry.benchmark for reuse in your own scripts and tests.