Multi-Fidelity Optimization¶
Multi-fidelity refers to running an algorithm on multiple budgets (such as number of epochs or
subsets of data) and thereby evaluating the performance prematurely. You can run a multi-fidelity optimization
when using Successive Halving or
Hyperband. Hyperband is the default intensifier in the
multi-fidelity facade and requires the arguments
min_budget and max_budget in the scenario if no instances are used.
In general, multi-fidelity works for both real-valued and instance budgets. In the real-valued case,
the budget is directly passed to the target function. In the instance case, the budget is not passed to the
target function but min_budget and max_budget are used internally to determine the number of instances of
each stage. That’s also the reason why min_budget and max_budget are not required when using instances:
The max_budget is simply the max number of instances, whereas the min_budget is simply 1.
Please have a look into our multi-fidelity examples to see how to use multi-fidelity optimization in real-world applications.