There are some cases where a hyperparameter is a range of values. An example of this is the quantile_range in scikit-learn Robust Scaler
Currently, a user could separate this range in two values, upper and lower bounds, and set two different float hyperparameters, but then proposals should have to be discarded also on the user side in the cases where the lower bound is higher than the upper bound.
A part from that, having to split a single hyperparameter in two conditioned parts to interact with BTB makes the automation of the process much more complicated.
Can we think of a way to support such hyperparameters natively inside BTB?
There are some cases where a hyperparameter is a range of values. An example of this is the
quantile_rangein scikit-learn Robust ScalerCurrently, a user could separate this range in two values, upper and lower bounds, and set two different float hyperparameters, but then proposals should have to be discarded also on the user side in the cases where the lower bound is higher than the upper bound.
A part from that, having to split a single hyperparameter in two conditioned parts to interact with BTB makes the automation of the process much more complicated.
Can we think of a way to support such hyperparameters natively inside BTB?