Demo python notebook crashes when using calibration. about robyn HOT 3 CLOSED

Hi @pvizan-artefact, This error is caused by the small number of models created by robin_run. In Step 3, can you increase the number of iterations or trials (for example, iterations=2000, trials=5, etc.) and try again to see if the error can be corrected?

from robyn.

@yu-ya-tanaka the suggested change does indeed solve the error (changing iterations from 200 to 2000). Only doubt I still have is why decreasing the number of iterations causes this error? How does it change the value of pareto_fronts and makes the code crash? Is there a rule of thumb for the number of iterations needed for the pareto_fronts = "auto" to work? Thanks a lot!

from robyn.

@pvizan-artefact
If pareto_fronts=“auto", 100 models are selected.
In your case, I think you got error with the following flow.

1. Created 1000 models (200 iterations and 5 trials) with calibration.
2. 100 models was selected from 1000 models by setting calibration_constraint = default (0.1).
3. Robyn tried to select 100 models with setting pareto_fronts = “auto”(100) from 100 models and got error.

Regarding iterations size, 2000 is recommended for the dummy dataset with no calibration.
We recommend to run at least 2000 iterations per trial and 10 trials to build initial model with calibration.
But this is a general guide and you need to consider what iterations and trials is best based on your input data with checking convergence, model performance, and match with business sense.

from robyn.