Commands

You can run a certain problem and optimizer combination directly with Hydra via:

python -m carps.run +problem=... +optimizer=... seed=... -m

Another option is to fill the database with all possible combinations of problems and optimizers you would like to run:

python -m carps.container.create_cluster_configs +problem=... +optimizer=... -m

Then, run them from the database with:

python -m carps.run_from_db 

To check whether any runs are missing, you can use the following command. It will create a file runcommands_missing.sh containing the missing runs:

python -m carps.utils.check_missing <rundir>

To collect all run data generated by the file logger into csv files, use the following command:

python -m carps.analysis.gather_data <rundir>

The csv files are then located in <rundir>. The logs.csv contain the trial info and values and the logs_cfg.csv contain the experiment configuration. The experiments can be matched via the column experiment_id.

Experiments with error status (or any other status) can be reset via:

python -m carps.utils.database.reset_experiments