Experimenter

A package for easily running experiments for different parameters and saving the results in a centralised database

Package Features

• Create a local SQLite database to store the results of your experiment.
• Provides a standard structure for executing code across a range of parameters.
• Provides saving of results into the database using standard Julia types.
• Provides an @execute macro that will execute an experiment (consisting of many trails with different parameters). Can execute serially, or in parallel with a choice of multithreading or multiprocessing.
• Automatically skips completed trials.

Head over to Getting Started to get an overview of this package.

Manual Outline

• Getting Started
• • Opening the database
  • Defining the work we want to process
  • Creating an experiment
  • Examining the trials of an experiment
  • Executing an experiment
  • Getting the results
  • Re-running failed trials
  • Saving part way
  • What is an Experiment?
• Running your Experiments
• • Executing in Parallel
• Distributed Execution
• • Configuring SLURM
• Store
• • Usage
• Custom Snapshots
• Clusters
• • SLURM

Check out the API at Public API.