Key Points
- Snakemake allows one to run their data analyses and share them with
others
- Benchmarks live in the
detector_benchmarks and
physics_benchmarks repositories
- A benchmark is added to GitLab CI by creating a
config.yml and including it from
.gitlab-ci.yml
- Benchmarks are submitted and tested through GitHub pull requests
that trigger eicweb GitLab pipelines
- Create
setup.config to switch between using the
simulation campaign and re-simulating events
- Each stage of the benchmark pipeline is defined in
config.yml
-
config.yml takes normal bash scripts as input
- Copy resulting figures over to the
results directory to
turn them into artifacts
- Status flags are used to indicate detrimental changes to
software/detector design
- Add a status flag to your benchmark to alert developers to changes
in performance
