Presentation

The main goal of sisyphe is to provide a way to generate artifacts in an autonomous, repeatable and reproducible manner1. To achieve this goal, sisyphe relies on multiple techniques or design principles which are presented in the companion paper of this project.

Long story short, sisyphe relies on reproducible package management through the use of Nix, compartmentalisation with the help of virtual machines, and testbeds such as FIT IoT-Lab to generate binaries (e.g firmwares), datasets, models, graphs, in an automated manner.

Overview

The following figure presents the main workflow followed by the sisyphe platform.

Execution flow for a single run of a sisyphe campaign

FAQ

Where is the source code for Sisyphe ?

The source code of the platform for Sisyphe is hosted under the sisyphe github organization namespace. This source code is also backed-up by the Software Heritage project.

What are the pre-requisites to use Sisyphe ?

The project makes good use of the Nix package manager and NixOS distribution. Therefore, to design experiments, fetch build artifacts or reproduce the results locally, you should have a working copy of the Nix package manager.

How to download experiment artifacts from Sisyphe ?

Experiment artifacts are available directly on the web interface of Sisyphe, and you can download them using a browser or curl.

How to download build artifacts from Sisyphe ?

Build artifacts are made available for each run on specific subdomains of the form https://<RUN_UUID>.cache.grunblatt.org/, for example e.g. at https://9c7341f9-95c5-48ea-ad95-670b0aff9698.cache.grunblatt.org/ for the run 9c7341f9-95c5-48ea-ad95-670b0aff9698.

You can browse and download the NAR archives manually, or you can use the run store as a binary cache, e.g:

nix-store --realise /nix/store/qv1i4k82wjslgq1pbxaphh420ca2pxlp-gnrc_networking \
          --option extra-substituters https://9c7341f9-95c5-48ea-ad95-670b0aff9698.cache.grunblatt.org/ \
          --option require-sigs false

If the binary was available in the binary cache, it should now be present in the /nix/store hierarchy:

    $ ls -alh /nix/store/qv1i4k82wjslgq1pbxaphh420ca2pxlp-gnrc_networking/
    total 11M
    dr-xr-xr-x    2 root root   4,0K  1 janv.  1970 .
    drwxrwxr-t 6975 root nixbld 7,5M  6 juil. 09:56 ..
    -r-xr-xr-x    1 root root   2,9M  1 janv.  1970 gnrc_networking.elf

Can I propose some experiment to run on Sisyphe ?

Yes ! We plan to open the platform for any one in the coming weeks, but right now you can contact Rémy for any specific information on how to do so.

How to download the companion paper data ?

Due to its size, the experiment artifacts for the companion paper is hosted in a specific manner (torrent files). The torrent files are available here:

  1. We adopt the ACM Artifact Review and Badging Version 1.1 terminology for the terms repeatability, reproducibility and replicability. ↩