Getting started

To get started with contributing to OpenProblems, you’ll need to fork and clone the OpenProblems repository to your local machine.

Step 1: Create a fork

Go to the OpenProblems repository at https://github.com/openproblems-bio/openproblems-v2 and click on the “Fork” button in the top right corner of the page.

This will create a copy of the repository under your GitHub account.

Tip

While you’re at it, why not click the “Star” button as well?

Step 2: Clone the repository

To clone this forked repository to your local machine, copy the URL of the forked repository by clicking the green “Code” button and selecting HTTPS or SSH.

In your terminal or command prompt, navigate to the directory where you want to clone the repository and enter the following command:

git clone <forked repository URL> openproblems-v2
cd openproblems-v2

This will download a copy of the repository to your local machine. You can now make changes to the code, add new functionality, and commit your changes.

Step 3: Download test resources

You will also need to download the test resources by running the following command. These are needed for testing the existing components and can be used for developing new unit tests. From the repository root, run:

viash run src/common/sync_test_resources/config.vsh.yaml

Output

Completed 86 Bytes/71.6 MiB (326 Bytes/s) with 91 file(s) remaining
download: s3://openproblems-data/resources_test/batch_integration/pancreas/state.yaml to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/batch_integration/pancreas/state.yaml
Completed 86 Bytes/71.6 MiB (326 Bytes/s) with 90 file(s) remaining
Completed 256.1 KiB/71.6 MiB (656.5 KiB/s) with 90 file(s) remaining
Completed 512.1 KiB/71.6 MiB (1.3 MiB/s) with 90 file(s) remaining  
Completed 768.1 KiB/71.6 MiB (1.9 MiB/s) with 90 file(s) remaining  
Completed 1.0 MiB/71.6 MiB (2.4 MiB/s) with 90 file(s) remaining    
Completed 1.3 MiB/71.6 MiB (3.0 MiB/s) with 90 file(s) remaining    
Completed 1.5 MiB/71.6 MiB (3.5 MiB/s) with 90 file(s) remaining    
Completed 1.8 MiB/71.6 MiB (4.1 MiB/s) with 90 file(s) remaining    
Completed 2.0 MiB/71.6 MiB (4.7 MiB/s) with 90 file(s) remaining    
Completed 2.3 MiB/71.6 MiB (5.2 MiB/s) with 90 file(s) remaining    
Completed 2.5 MiB/71.6 MiB (5.8 MiB/s) with 90 file(s) remaining    
Completed 2.6 MiB/71.6 MiB (5.9 MiB/s) with 90 file(s) remaining    
download: s3://openproblems-data/resources_test/batch_integration/pancreas/solution.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/batch_integration/pancreas/solution.h5ad
Completed 2.6 MiB/71.6 MiB (5.9 MiB/s) with 89 file(s) remaining
Completed 2.9 MiB/71.6 MiB (6.3 MiB/s) with 89 file(s) remaining
Completed 3.1 MiB/71.6 MiB (6.8 MiB/s) with 89 file(s) remaining
Completed 3.4 MiB/71.6 MiB (7.3 MiB/s) with 89 file(s) remaining
Completed 3.6 MiB/71.6 MiB (7.9 MiB/s) with 89 file(s) remaining
Completed 3.6 MiB/71.6 MiB (7.9 MiB/s) with 89 file(s) remaining
download: s3://openproblems-data/resources_test/batch_integration/pancreas/integrated_feature.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/batch_integration/pancreas/integrated_feature.h5ad
Completed 3.6 MiB/71.6 MiB (7.9 MiB/s) with 88 file(s) remaining
Completed 3.9 MiB/71.6 MiB (8.4 MiB/s) with 88 file(s) remaining
Completed 4.1 MiB/71.6 MiB (8.9 MiB/s) with 88 file(s) remaining
Completed 4.2 MiB/71.6 MiB (9.0 MiB/s) with 88 file(s) remaining
download: s3://openproblems-data/resources_test/batch_integration/pancreas/integrated_graph.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/batch_integration/pancreas/integrated_graph.h5ad
Completed 4.2 MiB/71.6 MiB (9.0 MiB/s) with 87 file(s) remaining
Completed 4.4 MiB/71.6 MiB (9.5 MiB/s) with 87 file(s) remaining
Completed 4.6 MiB/71.6 MiB (9.8 MiB/s) with 87 file(s) remaining
download: s3://openproblems-data/resources_test/batch_integration/pancreas/integrated_embedding.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/batch_integration/pancreas/integrated_embedding.h5ad
Completed 4.6 MiB/71.6 MiB (9.8 MiB/s) with 86 file(s) remaining
Completed 4.8 MiB/71.6 MiB (10.3 MiB/s) with 86 file(s) remaining
Completed 5.1 MiB/71.6 MiB (10.8 MiB/s) with 86 file(s) remaining
Completed 5.3 MiB/71.6 MiB (11.3 MiB/s) with 86 file(s) remaining
Completed 5.6 MiB/71.6 MiB (11.6 MiB/s) with 86 file(s) remaining
Completed 5.8 MiB/71.6 MiB (12.1 MiB/s) with 86 file(s) remaining
Completed 6.1 MiB/71.6 MiB (12.4 MiB/s) with 86 file(s) remaining
Completed 6.3 MiB/71.6 MiB (12.8 MiB/s) with 86 file(s) remaining
Completed 6.4 MiB/71.6 MiB (12.9 MiB/s) with 86 file(s) remaining
download: s3://openproblems-data/resources_test/common/bmmc_cite_starter/dataset_adt.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/bmmc_cite_starter/dataset_adt.h5ad
Completed 6.4 MiB/71.6 MiB (12.9 MiB/s) with 85 file(s) remaining
Completed 6.7 MiB/71.6 MiB (13.4 MiB/s) with 85 file(s) remaining
Completed 6.8 MiB/71.6 MiB (13.2 MiB/s) with 85 file(s) remaining
download: s3://openproblems-data/resources_test/batch_integration/pancreas/dataset.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/batch_integration/pancreas/dataset.h5ad
Completed 6.8 MiB/71.6 MiB (13.2 MiB/s) with 84 file(s) remaining
Completed 7.0 MiB/71.6 MiB (13.5 MiB/s) with 84 file(s) remaining
Completed 7.3 MiB/71.6 MiB (13.9 MiB/s) with 84 file(s) remaining
Completed 7.5 MiB/71.6 MiB (14.2 MiB/s) with 84 file(s) remaining
Completed 7.8 MiB/71.6 MiB (14.6 MiB/s) with 84 file(s) remaining
Completed 8.0 MiB/71.6 MiB (14.8 MiB/s) with 84 file(s) remaining
Completed 8.3 MiB/71.6 MiB (14.8 MiB/s) with 84 file(s) remaining
Completed 8.5 MiB/71.6 MiB (15.2 MiB/s) with 84 file(s) remaining
Completed 8.8 MiB/71.6 MiB (15.5 MiB/s) with 84 file(s) remaining
Completed 9.0 MiB/71.6 MiB (15.9 MiB/s) with 84 file(s) remaining
Completed 9.3 MiB/71.6 MiB (16.3 MiB/s) with 84 file(s) remaining
Completed 9.5 MiB/71.6 MiB (16.7 MiB/s) with 84 file(s) remaining
Completed 9.8 MiB/71.6 MiB (17.1 MiB/s) with 84 file(s) remaining
Completed 10.0 MiB/71.6 MiB (17.5 MiB/s) with 84 file(s) remaining
Completed 10.3 MiB/71.6 MiB (17.9 MiB/s) with 84 file(s) remaining
Completed 10.5 MiB/71.6 MiB (18.4 MiB/s) with 84 file(s) remaining
Completed 10.8 MiB/71.6 MiB (18.7 MiB/s) with 84 file(s) remaining
Completed 11.0 MiB/71.6 MiB (19.1 MiB/s) with 84 file(s) remaining
Completed 11.3 MiB/71.6 MiB (19.6 MiB/s) with 84 file(s) remaining
Completed 11.5 MiB/71.6 MiB (19.9 MiB/s) with 84 file(s) remaining
Completed 11.8 MiB/71.6 MiB (20.3 MiB/s) with 84 file(s) remaining
Completed 12.0 MiB/71.6 MiB (20.7 MiB/s) with 84 file(s) remaining
Completed 12.3 MiB/71.6 MiB (21.2 MiB/s) with 84 file(s) remaining
Completed 12.5 MiB/71.6 MiB (21.5 MiB/s) with 84 file(s) remaining
Completed 12.8 MiB/71.6 MiB (21.3 MiB/s) with 84 file(s) remaining
Completed 13.0 MiB/71.6 MiB (21.7 MiB/s) with 84 file(s) remaining
Completed 13.3 MiB/71.6 MiB (22.1 MiB/s) with 84 file(s) remaining
Completed 13.5 MiB/71.6 MiB (22.5 MiB/s) with 84 file(s) remaining
Completed 13.8 MiB/71.6 MiB (22.8 MiB/s) with 84 file(s) remaining
Completed 14.0 MiB/71.6 MiB (23.2 MiB/s) with 84 file(s) remaining
Completed 14.3 MiB/71.6 MiB (23.6 MiB/s) with 84 file(s) remaining
Completed 14.5 MiB/71.6 MiB (24.0 MiB/s) with 84 file(s) remaining
Completed 14.8 MiB/71.6 MiB (24.4 MiB/s) with 84 file(s) remaining
Completed 15.0 MiB/71.6 MiB (24.8 MiB/s) with 84 file(s) remaining
Completed 15.3 MiB/71.6 MiB (25.2 MiB/s) with 84 file(s) remaining
Completed 15.5 MiB/71.6 MiB (25.6 MiB/s) with 84 file(s) remaining
Completed 15.8 MiB/71.6 MiB (26.0 MiB/s) with 84 file(s) remaining
Completed 16.0 MiB/71.6 MiB (26.4 MiB/s) with 84 file(s) remaining
Completed 16.3 MiB/71.6 MiB (26.7 MiB/s) with 84 file(s) remaining
Completed 16.5 MiB/71.6 MiB (27.0 MiB/s) with 84 file(s) remaining
Completed 16.8 MiB/71.6 MiB (27.3 MiB/s) with 84 file(s) remaining
Completed 17.0 MiB/71.6 MiB (27.7 MiB/s) with 84 file(s) remaining
Completed 17.3 MiB/71.6 MiB (28.1 MiB/s) with 84 file(s) remaining
Completed 17.4 MiB/71.6 MiB (28.2 MiB/s) with 84 file(s) remaining
download: s3://openproblems-data/resources_test/common/pancreas/hvg.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/pancreas/hvg.h5ad
Completed 17.4 MiB/71.6 MiB (28.2 MiB/s) with 83 file(s) remaining
Completed 17.6 MiB/71.6 MiB (28.3 MiB/s) with 83 file(s) remaining
Completed 17.9 MiB/71.6 MiB (28.7 MiB/s) with 83 file(s) remaining
Completed 18.1 MiB/71.6 MiB (29.1 MiB/s) with 83 file(s) remaining
Completed 18.4 MiB/71.6 MiB (29.5 MiB/s) with 83 file(s) remaining
Completed 18.6 MiB/71.6 MiB (29.8 MiB/s) with 83 file(s) remaining
Completed 18.9 MiB/71.6 MiB (30.1 MiB/s) with 83 file(s) remaining
Completed 19.0 MiB/71.6 MiB (30.3 MiB/s) with 83 file(s) remaining
Completed 19.2 MiB/71.6 MiB (30.5 MiB/s) with 83 file(s) remaining
Completed 19.5 MiB/71.6 MiB (30.8 MiB/s) with 83 file(s) remaining
Completed 19.7 MiB/71.6 MiB (31.2 MiB/s) with 83 file(s) remaining
Completed 20.0 MiB/71.6 MiB (31.6 MiB/s) with 83 file(s) remaining
Completed 20.0 MiB/71.6 MiB (31.7 MiB/s) with 83 file(s) remaining
download: s3://openproblems-data/resources_test/common/pancreas/normalized.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/pancreas/normalized.h5ad
Completed 20.0 MiB/71.6 MiB (31.7 MiB/s) with 82 file(s) remaining
Completed 20.3 MiB/71.6 MiB (32.0 MiB/s) with 82 file(s) remaining
Completed 20.5 MiB/71.6 MiB (32.1 MiB/s) with 82 file(s) remaining
Completed 20.8 MiB/71.6 MiB (32.4 MiB/s) with 82 file(s) remaining
Completed 21.0 MiB/71.6 MiB (32.7 MiB/s) with 82 file(s) remaining
Completed 21.3 MiB/71.6 MiB (33.1 MiB/s) with 82 file(s) remaining
Completed 21.5 MiB/71.6 MiB (33.4 MiB/s) with 82 file(s) remaining
Completed 21.8 MiB/71.6 MiB (33.8 MiB/s) with 82 file(s) remaining
Completed 22.0 MiB/71.6 MiB (34.1 MiB/s) with 82 file(s) remaining
Completed 22.3 MiB/71.6 MiB (34.4 MiB/s) with 82 file(s) remaining
Completed 22.5 MiB/71.6 MiB (34.8 MiB/s) with 82 file(s) remaining
Completed 22.8 MiB/71.6 MiB (35.1 MiB/s) with 82 file(s) remaining
Completed 23.0 MiB/71.6 MiB (35.4 MiB/s) with 82 file(s) remaining
Completed 23.3 MiB/71.6 MiB (35.8 MiB/s) with 82 file(s) remaining
Completed 23.5 MiB/71.6 MiB (36.1 MiB/s) with 82 file(s) remaining
Completed 23.8 MiB/71.6 MiB (36.4 MiB/s) with 82 file(s) remaining
Completed 24.0 MiB/71.6 MiB (36.7 MiB/s) with 82 file(s) remaining
Completed 24.3 MiB/71.6 MiB (37.1 MiB/s) with 82 file(s) remaining
Completed 24.5 MiB/71.6 MiB (37.4 MiB/s) with 82 file(s) remaining
Completed 24.8 MiB/71.6 MiB (37.8 MiB/s) with 82 file(s) remaining
Completed 25.0 MiB/71.6 MiB (38.1 MiB/s) with 82 file(s) remaining
Completed 25.3 MiB/71.6 MiB (38.4 MiB/s) with 82 file(s) remaining
Completed 25.5 MiB/71.6 MiB (38.8 MiB/s) with 82 file(s) remaining
Completed 25.8 MiB/71.6 MiB (39.0 MiB/s) with 82 file(s) remaining
Completed 26.0 MiB/71.6 MiB (38.6 MiB/s) with 82 file(s) remaining
Completed 26.0 MiB/71.6 MiB (38.4 MiB/s) with 82 file(s) remaining
download: s3://openproblems-data/resources_test/common/pancreas/state.yaml to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/pancreas/state.yaml
Completed 26.0 MiB/71.6 MiB (38.4 MiB/s) with 81 file(s) remaining
Completed 26.3 MiB/71.6 MiB (38.7 MiB/s) with 81 file(s) remaining
Completed 26.4 MiB/71.6 MiB (38.8 MiB/s) with 81 file(s) remaining
download: s3://openproblems-data/resources_test/common/pancreas/pca.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/pancreas/pca.h5ad
Completed 26.4 MiB/71.6 MiB (38.8 MiB/s) with 80 file(s) remaining
Completed 26.6 MiB/71.6 MiB (39.0 MiB/s) with 80 file(s) remaining
Completed 26.9 MiB/71.6 MiB (39.3 MiB/s) with 80 file(s) remaining
Completed 27.1 MiB/71.6 MiB (39.6 MiB/s) with 80 file(s) remaining
download: s3://openproblems-data/resources_test/common/bmmc_multiome_starter/dataset_atac.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/bmmc_multiome_starter/dataset_atac.h5ad
Completed 27.1 MiB/71.6 MiB (39.6 MiB/s) with 79 file(s) remaining
Completed 27.4 MiB/71.6 MiB (39.7 MiB/s) with 79 file(s) remaining
Completed 27.6 MiB/71.6 MiB (39.9 MiB/s) with 79 file(s) remaining
Completed 27.6 MiB/71.6 MiB (39.9 MiB/s) with 79 file(s) remaining
download: s3://openproblems-data/resources_test/common/bmmc_multiome_starter/dataset_rna.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/bmmc_multiome_starter/dataset_rna.h5ad
Completed 27.6 MiB/71.6 MiB (39.9 MiB/s) with 78 file(s) remaining
download: s3://openproblems-data/resources_test/common/pancreas/knn.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/pancreas/knn.h5ad
Completed 27.6 MiB/71.6 MiB (39.9 MiB/s) with 77 file(s) remaining
Completed 27.6 MiB/71.6 MiB (39.7 MiB/s) with 77 file(s) remaining
download: s3://openproblems-data/resources_test/common/pancreas/dataset_metadata.yaml to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/pancreas/dataset_metadata.yaml
Completed 27.6 MiB/71.6 MiB (39.7 MiB/s) with 76 file(s) remaining
Completed 27.8 MiB/71.6 MiB (39.9 MiB/s) with 76 file(s) remaining
Completed 27.9 MiB/71.6 MiB (39.9 MiB/s) with 76 file(s) remaining
download: s3://openproblems-data/resources_test/common/pancreas/dataset.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/pancreas/dataset.h5ad
Completed 27.9 MiB/71.6 MiB (39.9 MiB/s) with 75 file(s) remaining
Completed 28.1 MiB/71.6 MiB (40.1 MiB/s) with 75 file(s) remaining
Completed 28.4 MiB/71.6 MiB (39.8 MiB/s) with 75 file(s) remaining
Completed 28.6 MiB/71.6 MiB (40.1 MiB/s) with 75 file(s) remaining
Completed 28.9 MiB/71.6 MiB (40.4 MiB/s) with 75 file(s) remaining
Completed 29.1 MiB/71.6 MiB (40.7 MiB/s) with 75 file(s) remaining
Completed 29.4 MiB/71.6 MiB (41.0 MiB/s) with 75 file(s) remaining
Completed 29.4 MiB/71.6 MiB (41.0 MiB/s) with 75 file(s) remaining
download: s3://openproblems-data/resources_test/common/pancreas/raw.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/pancreas/raw.h5ad
Completed 29.4 MiB/71.6 MiB (41.0 MiB/s) with 74 file(s) remaining
Completed 29.4 MiB/71.6 MiB (40.6 MiB/s) with 74 file(s) remaining
download: s3://openproblems-data/resources_test/common/scicar_cell_lines/dataset_metadata_mod2.yaml to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/scicar_cell_lines/dataset_metadata_mod2.yaml
Completed 29.4 MiB/71.6 MiB (40.6 MiB/s) with 73 file(s) remaining
Completed 29.7 MiB/71.6 MiB (40.0 MiB/s) with 73 file(s) remaining
Completed 29.7 MiB/71.6 MiB (40.0 MiB/s) with 73 file(s) remaining
download: s3://openproblems-data/resources_test/common/bmmc_cite_starter/dataset_rna.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/bmmc_cite_starter/dataset_rna.h5ad
Completed 29.7 MiB/71.6 MiB (40.0 MiB/s) with 72 file(s) remaining
Completed 29.7 MiB/71.6 MiB (39.7 MiB/s) with 72 file(s) remaining
download: s3://openproblems-data/resources_test/denoising/pancreas/score.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/denoising/pancreas/score.h5ad
Completed 29.7 MiB/71.6 MiB (39.7 MiB/s) with 71 file(s) remaining
Completed 29.7 MiB/71.6 MiB (39.4 MiB/s) with 71 file(s) remaining
download: s3://openproblems-data/resources_test/common/scicar_cell_lines/dataset_metadata_mod1.yaml to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/scicar_cell_lines/dataset_metadata_mod1.yaml
Completed 29.7 MiB/71.6 MiB (39.4 MiB/s) with 70 file(s) remaining
Completed 29.7 MiB/71.6 MiB (39.2 MiB/s) with 70 file(s) remaining
download: s3://openproblems-data/resources_test/common/task_metadata/method_info.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/task_metadata/method_info.json
Completed 29.7 MiB/71.6 MiB (39.2 MiB/s) with 69 file(s) remaining
Completed 29.7 MiB/71.6 MiB (38.7 MiB/s) with 69 file(s) remaining
download: s3://openproblems-data/resources_test/denoising/pancreas/metrics.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/denoising/pancreas/metrics.json
Completed 29.7 MiB/71.6 MiB (38.7 MiB/s) with 68 file(s) remaining
Completed 29.7 MiB/71.6 MiB (37.8 MiB/s) with 68 file(s) remaining
download: s3://openproblems-data/resources_test/common/traces.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/traces.json
Completed 29.7 MiB/71.6 MiB (37.8 MiB/s) with 67 file(s) remaining
Completed 29.7 MiB/71.6 MiB (37.7 MiB/s) with 67 file(s) remaining
download: s3://openproblems-data/resources_test/denoising/pancreas/scores.tsv to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/denoising/pancreas/scores.tsv
Completed 29.7 MiB/71.6 MiB (37.7 MiB/s) with 66 file(s) remaining
Completed 30.0 MiB/71.6 MiB (37.6 MiB/s) with 66 file(s) remaining
Completed 30.2 MiB/71.6 MiB (37.7 MiB/s) with 66 file(s) remaining
Completed 30.5 MiB/71.6 MiB (38.0 MiB/s) with 66 file(s) remaining
Completed 30.7 MiB/71.6 MiB (38.2 MiB/s) with 66 file(s) remaining
Completed 31.0 MiB/71.6 MiB (38.5 MiB/s) with 66 file(s) remaining
Completed 31.2 MiB/71.6 MiB (38.7 MiB/s) with 66 file(s) remaining
Completed 31.3 MiB/71.6 MiB (38.6 MiB/s) with 66 file(s) remaining
Completed 31.5 MiB/71.6 MiB (38.8 MiB/s) with 66 file(s) remaining
Completed 31.5 MiB/71.6 MiB (38.8 MiB/s) with 66 file(s) remaining
download: s3://openproblems-data/resources_test/denoising/pancreas/test.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/denoising/pancreas/test.h5ad
Completed 31.5 MiB/71.6 MiB (38.8 MiB/s) with 65 file(s) remaining
download: s3://openproblems-data/resources_test/denoising/pancreas/traces.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/denoising/pancreas/traces.json
Completed 31.5 MiB/71.6 MiB (38.8 MiB/s) with 64 file(s) remaining
Completed 31.8 MiB/71.6 MiB (38.7 MiB/s) with 64 file(s) remaining
Completed 32.0 MiB/71.6 MiB (39.0 MiB/s) with 64 file(s) remaining
Completed 32.3 MiB/71.6 MiB (39.2 MiB/s) with 64 file(s) remaining
Completed 32.5 MiB/71.6 MiB (39.4 MiB/s) with 64 file(s) remaining
download: s3://openproblems-data/resources_test/common/scicar_cell_lines/dataset_mod2.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/scicar_cell_lines/dataset_mod2.h5ad
Completed 32.5 MiB/71.6 MiB (39.4 MiB/s) with 63 file(s) remaining
Completed 32.5 MiB/71.6 MiB (39.3 MiB/s) with 63 file(s) remaining
download: s3://openproblems-data/resources_test/common/task_metadata/input_git_sha.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/task_metadata/input_git_sha.json
Completed 32.5 MiB/71.6 MiB (39.3 MiB/s) with 62 file(s) remaining
Completed 32.7 MiB/71.6 MiB (39.4 MiB/s) with 62 file(s) remaining
Completed 32.8 MiB/71.6 MiB (39.3 MiB/s) with 62 file(s) remaining
download: s3://openproblems-data/resources_test/denoising/pancreas/methods.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/denoising/pancreas/methods.json
Completed 32.8 MiB/71.6 MiB (39.3 MiB/s) with 61 file(s) remaining
Completed 33.0 MiB/71.6 MiB (39.4 MiB/s) with 61 file(s) remaining
Completed 33.3 MiB/71.6 MiB (39.7 MiB/s) with 61 file(s) remaining
Completed 33.5 MiB/71.6 MiB (39.9 MiB/s) with 61 file(s) remaining
Completed 33.8 MiB/71.6 MiB (40.2 MiB/s) with 61 file(s) remaining
Completed 34.0 MiB/71.6 MiB (40.5 MiB/s) with 61 file(s) remaining
Completed 34.3 MiB/71.6 MiB (40.7 MiB/s) with 61 file(s) remaining
Completed 34.5 MiB/71.6 MiB (41.0 MiB/s) with 61 file(s) remaining
Completed 34.8 MiB/71.6 MiB (41.1 MiB/s) with 61 file(s) remaining
Completed 35.0 MiB/71.6 MiB (41.3 MiB/s) with 61 file(s) remaining
Completed 35.3 MiB/71.6 MiB (41.6 MiB/s) with 61 file(s) remaining
Completed 35.5 MiB/71.6 MiB (41.5 MiB/s) with 61 file(s) remaining
Completed 35.8 MiB/71.6 MiB (41.4 MiB/s) with 61 file(s) remaining
Completed 35.8 MiB/71.6 MiB (41.2 MiB/s) with 61 file(s) remaining
Completed 36.0 MiB/71.6 MiB (41.5 MiB/s) with 61 file(s) remaining
download: s3://openproblems-data/resources_test/common/scicar_cell_lines/state.yaml to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/scicar_cell_lines/state.yaml
Completed 36.0 MiB/71.6 MiB (41.5 MiB/s) with 60 file(s) remaining
Completed 36.1 MiB/71.6 MiB (41.3 MiB/s) with 60 file(s) remaining
download: s3://openproblems-data/resources_test/dimensionality_reduction/pancreas/embedding.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/dimensionality_reduction/pancreas/embedding.h5ad
Completed 36.1 MiB/71.6 MiB (41.3 MiB/s) with 59 file(s) remaining
Completed 36.3 MiB/71.6 MiB (41.3 MiB/s) with 59 file(s) remaining
Completed 36.6 MiB/71.6 MiB (41.6 MiB/s) with 59 file(s) remaining
Completed 36.8 MiB/71.6 MiB (41.8 MiB/s) with 59 file(s) remaining
Completed 37.1 MiB/71.6 MiB (42.1 MiB/s) with 59 file(s) remaining
Completed 37.3 MiB/71.6 MiB (42.3 MiB/s) with 59 file(s) remaining
Completed 37.6 MiB/71.6 MiB (42.6 MiB/s) with 59 file(s) remaining
Completed 37.8 MiB/71.6 MiB (42.8 MiB/s) with 59 file(s) remaining
Completed 38.1 MiB/71.6 MiB (43.1 MiB/s) with 59 file(s) remaining
Completed 38.3 MiB/71.6 MiB (43.3 MiB/s) with 59 file(s) remaining
Completed 38.6 MiB/71.6 MiB (43.6 MiB/s) with 59 file(s) remaining
Completed 38.7 MiB/71.6 MiB (43.7 MiB/s) with 59 file(s) remaining
download: s3://openproblems-data/resources_test/denoising/pancreas/denoised.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/denoising/pancreas/denoised.h5ad
Completed 38.7 MiB/71.6 MiB (43.7 MiB/s) with 58 file(s) remaining
Completed 38.8 MiB/71.6 MiB (43.4 MiB/s) with 58 file(s) remaining
Completed 39.0 MiB/71.6 MiB (43.7 MiB/s) with 58 file(s) remaining
Completed 39.3 MiB/71.6 MiB (43.9 MiB/s) with 58 file(s) remaining
Completed 39.3 MiB/71.6 MiB (43.9 MiB/s) with 58 file(s) remaining
download: s3://openproblems-data/resources_test/denoising/pancreas/train.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/denoising/pancreas/train.h5ad
Completed 39.3 MiB/71.6 MiB (43.9 MiB/s) with 57 file(s) remaining
Completed 39.3 MiB/71.6 MiB (43.8 MiB/s) with 57 file(s) remaining
download: s3://openproblems-data/resources_test/dimensionality_reduction/pancreas/scores.tsv to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/dimensionality_reduction/pancreas/scores.tsv
Completed 39.3 MiB/71.6 MiB (43.8 MiB/s) with 56 file(s) remaining
download: s3://openproblems-data/resources_test/dimensionality_reduction/pancreas/metrics.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/dimensionality_reduction/pancreas/metrics.json
Completed 39.3 MiB/71.6 MiB (43.8 MiB/s) with 55 file(s) remaining
Completed 39.6 MiB/71.6 MiB (43.9 MiB/s) with 55 file(s) remaining
Completed 39.6 MiB/71.6 MiB (44.0 MiB/s) with 55 file(s) remaining
download: s3://openproblems-data/resources_test/common/scicar_cell_lines/dataset_mod1.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/common/scicar_cell_lines/dataset_mod1.h5ad
Completed 39.6 MiB/71.6 MiB (44.0 MiB/s) with 54 file(s) remaining
Completed 39.6 MiB/71.6 MiB (42.3 MiB/s) with 54 file(s) remaining
Completed 39.7 MiB/71.6 MiB (42.4 MiB/s) with 54 file(s) remaining
download: s3://openproblems-data/resources_test/dimensionality_reduction/pancreas/methods.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/dimensionality_reduction/pancreas/methods.json
Completed 39.7 MiB/71.6 MiB (42.4 MiB/s) with 53 file(s) remaining
download: s3://openproblems-data/resources_test/dimensionality_reduction/pancreas/traces.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/dimensionality_reduction/pancreas/traces.json
Completed 39.7 MiB/71.6 MiB (42.4 MiB/s) with 52 file(s) remaining
Completed 39.7 MiB/71.6 MiB (42.2 MiB/s) with 52 file(s) remaining
download: s3://openproblems-data/resources_test/dimensionality_reduction/pancreas/score.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/dimensionality_reduction/pancreas/score.h5ad
Completed 39.7 MiB/71.6 MiB (42.2 MiB/s) with 51 file(s) remaining
Completed 40.0 MiB/71.6 MiB (42.1 MiB/s) with 51 file(s) remaining
Completed 40.0 MiB/71.6 MiB (41.6 MiB/s) with 51 file(s) remaining
download: s3://openproblems-data/resources_test/label_projection/pancreas/metrics.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/label_projection/pancreas/metrics.json
Completed 40.0 MiB/71.6 MiB (41.6 MiB/s) with 50 file(s) remaining
Completed 40.0 MiB/71.6 MiB (39.7 MiB/s) with 50 file(s) remaining
download: s3://openproblems-data/resources_test/label_projection/pancreas/traces.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/label_projection/pancreas/traces.json
Completed 40.0 MiB/71.6 MiB (39.7 MiB/s) with 49 file(s) remaining
Completed 40.2 MiB/71.6 MiB (39.5 MiB/s) with 49 file(s) remaining
Completed 40.4 MiB/71.6 MiB (39.7 MiB/s) with 49 file(s) remaining
download: s3://openproblems-data/resources_test/label_projection/pancreas/methods.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/label_projection/pancreas/methods.json
Completed 40.4 MiB/71.6 MiB (39.7 MiB/s) with 48 file(s) remaining
Completed 40.4 MiB/71.6 MiB (39.5 MiB/s) with 48 file(s) remaining
Completed 40.7 MiB/71.6 MiB (39.8 MiB/s) with 48 file(s) remaining
Completed 40.9 MiB/71.6 MiB (40.0 MiB/s) with 48 file(s) remaining
Completed 41.0 MiB/71.6 MiB (40.0 MiB/s) with 48 file(s) remaining
download: s3://openproblems-data/resources_test/dimensionality_reduction/pancreas/solution.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/dimensionality_reduction/pancreas/solution.h5ad
Completed 41.0 MiB/71.6 MiB (40.0 MiB/s) with 47 file(s) remaining
download: s3://openproblems-data/resources_test/label_projection/pancreas/scores.tsv to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/label_projection/pancreas/scores.tsv
Completed 41.0 MiB/71.6 MiB (40.0 MiB/s) with 46 file(s) remaining
Completed 41.2 MiB/71.6 MiB (40.1 MiB/s) with 46 file(s) remaining
download: s3://openproblems-data/resources_test/label_projection/pancreas/solution.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/label_projection/pancreas/solution.h5ad
Completed 41.2 MiB/71.6 MiB (40.1 MiB/s) with 45 file(s) remaining
Completed 41.3 MiB/71.6 MiB (39.1 MiB/s) with 45 file(s) remaining
download: s3://openproblems-data/resources_test/label_projection/pancreas/knn_accuracy.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/label_projection/pancreas/knn_accuracy.h5ad
Completed 41.3 MiB/71.6 MiB (39.1 MiB/s) with 44 file(s) remaining
Completed 41.6 MiB/71.6 MiB (39.0 MiB/s) with 44 file(s) remaining
Completed 41.6 MiB/71.6 MiB (38.5 MiB/s) with 44 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter/metrics.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter/metrics.json
Completed 41.6 MiB/71.6 MiB (38.5 MiB/s) with 43 file(s) remaining
Completed 41.8 MiB/71.6 MiB (38.5 MiB/s) with 43 file(s) remaining
Completed 41.9 MiB/71.6 MiB (38.6 MiB/s) with 43 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter/score.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter/score.h5ad
Completed 41.9 MiB/71.6 MiB (38.6 MiB/s) with 42 file(s) remaining
download: s3://openproblems-data/resources_test/label_projection/pancreas/test.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/label_projection/pancreas/test.h5ad
Completed 41.9 MiB/71.6 MiB (38.6 MiB/s) with 41 file(s) remaining
Completed 42.0 MiB/71.6 MiB (37.2 MiB/s) with 41 file(s) remaining
Completed 42.3 MiB/71.6 MiB (37.4 MiB/s) with 41 file(s) remaining
download: s3://openproblems-data/resources_test/label_projection/pancreas/knn.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/label_projection/pancreas/knn.h5ad
Completed 42.3 MiB/71.6 MiB (37.4 MiB/s) with 40 file(s) remaining
Completed 42.5 MiB/71.6 MiB (37.5 MiB/s) with 40 file(s) remaining
Completed 42.7 MiB/71.6 MiB (37.7 MiB/s) with 40 file(s) remaining
Completed 42.9 MiB/71.6 MiB (37.9 MiB/s) with 40 file(s) remaining
download: s3://openproblems-data/resources_test/label_projection/pancreas/train.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/label_projection/pancreas/train.h5ad
Completed 42.9 MiB/71.6 MiB (37.9 MiB/s) with 39 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter/methods.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter/methods.json
Completed 42.9 MiB/71.6 MiB (37.9 MiB/s) with 38 file(s) remaining
Completed 42.9 MiB/71.6 MiB (37.7 MiB/s) with 38 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter/scores.tsv to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter/scores.tsv
Completed 42.9 MiB/71.6 MiB (37.7 MiB/s) with 37 file(s) remaining
Completed 43.2 MiB/71.6 MiB (37.6 MiB/s) with 37 file(s) remaining
Completed 43.2 MiB/71.6 MiB (37.6 MiB/s) with 37 file(s) remaining
download: s3://openproblems-data/resources_test/dimensionality_reduction/pancreas/dataset.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/dimensionality_reduction/pancreas/dataset.h5ad
Completed 43.2 MiB/71.6 MiB (37.6 MiB/s) with 36 file(s) remaining
Completed 43.2 MiB/71.6 MiB (36.7 MiB/s) with 36 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter/traces.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter/traces.json
Completed 43.2 MiB/71.6 MiB (36.7 MiB/s) with 35 file(s) remaining
Completed 43.3 MiB/71.6 MiB (36.3 MiB/s) with 35 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter_swapped/metrics.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter_swapped/metrics.json
Completed 43.3 MiB/71.6 MiB (36.3 MiB/s) with 34 file(s) remaining
Completed 43.5 MiB/71.6 MiB (36.3 MiB/s) with 34 file(s) remaining
Completed 43.8 MiB/71.6 MiB (36.5 MiB/s) with 34 file(s) remaining
Completed 44.0 MiB/71.6 MiB (36.6 MiB/s) with 34 file(s) remaining
Completed 44.3 MiB/71.6 MiB (36.8 MiB/s) with 34 file(s) remaining
Completed 44.5 MiB/71.6 MiB (37.0 MiB/s) with 34 file(s) remaining
Completed 44.8 MiB/71.6 MiB (37.2 MiB/s) with 34 file(s) remaining
Completed 44.8 MiB/71.6 MiB (37.2 MiB/s) with 34 file(s) remaining
Completed 45.0 MiB/71.6 MiB (37.4 MiB/s) with 34 file(s) remaining
Completed 45.2 MiB/71.6 MiB (37.5 MiB/s) with 34 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter/test_mod2.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter/test_mod2.h5ad
Completed 45.2 MiB/71.6 MiB (37.5 MiB/s) with 33 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter/prediction.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter/prediction.h5ad
Completed 45.2 MiB/71.6 MiB (37.5 MiB/s) with 32 file(s) remaining
Completed 45.4 MiB/71.6 MiB (37.3 MiB/s) with 32 file(s) remaining
Completed 45.5 MiB/71.6 MiB (37.3 MiB/s) with 32 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter/train_mod1.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter/train_mod1.h5ad
Completed 45.5 MiB/71.6 MiB (37.3 MiB/s) with 31 file(s) remaining
Completed 45.7 MiB/71.6 MiB (37.5 MiB/s) with 31 file(s) remaining
Completed 46.0 MiB/71.6 MiB (37.7 MiB/s) with 31 file(s) remaining
Completed 46.0 MiB/71.6 MiB (37.7 MiB/s) with 31 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter/test_mod1.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter/test_mod1.h5ad
Completed 46.0 MiB/71.6 MiB (37.7 MiB/s) with 30 file(s) remaining
Completed 46.3 MiB/71.6 MiB (37.8 MiB/s) with 30 file(s) remaining
Completed 46.5 MiB/71.6 MiB (38.0 MiB/s) with 30 file(s) remaining
Completed 46.5 MiB/71.6 MiB (38.0 MiB/s) with 30 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter/train_mod2.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter/train_mod2.h5ad
Completed 46.5 MiB/71.6 MiB (38.0 MiB/s) with 29 file(s) remaining
Completed 46.5 MiB/71.6 MiB (37.7 MiB/s) with 29 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter_swapped/score.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter_swapped/score.h5ad
Completed 46.5 MiB/71.6 MiB (37.7 MiB/s) with 28 file(s) remaining
Completed 46.6 MiB/71.6 MiB (37.5 MiB/s) with 28 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter_swapped/traces.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter_swapped/traces.json
Completed 46.6 MiB/71.6 MiB (37.5 MiB/s) with 27 file(s) remaining
Completed 46.6 MiB/71.6 MiB (37.3 MiB/s) with 27 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter_swapped/scores.tsv to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter_swapped/scores.tsv
Completed 46.6 MiB/71.6 MiB (37.3 MiB/s) with 26 file(s) remaining
Completed 46.8 MiB/71.6 MiB (36.8 MiB/s) with 26 file(s) remaining
Completed 46.8 MiB/71.6 MiB (36.7 MiB/s) with 26 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter_swapped/prediction.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter_swapped/prediction.h5ad
Completed 46.8 MiB/71.6 MiB (36.7 MiB/s) with 25 file(s) remaining
Completed 46.9 MiB/71.6 MiB (36.5 MiB/s) with 25 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter/score.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter/score.h5ad
Completed 46.9 MiB/71.6 MiB (36.5 MiB/s) with 24 file(s) remaining
Completed 46.9 MiB/71.6 MiB (36.0 MiB/s) with 24 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter/metrics.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter/metrics.json
Completed 46.9 MiB/71.6 MiB (36.0 MiB/s) with 23 file(s) remaining
Completed 47.1 MiB/71.6 MiB (36.0 MiB/s) with 23 file(s) remaining
Completed 47.4 MiB/71.6 MiB (36.2 MiB/s) with 23 file(s) remaining
Completed 47.6 MiB/71.6 MiB (36.4 MiB/s) with 23 file(s) remaining
Completed 47.7 MiB/71.6 MiB (36.4 MiB/s) with 23 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter_swapped/test_mod1.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter_swapped/test_mod1.h5ad
Completed 47.7 MiB/71.6 MiB (36.4 MiB/s) with 22 file(s) remaining
Completed 47.8 MiB/71.6 MiB (36.4 MiB/s) with 22 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter_swapped/methods.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter_swapped/methods.json
Completed 47.8 MiB/71.6 MiB (36.4 MiB/s) with 21 file(s) remaining
Completed 48.0 MiB/71.6 MiB (36.4 MiB/s) with 21 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter/methods.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter/methods.json
Completed 48.0 MiB/71.6 MiB (36.4 MiB/s) with 20 file(s) remaining
Completed 48.0 MiB/71.6 MiB (36.0 MiB/s) with 20 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter/scores.tsv to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter/scores.tsv
Completed 48.0 MiB/71.6 MiB (36.0 MiB/s) with 19 file(s) remaining
Completed 48.3 MiB/71.6 MiB (35.6 MiB/s) with 19 file(s) remaining
Completed 48.3 MiB/71.6 MiB (35.6 MiB/s) with 19 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter_swapped/test_mod2.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter_swapped/test_mod2.h5ad
Completed 48.3 MiB/71.6 MiB (35.6 MiB/s) with 18 file(s) remaining
Completed 48.6 MiB/71.6 MiB (35.7 MiB/s) with 18 file(s) remaining
Completed 48.8 MiB/71.6 MiB (35.8 MiB/s) with 18 file(s) remaining
Completed 49.1 MiB/71.6 MiB (36.0 MiB/s) with 18 file(s) remaining
Completed 49.3 MiB/71.6 MiB (36.1 MiB/s) with 18 file(s) remaining
Completed 49.3 MiB/71.6 MiB (36.1 MiB/s) with 18 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter_swapped/train_mod1.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter_swapped/train_mod1.h5ad
Completed 49.3 MiB/71.6 MiB (36.1 MiB/s) with 17 file(s) remaining
Completed 49.6 MiB/71.6 MiB (36.3 MiB/s) with 17 file(s) remaining
Completed 49.8 MiB/71.6 MiB (36.4 MiB/s) with 17 file(s) remaining
Completed 49.9 MiB/71.6 MiB (36.5 MiB/s) with 17 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter/prediction.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter/prediction.h5ad
Completed 49.9 MiB/71.6 MiB (36.5 MiB/s) with 16 file(s) remaining
Completed 50.0 MiB/71.6 MiB (36.3 MiB/s) with 16 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter_swapped/metrics.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter_swapped/metrics.json
Completed 50.0 MiB/71.6 MiB (36.3 MiB/s) with 15 file(s) remaining
Completed 50.0 MiB/71.6 MiB (36.2 MiB/s) with 15 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter/traces.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter/traces.json
Completed 50.0 MiB/71.6 MiB (36.2 MiB/s) with 14 file(s) remaining
Completed 50.2 MiB/71.6 MiB (35.8 MiB/s) with 14 file(s) remaining
Completed 50.4 MiB/71.6 MiB (35.9 MiB/s) with 14 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter/test_mod2.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter/test_mod2.h5ad
Completed 50.4 MiB/71.6 MiB (35.9 MiB/s) with 13 file(s) remaining
Completed 50.4 MiB/71.6 MiB (35.8 MiB/s) with 13 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter_swapped/score.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter_swapped/score.h5ad
Completed 50.4 MiB/71.6 MiB (35.8 MiB/s) with 12 file(s) remaining
Completed 50.6 MiB/71.6 MiB (35.6 MiB/s) with 12 file(s) remaining
Completed 50.7 MiB/71.6 MiB (35.6 MiB/s) with 12 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_cite_starter_swapped/train_mod2.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_cite_starter_swapped/train_mod2.h5ad
Completed 50.7 MiB/71.6 MiB (35.6 MiB/s) with 11 file(s) remaining
Completed 50.7 MiB/71.6 MiB (35.2 MiB/s) with 11 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter_swapped/scores.tsv to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter_swapped/scores.tsv
Completed 50.7 MiB/71.6 MiB (35.2 MiB/s) with 10 file(s) remaining
Completed 50.9 MiB/71.6 MiB (34.9 MiB/s) with 10 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter_swapped/prediction.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter_swapped/prediction.h5ad
Completed 50.9 MiB/71.6 MiB (34.9 MiB/s) with 9 file(s) remaining
Completed 51.2 MiB/71.6 MiB (35.0 MiB/s) with 9 file(s) remaining
Completed 51.4 MiB/71.6 MiB (35.1 MiB/s) with 9 file(s) remaining
Completed 51.7 MiB/71.6 MiB (35.3 MiB/s) with 9 file(s) remaining
Completed 51.9 MiB/71.6 MiB (35.4 MiB/s) with 9 file(s) remaining
Completed 52.2 MiB/71.6 MiB (35.5 MiB/s) with 9 file(s) remaining
Completed 52.4 MiB/71.6 MiB (35.7 MiB/s) with 9 file(s) remaining
Completed 52.7 MiB/71.6 MiB (35.8 MiB/s) with 9 file(s) remaining
Completed 52.7 MiB/71.6 MiB (35.3 MiB/s) with 9 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter_swapped/traces.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter_swapped/traces.json
Completed 52.7 MiB/71.6 MiB (35.3 MiB/s) with 8 file(s) remaining
Completed 52.9 MiB/71.6 MiB (35.4 MiB/s) with 8 file(s) remaining
Completed 53.2 MiB/71.6 MiB (35.6 MiB/s) with 8 file(s) remaining
Completed 53.4 MiB/71.6 MiB (35.7 MiB/s) with 8 file(s) remaining
Completed 53.7 MiB/71.6 MiB (35.8 MiB/s) with 8 file(s) remaining
Completed 53.9 MiB/71.6 MiB (36.0 MiB/s) with 8 file(s) remaining
Completed 54.2 MiB/71.6 MiB (36.1 MiB/s) with 8 file(s) remaining
Completed 54.4 MiB/71.6 MiB (36.3 MiB/s) with 8 file(s) remaining
Completed 54.7 MiB/71.6 MiB (36.4 MiB/s) with 8 file(s) remaining
Completed 54.9 MiB/71.6 MiB (36.6 MiB/s) with 8 file(s) remaining
Completed 55.1 MiB/71.6 MiB (36.4 MiB/s) with 8 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter_swapped/methods.json to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter_swapped/methods.json
Completed 55.1 MiB/71.6 MiB (36.4 MiB/s) with 7 file(s) remaining
Completed 55.4 MiB/71.6 MiB (35.8 MiB/s) with 7 file(s) remaining
Completed 55.5 MiB/71.6 MiB (35.8 MiB/s) with 7 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter/train_mod2.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter/train_mod2.h5ad
Completed 55.5 MiB/71.6 MiB (35.8 MiB/s) with 6 file(s) remaining
Completed 55.7 MiB/71.6 MiB (35.8 MiB/s) with 6 file(s) remaining
Completed 55.8 MiB/71.6 MiB (35.8 MiB/s) with 6 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter_swapped/train_mod1.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter_swapped/train_mod1.h5ad
Completed 55.8 MiB/71.6 MiB (35.8 MiB/s) with 5 file(s) remaining
Completed 56.0 MiB/71.6 MiB (35.6 MiB/s) with 5 file(s) remaining
Completed 56.2 MiB/71.6 MiB (35.7 MiB/s) with 5 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter_swapped/test_mod1.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter_swapped/test_mod1.h5ad
Completed 56.2 MiB/71.6 MiB (35.7 MiB/s) with 4 file(s) remaining
Completed 56.4 MiB/71.6 MiB (35.3 MiB/s) with 4 file(s) remaining
Completed 56.7 MiB/71.6 MiB (35.4 MiB/s) with 4 file(s) remaining
Completed 56.9 MiB/71.6 MiB (35.5 MiB/s) with 4 file(s) remaining
Completed 57.2 MiB/71.6 MiB (35.7 MiB/s) with 4 file(s) remaining
Completed 57.4 MiB/71.6 MiB (35.8 MiB/s) with 4 file(s) remaining
Completed 57.7 MiB/71.6 MiB (36.0 MiB/s) with 4 file(s) remaining
Completed 57.9 MiB/71.6 MiB (36.1 MiB/s) with 4 file(s) remaining
Completed 58.2 MiB/71.6 MiB (36.2 MiB/s) with 4 file(s) remaining
Completed 58.2 MiB/71.6 MiB (36.2 MiB/s) with 4 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter/train_mod1.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter/train_mod1.h5ad
Completed 58.2 MiB/71.6 MiB (36.2 MiB/s) with 3 file(s) remaining
Completed 58.5 MiB/71.6 MiB (35.9 MiB/s) with 3 file(s) remaining
Completed 58.7 MiB/71.6 MiB (35.8 MiB/s) with 3 file(s) remaining
Completed 59.0 MiB/71.6 MiB (35.9 MiB/s) with 3 file(s) remaining
Completed 59.2 MiB/71.6 MiB (36.1 MiB/s) with 3 file(s) remaining
Completed 59.5 MiB/71.6 MiB (36.2 MiB/s) with 3 file(s) remaining
Completed 59.7 MiB/71.6 MiB (36.4 MiB/s) with 3 file(s) remaining
Completed 60.0 MiB/71.6 MiB (36.5 MiB/s) with 3 file(s) remaining
Completed 60.2 MiB/71.6 MiB (36.6 MiB/s) with 3 file(s) remaining
Completed 60.5 MiB/71.6 MiB (36.8 MiB/s) with 3 file(s) remaining
Completed 60.7 MiB/71.6 MiB (36.9 MiB/s) with 3 file(s) remaining
Completed 61.0 MiB/71.6 MiB (37.0 MiB/s) with 3 file(s) remaining
Completed 61.2 MiB/71.6 MiB (37.1 MiB/s) with 3 file(s) remaining
Completed 61.5 MiB/71.6 MiB (36.6 MiB/s) with 3 file(s) remaining
Completed 61.7 MiB/71.6 MiB (36.7 MiB/s) with 3 file(s) remaining
Completed 62.0 MiB/71.6 MiB (36.8 MiB/s) with 3 file(s) remaining
Completed 62.2 MiB/71.6 MiB (37.0 MiB/s) with 3 file(s) remaining
Completed 62.4 MiB/71.6 MiB (37.1 MiB/s) with 3 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter/test_mod1.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter/test_mod1.h5ad
Completed 62.4 MiB/71.6 MiB (37.1 MiB/s) with 2 file(s) remaining
Completed 62.6 MiB/71.6 MiB (37.1 MiB/s) with 2 file(s) remaining
Completed 62.9 MiB/71.6 MiB (36.8 MiB/s) with 2 file(s) remaining
Completed 63.1 MiB/71.6 MiB (36.5 MiB/s) with 2 file(s) remaining
Completed 63.4 MiB/71.6 MiB (36.2 MiB/s) with 2 file(s) remaining
Completed 63.6 MiB/71.6 MiB (36.0 MiB/s) with 2 file(s) remaining
Completed 63.9 MiB/71.6 MiB (35.3 MiB/s) with 2 file(s) remaining
Completed 64.1 MiB/71.6 MiB (35.1 MiB/s) with 2 file(s) remaining
Completed 64.4 MiB/71.6 MiB (34.8 MiB/s) with 2 file(s) remaining
Completed 64.6 MiB/71.6 MiB (34.9 MiB/s) with 2 file(s) remaining
Completed 64.9 MiB/71.6 MiB (34.8 MiB/s) with 2 file(s) remaining
Completed 65.1 MiB/71.6 MiB (34.5 MiB/s) with 2 file(s) remaining
Completed 65.4 MiB/71.6 MiB (34.3 MiB/s) with 2 file(s) remaining
Completed 65.6 MiB/71.6 MiB (34.0 MiB/s) with 2 file(s) remaining
Completed 65.9 MiB/71.6 MiB (34.1 MiB/s) with 2 file(s) remaining
Completed 66.1 MiB/71.6 MiB (34.0 MiB/s) with 2 file(s) remaining
Completed 66.4 MiB/71.6 MiB (33.7 MiB/s) with 2 file(s) remaining
Completed 66.6 MiB/71.6 MiB (33.5 MiB/s) with 2 file(s) remaining
Completed 66.9 MiB/71.6 MiB (33.3 MiB/s) with 2 file(s) remaining
Completed 67.1 MiB/71.6 MiB (33.4 MiB/s) with 2 file(s) remaining
Completed 67.4 MiB/71.6 MiB (33.2 MiB/s) with 2 file(s) remaining
Completed 67.6 MiB/71.6 MiB (33.0 MiB/s) with 2 file(s) remaining
Completed 67.9 MiB/71.6 MiB (33.1 MiB/s) with 2 file(s) remaining
Completed 68.1 MiB/71.6 MiB (32.9 MiB/s) with 2 file(s) remaining
Completed 68.4 MiB/71.6 MiB (32.7 MiB/s) with 2 file(s) remaining
Completed 68.6 MiB/71.6 MiB (32.6 MiB/s) with 2 file(s) remaining
Completed 68.9 MiB/71.6 MiB (32.4 MiB/s) with 2 file(s) remaining
Completed 69.1 MiB/71.6 MiB (32.5 MiB/s) with 2 file(s) remaining
Completed 69.4 MiB/71.6 MiB (32.3 MiB/s) with 2 file(s) remaining
Completed 69.6 MiB/71.6 MiB (32.1 MiB/s) with 2 file(s) remaining
Completed 69.9 MiB/71.6 MiB (32.2 MiB/s) with 2 file(s) remaining
Completed 70.1 MiB/71.6 MiB (32.1 MiB/s) with 2 file(s) remaining
Completed 70.4 MiB/71.6 MiB (31.9 MiB/s) with 2 file(s) remaining
Completed 70.5 MiB/71.6 MiB (32.0 MiB/s) with 2 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter_swapped/test_mod2.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter_swapped/test_mod2.h5ad
Completed 70.5 MiB/71.6 MiB (32.0 MiB/s) with 1 file(s) remaining
Completed 70.8 MiB/71.6 MiB (31.8 MiB/s) with 1 file(s) remaining
Completed 71.0 MiB/71.6 MiB (31.4 MiB/s) with 1 file(s) remaining
Completed 71.3 MiB/71.6 MiB (31.5 MiB/s) with 1 file(s) remaining
Completed 71.5 MiB/71.6 MiB (31.0 MiB/s) with 1 file(s) remaining
Completed 71.6 MiB/71.6 MiB (31.1 MiB/s) with 1 file(s) remaining
download: s3://openproblems-data/resources_test/predict_modality/bmmc_multiome_starter_swapped/train_mod2.h5ad to ../viash_automount/home/runner/work/website/website/_openproblems-v2/resources_test/predict_modality/bmmc_multiome_starter_swapped/train_mod2.h5ad

The test resources are stored in the resources_test directory.

Ready, set, go!

That’s it! Now you should be able to test whether the existing components work as expected and then start adding functionality to the pipeline. Running an existing component is as simple as running a command in your terminal. Using test data as input, you can try this out immediately.

Run a component

Use the viash run command to run a Viash component. Everything after the -- separator counts as the arguments of the component itself. In this case, the knn component has an --input_train and --input_test argument to which the test resources are passed.

viash run src/tasks/label_projection/methods/knn/config.vsh.yaml -- \
  --input_train resources_test/label_projection/pancreas/train.h5ad \
  --input_test resources_test/label_projection/pancreas/test.h5ad \
  --output output.h5ad

Output

[notice] Checking if Docker image is available at 'ghcr.io/openproblems-bio/label_projection/methods/knn:dev'
[warning] Could not pull from 'ghcr.io/openproblems-bio/label_projection/methods/knn:dev'. Docker image doesn't exist or is not accessible.
[notice] Building container 'ghcr.io/openproblems-bio/label_projection/methods/knn:dev' with Dockerfile
Load input data
Fit to train data
Predict on test data
Write output to file

Testing components

Testing components is an important part of the development process. Each tasks comes with pre-defined unit tests that can be run using the viash test command.

viash test src/tasks/label_projection/methods/knn/config.vsh.yaml

Output

Running tests in temporary directory: '/tmp/viash_test_knn7328529810300093355'
====================================================================
+/tmp/viash_test_knn7328529810300093355/build_executable/knn ---verbosity 6 ---setup cachedbuild
[notice] Building container 'ghcr.io/openproblems-bio/label_projection/methods/knn:test' with Dockerfile
[info] Running 'docker build -t ghcr.io/openproblems-bio/label_projection/methods/knn:test /tmp/viash_test_knn7328529810300093355/build_executable -f /tmp/viash_test_knn7328529810300093355/build_executable/tmp/dockerbuild-knn-JrsEqh/Dockerfile'
#0 building with "default" instance using docker driver

#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 DONE 0.0s

#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 590B done
#2 DONE 0.0s

#3 [internal] load metadata for ghcr.io/openproblems-bio/base_python:1.0.1
#3 DONE 0.2s

#4 [1/2] FROM ghcr.io/openproblems-bio/base_python:1.0.1@sha256:54ab73ef47dee4b0ba32bcacab08b760351d118943e4b30d7476f9a85072303d
#4 DONE 0.0s

#5 [2/2] RUN pip install --upgrade pip &&   pip install --upgrade --no-cache-dir "scikit-learn" "jsonschema"
#5 CACHED

#6 exporting to image
#6 exporting layers done
#6 writing image sha256:9e4a9a7aabe0987e43f223e3714ce9adf1297b4477ff4f75a61c0155275bca60 done
#6 naming to ghcr.io/openproblems-bio/label_projection/methods/knn:test done
#6 DONE 0.0s
====================================================================
+/tmp/viash_test_knn7328529810300093355/test_check_method_config/test_executable
Load config data
Check general fields
Check info fields
All checks succeeded!
====================================================================
+/tmp/viash_test_knn7328529810300093355/test_run_and_check_adata/test_executable
>> Checking whether input files exist
>> Running script as test
Load input data
Fit to train data
Predict on test data
Write output to file
>> Checking whether output file exists
>> Reading h5ad files and checking formats
Reading and checking input_train
  AnnData object with n_obs × n_vars = 400 × 500
    obs: 'label', 'batch'
    var: 'hvg', 'hvg_score'
    uns: 'dataset_id', 'normalization_id'
    obsm: 'X_pca'
    layers: 'counts', 'normalized'
Reading and checking input_test
  AnnData object with n_obs × n_vars = 100 × 500
    obs: 'batch'
    var: 'hvg', 'hvg_score'
    uns: 'dataset_id', 'normalization_id'
    obsm: 'X_pca'
    layers: 'counts', 'normalized'
Reading and checking output
  AnnData object with n_obs × n_vars = 100 × 500
    obs: 'batch', 'label_pred'
    var: 'hvg', 'hvg_score'
    uns: 'dataset_id', 'method_id', 'normalization_id'
    obsm: 'X_pca'
    layers: 'counts', 'normalized'
All checks succeeded!
====================================================================
[32mSUCCESS! All 2 out of 2 test scripts succeeded![0m
Cleaning up temporary directory

If you want to run the unit tests for all of the components of a task, you can use the viash ns test command.

viash ns test --query label_projection --parallel --platform docker

Output

             namespace        functionality             platform            test_name exit_code duration               result
label_projection/methods  logistic_regression               docker                start                                        
label_projection/methods               scanvi               docker                start                                        
label_projection/methods                  knn               docker                start                                        
label_projection/methods                  mlp               docker                start                                        
label_projection/metrics             accuracy               docker                start                                        
label_projection/metrics                   f1               docker                start
label_projection/methods  logistic_regression               docker     build_executable         0        4              SUCCESS
label_projection/methods  logistic_regression               docker      generic_test.py         0        9              SUCCESS
label_projection/metrics                   f1               docker     build_executable         0        7              SUCCESS
label_projection/metrics                   f1               docker      format_check.py         0        8              SUCCESS
label_projection/metrics             accuracy               docker     build_executable         0        8              SUCCESS
label_projection/metrics             accuracy               docker      format_check.py         0        7              SUCCESS
...