Pancreas (random split with label noise)
Raw
Scaled
Rank | Name | Mean score | Accuracy | Accuracy | F1 score | F1 score | Macro F1 score | Macro F1 score | Memory (GB) | Runtime (min) | CPU (%) | Paper | Year | Library |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Logistic regression (log CP10k) | 0.96 | 0.98 | 0.98 | 0.98 | 0.98 | 0.95 | 0.94 | 2.20 | 1.38 | 334.20 | 2013 | v1.1.3 | |
2 | Seurat reference mapping (SCTransform) | 0.96 | 0.98 | 0.98 | 0.98 | 0.98 | 0.92 | 0.92 | 20.10 | 15.17 | 108.40 | 2021 | v4.3.0 | |
3 | XGBoost (log CP10k) | 0.93 | 0.97 | 0.97 | 0.97 | 0.97 | 0.86 | 0.85 | 2.60 | 13.85 | 382.80 | 2016 | v1.6.2 | |
4 | K-neighbors classifier (log CP10k) | 0.91 | 0.96 | 0.95 | 0.96 | 0.95 | 0.85 | 0.83 | 2.30 | 2.90 | 256.80 | 1967 | v1.1.3 | |
5 | XGBoost (log scran) | 0.90 | 0.96 | 0.95 | 0.96 | 0.94 | 0.83 | 0.81 | 8.50 | 21.23 | 253.30 | 2016 | v1.6.2 | |
6 | scANVI (Seurat v3 2000 HVG) | 0.89 | 0.98 | 0.97 | 0.97 | 0.97 | 0.75 | 0.73 | 5.60 | 21.82 | 2,362.70 | 2021 | v0.20.0 | |
7 | K-neighbors classifier (log scran) | 0.86 | 0.95 | 0.93 | 0.95 | 0.93 | 0.74 | 0.71 | 8.50 | 8.50 | 120.10 | 1967 | v1.1.3 | |
8 | scANVI (All genes) | 0.85 | 0.97 | 0.96 | 0.97 | 0.96 | 0.66 | 0.64 | 4.60 | 25.00 | 2,716.10 | 2021 | v0.20.0 | |
9 | Multilayer perceptron (log scran) | 0.83 | 0.93 | 0.91 | 0.94 | 0.92 | 0.67 | 0.65 | 8.50 | 14.35 | 1,016.70 | 1990 | v1.1.3 | |
10 | scArches+scANVI (All genes) | 0.81 | 0.96 | 0.95 | 0.95 | 0.94 | 0.57 | 0.54 | 5.80 | 109.42 | 2,074.10 | 2021 | v0.20.0 | |
11 | scArches+scANVI (Seurat v3 2000 HVG) | 0.81 | 0.96 | 0.95 | 0.95 | 0.93 | 0.57 | 0.53 | 4.60 | 55.18 | 1,723.80 | 2021 | v0.20.0 | |
12 | Multilayer perceptron (log CP10k) | 0.69 | 0.81 | 0.76 | 0.84 | 0.80 | 0.55 | 0.51 | 2.20 | 2.00 | 1,422.70 | 1990 | v1.1.3 | |
13 | Logistic regression (log scran) | 0.65 | 0.83 | 0.79 | 0.80 | 0.75 | 0.44 | 0.39 | 8.50 | 16.58 | 120.50 | 2013 | v1.1.3 | |
14 | Majority Vote | 0.04 | 0.34 | 0.19 | 0.17 | -0.04 | 0.04 | -0.04 | 1.50 | 0.80 | 22.40 | 2022 | v0.7.0 |