Pancreas (random split with label noise)

Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type).

Raw Scaled

Rank	Name	Mean score	Accuracy	Accuracy	F1 score	F1 score	Macro F1 score	Macro F1 score	Memory (GB)	Runtime (min)	CPU (%)	Year	Library
1	Logistic regression (log CP10k)	0.96	0.98	0.98	0.98	0.98	0.95	0.94	2.20	1.38	334.20	2013	v1.1.3
2	Seurat reference mapping (SCTransform)	0.96	0.98	0.98	0.98	0.98	0.92	0.92	20.10	15.17	108.40	2021	v4.3.0
3	XGBoost (log CP10k)	0.93	0.97	0.97	0.97	0.97	0.86	0.85	2.60	13.85	382.80	2016	v1.6.2
4	K-neighbors classifier (log CP10k)	0.91	0.96	0.95	0.96	0.95	0.85	0.83	2.30	2.90	256.80	1967	v1.1.3
5	XGBoost (log scran)	0.90	0.96	0.95	0.96	0.94	0.83	0.81	8.50	21.23	253.30	2016	v1.6.2
6	scANVI (Seurat v3 2000 HVG)	0.89	0.98	0.97	0.97	0.97	0.75	0.73	5.60	21.82	2,362.70	2021	v0.20.0
7	K-neighbors classifier (log scran)	0.86	0.95	0.93	0.95	0.93	0.74	0.71	8.50	8.50	120.10	1967	v1.1.3
8	scANVI (All genes)	0.85	0.97	0.96	0.97	0.96	0.66	0.64	4.60	25.00	2,716.10	2021	v0.20.0
9	Multilayer perceptron (log scran)	0.83	0.93	0.91	0.94	0.92	0.67	0.65	8.50	14.35	1,016.70	1990	v1.1.3
10	scArches+scANVI (All genes)	0.81	0.96	0.95	0.95	0.94	0.57	0.54	5.80	109.42	2,074.10	2021	v0.20.0
11	scArches+scANVI (Seurat v3 2000 HVG)	0.81	0.96	0.95	0.95	0.93	0.57	0.53	4.60	55.18	1,723.80	2021	v0.20.0
12	Multilayer perceptron (log CP10k)	0.69	0.81	0.76	0.84	0.80	0.55	0.51	2.20	2.00	1,422.70	1990	v1.1.3
13	Logistic regression (log scran)	0.65	0.83	0.79	0.80	0.75	0.44	0.39	8.50	16.58	120.50	2013	v1.1.3
14	Majority Vote	0.04	0.34	0.19	0.17	-0.04	0.04	-0.04	1.50	0.80	22.40	2022	v0.7.0