Pancreas (random split)

Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type).

Raw Scaled

Rank	Name	Mean score	Accuracy	Accuracy	F1 score	F1 score	Macro F1 score	Macro F1 score	Memory (GB)	Runtime (min)	CPU (%)	Year	Library
1	Multilayer perceptron (log CP10k)	0.97	0.99	0.98	0.99	0.98	0.96	0.96	2.20	8.25	518.40	1990	v1.1.3
2	Logistic regression (log CP10k)	0.97	0.99	0.98	0.99	0.98	0.96	0.95	2.20	2.83	469.60	2013	v1.1.3
3	XGBoost (log CP10k)	0.96	0.98	0.97	0.98	0.97	0.95	0.95	2.60	12.42	316.90	2016	v1.6.2
4	Multilayer perceptron (log scran)	0.95	0.98	0.98	0.98	0.98	0.91	0.91	8.50	22.07	1,000.00	1990	v1.1.3
5	Seurat reference mapping (SCTransform)	0.95	0.98	0.97	0.98	0.97	0.90	0.89	170.60	15.63	120.80	2021	v4.3.0
6	K-neighbors classifier (log CP10k)	0.94	0.96	0.95	0.96	0.95	0.92	0.92	2.30	3.13	264.80	1967	v1.1.3
7	XGBoost (log scran)	0.94	0.97	0.96	0.97	0.96	0.91	0.90	8.50	19.72	291.50	2016	v1.6.2
8	scANVI (Seurat v3 2000 HVG)	0.87	0.98	0.97	0.97	0.97	0.69	0.67	2.30	18.20	643.90	2021	v0.20.0
9	K-neighbors classifier (log scran)	0.86	0.95	0.94	0.95	0.94	0.72	0.70	8.50	8.97	122.20	1967	v1.1.3
10	scANVI (All genes)	0.83	0.97	0.96	0.96	0.95	0.60	0.57	4.40	49.28	1,512.30	2021	v0.20.0
11	Logistic regression (log scran)	0.81	0.95	0.93	0.94	0.93	0.61	0.58	8.30	17.17	130.60	2013	v1.1.3
12	scArches+scANVI (Seurat v3 2000 HVG)	0.79	0.96	0.95	0.95	0.93	0.54	0.50	3.70	24.72	1,223.00	2021	v0.20.0
13	scArches+scANVI (All genes)	0.79	0.96	0.94	0.95	0.93	0.53	0.50	5.60	26.25	2,670.80	2021	v0.20.0
14	Majority Vote	0.04	0.35	0.18	0.18	-0.04	0.04	-0.03	0.24	1.78	11.80	2022	v0.7.0