Tabula Muris Senis Lung (random split)

All lung cells from Tabula Muris Senis, a 500k cell-atlas from 18 organs and tissues across the mouse lifespan. Split into train/test randomly. Dimensions: 24540 cells, 17985 genes. 39 cell types (avg. 629±999 cells per cell type).

Raw Scaled

Rank	Name	Mean score	Accuracy	Accuracy	F1 score	F1 score	Macro F1 score	Macro F1 score	Memory (GB)	Runtime (min)	CPU (%)	Year	Library
1	Multilayer perceptron (log scran)	0.91	0.93	0.92	0.93	0.92	0.88	0.88	5.30	37.62	777.90	1990	v1.1.3
2	Logistic regression (log CP10k)	0.91	0.93	0.92	0.93	0.92	0.89	0.88	1.30	2.85	1,254.10	2013	v1.1.3
3	Multilayer perceptron (log CP10k)	0.91	0.92	0.92	0.92	0.92	0.89	0.89	1.30	17.62	709.00	1990	v1.1.3
4	Logistic regression (log scran)	0.91	0.92	0.92	0.92	0.92	0.89	0.89	5.40	22.95	293.30	2013	v1.1.3
5	Seurat reference mapping (SCTransform)	0.89	0.91	0.90	0.91	0.90	0.88	0.88	138.70	10.60	113.50	2021	v4.3.0
6	K-neighbors classifier (log scran)	0.86	0.88	0.87	0.88	0.87	0.85	0.84	5.30	9.50	119.00	1967	v1.1.3
7	K-neighbors classifier (log CP10k)	0.86	0.87	0.86	0.87	0.86	0.86	0.86	2.10	2.37	353.10	1967	v1.1.3
8	XGBoost (log CP10k)	0.84	0.87	0.86	0.87	0.85	0.83	0.82	1.50	27.75	276.30	2016	v1.6.2
9	XGBoost (log scran)	0.83	0.86	0.85	0.86	0.85	0.81	0.81	5.60	22.75	315.20	2016	v1.6.2
10	scANVI (Seurat v3 2000 HVG)	0.68	0.86	0.84	0.82	0.80	0.42	0.40	9.30	50.58	2,406.30	2021	v0.20.0
11	scANVI (All genes)	0.62	0.81	0.80	0.76	0.74	0.34	0.32	3.80	76.55	2,788.30	2021	v0.20.0
12	scArches+scANVI (Seurat v3 2000 HVG)	0.58	0.79	0.77	0.72	0.70	0.29	0.27	9.30	72.78	2,319.60	2021	v0.20.0
13	scArches+scANVI (All genes)	0.57	0.78	0.76	0.71	0.69	0.28	0.26	6.10	46.10	2,723.50	2021	v0.20.0
14	Majority Vote	0.04	0.22	0.15	0.08	-0.01	0.01	-0.01	0.22	0.39	37.30	2022	v0.7.0