arrow
Return

Pattern Learning and Knowledge Distillation for Single-Cell Data Annotation

delete2025-12-19
delete0
delete
OA
AI
M
Ming Zhang *
R
Ren, Boran
X
Xuedong Li
DOI:10.3390/biology15010002delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Transferring cell type annotations from reference dataset to query dataset is a fundamental problem in AI-based single-cell data analysis. However, single-cell measurement techniques lead to domain gaps between multiple batches or datasets. The existing deep learning methods lack consideration on batch integration when learning reference annotations, which is a challenge for cell type annotation on multiple query batches. For cell representation, batch integration can not only eliminate the gaps between batches or datasets but also improve the heterogeneity of cell clusters. In this study, we proposed PLKD, a cell type annotation method based on pattern learning and knowledge distillation. PLKD consists of Teacher (Transformer) and Student (MLP). Teacher groups all input genes (features) into different gene sets (patterns), and each pattern represents a specific biological function. This design enables model to focus on biologically relevant functions interaction rather than gene-level expression that is susceptible to gaps of batches. In addition, knowledge distillation makes lightweight Student resistant to noise, allowing Student to infer quickly and robustly. Furthermore, PLKD supports multi-modal cell type annotation, multi-modal integration and other tasks. Benchmark experiments demonstrate that PLKD is able to achieve accurate and robust cell type annotation.
Keywords:
pattern learning
knowledge distillation
cell type annotation
batch integration

Journal

B
Biology-Basel
IF:
3.5
Papers:
881
Citations:
0

Organization

C
chengdu university of information technology
Scholars:
836
Papers: 330
Citations: 0
H
Hangzhou Normal University
Scholars:
916
Papers: 311
Citations: 1.0W
S
sun yat sen university
Scholars:
1.2W
Papers: 3.9K
Citations: 1.2K
researcher View more organizations
Cited Papers

Cited Papers

Transcriptome-scale spatial gene expression in the human dorsolateral prefrontal cortex
err2021-02-08
err0
errOAAI
errKristen R. Maynard; Leonardo Collado-Torres; Lukas M. Weber; Cedric Uytingco; Brianna K. Barry; Stephen R. Williams; Joseph L. Catallini; Matthew N. Tran; Zachary Besich; Madhavi Tippani; Jennifer Chew; Yifeng Yin; Joel E. Kleinman; Thomas M. Hyde; Nikhil Rao; Stephanie C. Hicks; Keri Martinowich; Andrew E. Jaffe
errShare
errSave
Modal-NexT: Towards unified heterogeneous cellular data integration
err2025-07-11
err0
PREAI
errZhenchao Tang; Guanxing Chen; Shouzhi Chen; Haohuai He; Jiehui Huang; Tiejun Dong; Jun Zhou; Lu Zhao; Linlin You; Calvin Yu-Chian Chen
errShare
errSave
The scverse project provides a computational ecosystem for single-cell omics data analysis
err2023-04-10
err60
PREAI
errVirshup, Isaac; Bredikhin, Danila; Heumos, Lukas; Palla, Giovanni; Sturm, Gregor; Gayoso, Adam; Kats, Ilia; Koutrouli, Mikaela; Berger, Bonnie; Pe'er, Dana; Regev, Aviv; Teichmann, Sarah; Finotello, Francesca; Wolf, F. Alexander; Yosef, Nir; Stegle, Oliver; Theis, Fabian; Angerer, Philipp; Bergen, Volker; Boyeau, Pierre D.; Buettner, Maren; Eraslan, Gokcen; Fischer, David; Frank, Max C.; Hong, Justin; Klein, Michal; Lange, Marius; Lopez, Romain; Lotfollahi, Mohammad; Luecken, Malte; Ramirez, Fidel A.; Regier, Jeffrey; Rybakov, Sergei; Schaar, Anna; Valiollah Pour Amiri, Valeh; Weiler, Philipp J.; Xing, Galen
errShare
errSave
Bi-order multimodal integration of single-cell data
err2022-05-09
err21
errOAAI
errDou, Jinzhuang; Liang, Shaoheng; Mohanty, Vakul; Miao, Qi; Huang, Yuefan; Liang, Qingnan; Cheng, Xuesen; Kim, Sangbae; Choi, Jongsu; Li, Yumei; Li, Li; Daher, May; Basar, Rafet; Rezvani, Katayoun; Chen, Rui; Chen, Ken
errShare
errSave
Integrated analysis of multimodal single-cell data
errCell
IF0
err2021-06-01
err0
errOAAI
errYuhan Hao; Stephanie Hao; Erica Andersen-Nissen; William M. Mauck; Shiwei Zheng; Andrew Butler; Maddie J. Lee; Aaron J. Wilk; Charlotte Darby; Michael Zager; Paul Hoffman; Marlon Stoeckius; Efthymia Papalexi; Eleni P. Mimitou; Jaison Jain; Avi Srivastava; Tim Stuart; Lamar M. Fleming; Bertrand Yeung; Angela J. Rogers; Juliana M. McElrath; Catherine A. Blish; Raphael Gottardo; Peter Smibert; Rahul Satija
errShare
errSave
Comprehensive Integration of Single-Cell Data
errCell
IF0
err2019-06-01
err0
errOAAI
errTim Stuart; Andrew Butler; Paul Hoffman; Christoph Hafemeister; Efthymia Papalexi; William M. Mauck; Yuhan Hao; Marlon Stoeckius; Peter Smibert; Rahul Satija
errShare
errSave
Transfer learning enables predictions in network biology
err2023-05-31
err0
errOAAI
errChristina V. Theodoris; Ling Xiao; Anant Chopra; Mark D. Chaffin; Zeina R. Al Sayed; Matthew C. Hill; Helene Mantineo; Elizabeth M. Brydon; Zexian Zeng; X. Shirley Liu; Patrick T. Ellinor
errShare
errSave
Modal-nexus auto-encoder for multi-modality cellular data integration and imputation
err2024-10-18
err1
errOAAI
errTang, Zhenchao; Chen, Guanxing; Chen, Shouzhi; Yao, Jianhua; You, Linlin; Chen, Calvin Yu-Chian
errShare
errSave
Graph embedding on biomedical networks: methods, applications and evaluations
err2019-10-04
err0
errOAAI
errXiang Yue; Zhen Wang; Jingong Huang; Srinivasan Parthasarathy; Soheil Moosavinasab; Yungui Huang; Simon M Lin; Wen Zhang; Ping Zhang; Huan Sun
errShare
errSave
researcher View more