.png){kind=icon}
返回
Assessing parameter efficient methods for pre-trained language model in annotating scRNA-seq data
.png){kind=icon}
PRE
AI
DOI：10.1016/j.ymeth.2024.05.007.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Annotating cell types of single-cell RNA sequencing (scRNA-seq) data is crucial for studying cellular heterogeneity in the tumor microenvironment. Recently, large-scale pre-trained language models (PLMs) have achieved significant progress in cell-type annotation of scRNA-seq data. This approach effectively addresses previous methods' shortcomings in performance and generalization. However, fine-tuning PLMs for different downstream tasks demands considerable computational resources, rendering it impractical. Hence, a new research branch introduces parameter-efficient fine-tuning (PEFT). This involves optimizing a few parameters while leaving the majority unchanged, leading to substantial reductions in computational expenses. Here, we utilize scBERT, a large-scale pre-trained model, to explore the capabilities of three PEFT methods in scRNA-seq cell type annotation. Extensive benchmark studies across several datasets demonstrate the superior applicability of PEFT methods. Furthermore, downstream analysis using models obtained through PEFT showcases their utility in novel cell type discovery and model interpretability for potential marker genes. Our findings underscore the considerable potential of PEFT in PLM-based cell type annotation, presenting novel perspectives for the analysis of scRNA-seq data.
Keyword:
Cell type annotation
Parameter-efficient fine-tuning
scRNA-seq analysis
Bioinformatics
期刊
IF:
4.3
论文数:
4.8K
被引数:
2.4W
机构
引用论文
Single-Cell Transcriptome Profiling of Human Pancreatic Islets in Health and Type 2 Diabetes健康和2型糖尿病中人胰岛的单细胞转录组图谱.png)
CELL METABOLISM
OAAI
CELL METABOLISMIF30.9
OAAI分享收藏scDeepSort: a pre-trained cell-type annotation method for single-cell transcriptomics using deep learning with a weighted graph neural networkscDeepSort: 一种使用深度学习和加权图神经网络的单细胞转录组学的预训练细胞类型注释方法NUCLEIC ACIDS RESEARCHOAAI
NUCLEIC ACIDS RESEARCHIF13.1
OAAI分享收藏A multicenter study benchmarking single-cell RNA sequencing technologies using reference samplesNATURE BIOTECHNOLOGYOAAI
NATURE BIOTECHNOLOGYIF41.7
OAAI分享收藏Gene2vec: distributed representation of genes based on co-expressionGene2vec: 基于共表达的基因分布式表示BMC GENOMICSOAAI
BMC GENOMICSIF3.7
OAAI分享收藏
查看更多内容