.png){kind=icon}
返回
Large-scale foundation model on single-cell transcriptomics
.png){kind=icon}
PRE
AI
DOI：10.1038/s41592-024-02305-7.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Large pretrained models have become foundation models leading to breakthroughs in natural language processing and related fields. Developing foundation models for deciphering the 'languages' of cells and facilitating biomedical research is promising yet challenging. Here we developed a large pretrained model scFoundation, also named 'xTrimoscFoundation alpha', with 100 million parameters covering about 20,000 genes, pretrained on over 50 million human single-cell transcriptomic profiles. scFoundation is a large-scale model in terms of the size of trainable parameters, dimensionality of genes and volume of training data. Its asymmetric transformer-like architecture and pretraining task design empower effectively capturing complex context relations among genes in a variety of cell types and states. Experiments showed its merit as a foundation model that achieved state-of-the-art performances in a diverse array of single-cell analysis tasks such as gene expression enhancement, tissue drug response prediction, single-cell drug response classification, single-cell perturbation prediction, cell type annotation and gene module inference. scFoundation, with 100 million parameters covering about 20,000 genes, pretrained on over 50 million single-cell transcriptomics profiles, is a foundation model for diverse tasks of single-cell analysis.
Keyword:
RNA-SEQ
EXPRESSION
ENCYCLOPEDIA
VORINOSTAT
CARCINOMA
NETWORK
ATLAS
期刊
IF:
32.1
论文数:
7.2K
被引数:
12.7W
机构
引用论文
分享收藏High-throughput sequencing of the transcriptome and chromatin accessibility in the same cell.png)
NATURE BIOTECHNOLOGY
OAAI
NATURE BIOTECHNOLOGYIF41.7
OAAI分享收藏Gene Expression Omnibus: NCBI gene expression and hybridization array data repository基因表达综合: NCBI基因表达和杂交阵列数据库NUCLEIC ACIDS RESEARCH
OAAI
NUCLEIC ACIDS RESEARCHIF13.1
OAAI分享收藏Single-Cell Transcriptome Profiling of Human Pancreatic Islets in Health and Type 2 Diabetes健康和2型糖尿病中人胰岛的单细胞转录组图谱CELL METABOLISMOAAI
CELL METABOLISMIF30.9
OAAI分享收藏Predicting cellular responses to complex perturbations in high-throughput screens在高通量筛选中预测细胞对复杂扰动的反应OAAI
OAAI分享收藏
查看更多内容