.png){kind=icon}
Return
Large-scale foundation model on single-cell transcriptomics
.png){kind=icon}
PRE
AI
DOI：10.1038/s41592-024-02305-7.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Large pretrained models have become foundation models leading to breakthroughs in natural language processing and related fields. Developing foundation models for deciphering the 'languages' of cells and facilitating biomedical research is promising yet challenging. Here we developed a large pretrained model scFoundation, also named 'xTrimoscFoundation alpha', with 100 million parameters covering about 20,000 genes, pretrained on over 50 million human single-cell transcriptomic profiles. scFoundation is a large-scale model in terms of the size of trainable parameters, dimensionality of genes and volume of training data. Its asymmetric transformer-like architecture and pretraining task design empower effectively capturing complex context relations among genes in a variety of cell types and states. Experiments showed its merit as a foundation model that achieved state-of-the-art performances in a diverse array of single-cell analysis tasks such as gene expression enhancement, tissue drug response prediction, single-cell drug response classification, single-cell perturbation prediction, cell type annotation and gene module inference. scFoundation, with 100 million parameters covering about 20,000 genes, pretrained on over 50 million single-cell transcriptomics profiles, is a foundation model for diverse tasks of single-cell analysis.
Keywords:
RNA-SEQ
EXPRESSION
ENCYCLOPEDIA
VORINOSTAT
CARCINOMA
NETWORK
ATLAS
Journal
IF:
32.1
Papers:
7.2K
Citations:
12.7W
Organization
Cited Papers
ShareSaveHigh-throughput sequencing of the transcriptome and chromatin accessibility in the same cell.png)
NATURE BIOTECHNOLOGY
OAAI
NATURE BIOTECHNOLOGYIF41.7
OAAIShareSaveGene Expression Omnibus: NCBI gene expression and hybridization array data repositoryNUCLEIC ACIDS RESEARCH
OAAI
NUCLEIC ACIDS RESEARCHIF13.1
OAAIShareSaveSingle-Cell Transcriptome Profiling of Human Pancreatic Islets in Health and Type 2 DiabetesCELL METABOLISMOAAI
CELL METABOLISMIF30.9
OAAIShareSave
View more