Learning the protein language: Evolution, structure, and function

Tristan Bepler

doi:10.1016/j.cels.2021.05.017

Learning the protein language: Evolution, structure, and function

2021-06-01

204

OA

AI

DOI：10.1016/j.cels.2021.05.017

Original

Save

View PDF

Abstract

En 中文

Language models have recently emerged as a powerful machine-learning approach for distilling information from massive protein sequence databases. From readily available sequence data alone, these models discover evolutionary, structural, and functional organization across protein space. Using language models, we can encode amino-acid sequences into distributed vector representations that capture their structural and functional properties, as well as evaluate the evolutionary fitness of sequence variants. We discuss recent advances in protein language modeling and their applications to downstream protein property prediction problems. We then consider how these models can be enriched with prior biological knowledge and introduce an approach for encoding protein structural knowledge into the learned representations. The knowledge distilled by these models allows us to improve downstream function prediction through transfer learning. Deep protein language models are revolutionizing protein biology. They suggest new ways to approach protein and therapeutic design. However, further developments are needed to encode strong biological priors into protein language models and to increase their accessibility to the broader community.

Keywords:

STRUCTURE PREDICTION

FITNESS LANDSCAPES

COILED COILS

SEQUENCE

CLASSIFICATION

INFERENCE

GENOMICS

ENZYME

SCOP

Learning the protein language: Evolution, structure, and function

Abstract

AI Summary

Journal

Organization