arrow
Return

LAMBDA: a prophage detection benchmark for genomic language models

delete2026-09-08
delete0
delete
OA
AI
L
LeAnn M. Lindsey
N
Nicole L. Pershing
K
Keith Dufault‐Thompson
H
Ho‐Jin Gwak
A
Anisa Habib
A
Aaron Schindler
A
Arjun Rakheja
J
June L. Round
W
W. Zac Stephens
A
Anne J. Blaschke
H
Hari Sundar
X
Xiaofang Jiang *
DOI:10.1093/nargab/lqag103delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Transformer-based genomic sequence models represent an emerging frontier in computational biology. Yet, their embeddings have not yet shown the same level of predictive power as natural and protein language models, highlighting a gap between current implementations and theoretical promise. Existing benchmarks for DNA language models primarily focus on classifying regulatory elements in eukaryotic genomes, leaving open the fundamental question of whether these models learn sequence-level features across whole genomes. We introduce LAMBDA, a benchmark designed to rigorously evaluate genome language model embeddings through phage–bacteria sequence discrimination across four categories of increasing complexity: probing tasks, fine-tuning assessments, diagnostic tests, and genome-wide prophage detection. Our comprehensive analysis of current genomic language models provides insight into the importance of training data selection relative to model size, the need for domain-specific training, and the capabilities and limitations of genomic language models for detecting prophage sequences. This benchmark represents a challenging genomic annotation task in the bacterial domain and addresses a key computational problem with direct relevance to microbiology and medicine.

Journal

N
NAR Genomics and Bioinformatics
IF:
2.8
Papers:
264
Citations:
0

Organization

T
tufts university
Scholars:
1.7W
Papers: 1.5W
Citations: 24
U
University of Utah
Scholars:
3.0W
Papers: 2.2W
Citations: 4.6W
Cited Papers

Cited Papers

VirSorter2: a multi-classifier, expert-guided approach to detect diverse DNA and RNA viruses
err2021-02-01
err527
errOAAI
errGuo, Jiarong; Bolduc, Ben; Zayed, Ahmed A.; Varsani, Arvind; Dominguez-Huerta, Guillermo; Delmont, Tom O.; Pratama, Akbar Adjie; Gazitua, M. Consuelo; Vik, Dean; Sullivan, Matthew B.; Roux, Simon
errShare
errSave
VirFinder: a novel k-mer based tool for identifying viral sequences from assembled metagenomic data
err2017-07-06
err412
errOAAI
errRen, Jie; Ahlgren, Nathan A.; Lu, Yang Young; Fuhrman, Jed A.; Sun, Fengzhu
errShare
errSave
DEPhT: a novel approach for efficient prophage discovery and precise extraction
err2022-04-22
err21
errOAAI
errGauthier, Christian H.; Abad, Lawrence; Venbakkam, Ananya K.; Malnak, Julia; Russell, Daniel A.; Hatfull, Graham F.
errShare
errSave
INfrastructure for a PHAge REference Database: Identification of Large-Scale Biases in the Current Collection of Cultured Phage Genomes
err2021-12-01
err168
errOAAI
errCook, Ryan; Brown, Nathan; Redgwell, Tamsin; Rihtman, Branko; Barnes, Megan; Clokie, Martha; Stekel, Dov J.; Hobman, Jon; Jones, Michael A.; Millard, Andrew
errShare
errSave
Taxonomic assignment of uncultivated prokaryotic virus genomes is enabled by gene-sharing networks
err2019-05-06
err506
errOAAI
errJang, Ho Bin; Bolduc, Benjamin; Zablocki, Olivier; Kuhn, Jens H.; Roux, Simon; Adriaenssens, Evelien M.; Brister, J. Rodney; Kropinski, Andrew M.; Krupovic, Mart; Lavigne, Rob; Turner, Dann; Sullivan, Matthew B.
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
researcher View more