Efficient storage of high throughput DNA sequencing data using reference-based compression

Markus Hsi-Yang Fritz

doi:10.1101/gr.114819.110

Return

Efficient storage of high throughput DNA sequencing data using reference-based compression

2011-01-18

287

Markus Hsi-Yang Fritz

Rasko Leinonen

Guy Cochrane

Ewan Birney *

DOI：10.1101/gr.114819.110

Original

Save

View PDF

Abstract

En 中文

Data storage costs have become an appreciable proportion of total cost in the creation and analysis of DNA sequence data. Of particular concern is that the rate of increase in DNA sequencing is significantly outstripping the rate of increase in disk storage capacity. In this paper we present a new reference-based compression method that efficiently compresses DNA sequences for storage. Our approach works for resequencing experiments that target well-studied genomes. We align new sequences to a reference genome and then encode the differences between the new sequence and the reference genome for storage. Our compression method is most efficient when we allow controlled loss of data in the saving of quality information and unaligned sequences. With this new compression method we observe exponential efficiency gains as read lengths increase, and the magnitude of this efficiency gain can be controlled by changing the amount of quality information stored. Our compression method is tunable: The storage of quality scores and unaligned sequences may be adjusted for different experiments to conserve information or to minimize storage costs, and provides one opportunity to address the threat that increasing DNA sequence volumes will overcome our ability to store the sequences.

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.