arrow
Return

Haplotype-Based Parallel PBWT for Biobank Scale Data

delete2026-01-01
delete0
PRE
AI
K
Kecong Tang
A
Ahsan Sanaullah
D
Degui Zhi
张
张绍杰 (Shaojie Zhang) *
DOI:10.1007/978-3-032-02489-3_10delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Durbin's positional Burrows-Wheeler transform (PBWT) enables algorithms with the optimal time complexity of O(MN) for reporting all vs all haplotype matches in a population panel with M haplotypes and N variant sites. However, even this efficiency may still be too slow when the number of haplotypes reaches millions. To further reduce the run time, in this paper, a parallel version of the PBWT algorithms is introduced for all versus all haplotype matching, which is called HP-PBWT (haplotype-based parallel PBWT). HP-PBWT parallelly executes the PBWT by splitting a haplotype panel into blocks of haplotypes. HP-PBWT algorithms achieve parallelization for PBWT construction, reporting all versus all L-long matches, and reporting all versus all set -maximal matches while maintaining memory efficiency. HP-PBWT has an O((M/T + T)N) time complexity in PBWT construction, and O((M/T + T + c*)N) time complexity for reporting all versus all L -long matches and reporting all versus all set -maximal matches, where T is the number of threads and c* is the maximum number of matches (of length L or maximum divergence value for L -long matches and set -maximal matches respectively) per haplotype per site. HP-PBWT achieves 4-fold speed-up in UK Biobank genotyping array data with 30 threads in the IO-included benchmarks. When applying HP-PBWT to a dataset of 8 million randomized haplotypes (random binary strings of equal length) in the IO-excluded benchmarks, it can achieve a 22-fold speed-up with 60 cores on the Amazon EC2 server. With further hardware optimization, HP-PBWT is expected to handle billions of haplotypes efficiently.
Keywords:
PBWT
Parallel Computing
Haplotype Matching

Journal

C
COMPUTATIONAL ADVANCES IN BIO AND MEDICAL SCIENCES, ICCABS 2025
IF:
0
Papers:
23
Citations:
0

Organization

State University System of Florida cover
State University System of Florida
Scholars:
12.8W
Papers: 10.9W
Citations: 130
U
University of Central Florida
Scholars:
8.7K
Papers: 6.8K
Citations: 1.4W
Cited Papers

Cited Papers

Sequencing of 53,831 diverse genomes from the NHLBI TOPMed Program
err2021-02-10
err0
errOAAI
errDaniel Taliun; Daniel N. Harris; Michael D. Kessler; Jedidiah Carlson; Zachary A. Szpiech; Raul Torres; Sarah A. Gagliano Taliun; André Corvelo; Stephanie M. Gogarten; Hyun Min Kang; Achilleas N. Pitsillides; Jonathon LeFaive; Seung-been Lee; Xiaowen Tian; Brian L. Browning; Sayantan Das; Anne-Katrin Emde; Wayne E. Clarke; Douglas P. Loesch; Amol C. Shetty; Thomas W. Blackwell; Albert V. Smith; Quenna Wong; Xiaoming Liu; Matthew P. Conomos; Dean M. Bobo; François Aguet; Christine Albert; Alvaro Alonso; Kristin G. Ardlie; Dan E. Arking; Stella Aslibekyan; Paul L. Auer; John Barnard; R. Graham Barr; Lucas Barwick; Lewis C. Becker; Rebecca L. Beer; Emelia J. Benjamin; Lawrence F. Bielak; John Blangero; Michael Boehnke; Donald W. Bowden; Jennifer A. Brody; Esteban G. Burchard; Brian E. Cade; James F. Casella; Brandon Chalazan; Daniel I. Chasman; Yii-Der Ida Chen; Michael H. Cho; Seung Hoan Choi; Mina K. Chung; Clary B. Clish; Adolfo Correa; Joanne E. Curran; Brian Custer; Dawood Darbar; Michelle Daya; Mariza de Andrade; Dawn L. DeMeo; Susan K. Dutcher; Patrick T. Ellinor; Leslie S. Emery; Celeste Eng; Diane Fatkin; Tasha Fingerlin; Lukas Forer; Myriam Fornage; Nora Franceschini; Christian Fuchsberger; Stephanie M. Fullerton; Soren Germer; Mark T. Gladwin; Daniel J. Gottlieb; Xiuqing Guo; Michael E. Hall; Jiang He; Nancy L. Heard-Costa; Susan R. Heckbert; Marguerite R. Irvin; Jill M. Johnsen; Andrew D. Johnson; Robert Kaplan; Sharon L. R. Kardia; Tanika Kelly; Shannon Kelly; Eimear E. Kenny; Douglas P. Kiel; Robert Klemmer; Barbara A. Konkle; Charles Kooperberg; Anna Köttgen; Leslie A. Lange; Jessica Lasky-Su; Daniel Levy; Xihong Lin; Keng-Han Lin; Chunyu Liu; Ruth J. F. Loos; Lori Garman; Robert Gerszten; Steven A. Lubitz; Kathryn L. Lunetta; Angel C. Y. Mak; Ani Manichaikul; Alisa K. Manning; Rasika A. Mathias; David D. McManus; Stephen T. McGarvey; James B. Meigs; Deborah A. Meyers; Julie L. Mikulla; Mollie A. Minear; Braxton D. Mitchell; Sanghamitra Mohanty; May E. Montasser; Courtney Montgomery; Alanna C. Morrison; Joanne M. Murabito; Andrea Natale; Pradeep Natarajan; Sarah C. Nelson; Kari E. North; Jeffrey R. O’Connell; Nicholette D. Palmer; Nathan Pankratz; Gina M. Peloso; Patricia A. Peyser; Jacob Pleiness; Wendy S. Post; Bruce M. Psaty; D. C. Rao; Susan Redline; Alexander P. Reiner; Dan Roden; Jerome I. Rotter; Ingo Ruczinski; Chloé Sarnowski; Sebastian Schoenherr; David A. Schwartz; Jeong-Sun Seo; Sudha Seshadri; Vivien A. Sheehan; Wayne H. Sheu; M. Benjamin Shoemaker; Nicholas L. Smith; Jennifer A. Smith; Nona Sotoodehnia; Adrienne M. Stilp; Weihong Tang; Kent D. Taylor; Marilyn Telen; Timothy A. Thornton; Russell P. Tracy; David J. Van Den Berg; Ramachandran S. Vasan; Karine A. Viaud-Martinez; Scott Vrieze; Daniel E. Weeks; Bruce S. Weir; Scott T. Weiss; Lu-Chen Weng; Cristen J. Willer; Yingze Zhang; Xutong Zhao; Donna K. Arnett; Allison E. Ashley-Koch; Kathleen C. Barnes; Eric Boerwinkle; Stacey Gabriel; Richard Gibbs; Kenneth M. Rice; Stephen S. Rich; Edwin K. Silverman; Pankaj Qasba; Weiniu Gan; Namiko Abe; Laura Almasy; Seth Ament; Peter Anderson; Pramod Anugu; Deborah Applebaum-Bowden; Tim Assimes; Dimitrios Avramopoulos; Emily Barron-Casella; Terri Beaty; Gerald Beck; Diane Becker; Amber Beitelshees; Takis Benos; Marcos Bezerra; Joshua Bis; Russell Bowler; Ulrich Broeckel; Jai Broome; Karen Bunting; Carlos Bustamante; Erin Buth; Jonathan Cardwell; Vincent Carey; Cara Carty; Richard Casaburi; Peter Castaldi; Mark Chaffin; Christy Chang; Yi-Cheng Chang; Sameer Chavan; Bo-Juen Chen; Wei-Min Chen; Lee-Ming Chuang; Ren-Hua Chung; Suzy Comhair; Elaine Cornell; Carolyn Crandall; James Crapo; Jeffrey Curtis; Coleen Damcott; Sean David; Colleen Davis; Lisa de las Fuentes; Michael DeBaun; Ranjan Deka; Scott Devine; Qing Duan; Ravi Duggirala; Jon Peter Durda; Charles Eaton; Lynette Ekunwe; Adel El Boueiz; Serpil Erzurum; Charles Farber; Matthew Flickinger; Myriam Fornage; Chris Frazar; Mao Fu; Lucinda Fulton; Shanshan Gao; Yan Gao; Margery Gass; Bruce Gelb; Xiaoqi Priscilla Geng; Mark Geraci; Auyon Ghosh; Chris Gignoux; David Glahn; Da-Wei Gong; Harald Goring; Sharon Graw; Daniel Grine; C. Charles Gu; Yue Guan; Namrata Gupta; Jeff Haessler; Nicola L. Hawley; Ben Heavner; David Herrington; Craig Hersh; Bertha Hidalgo; James Hixson; Brian Hobbs; John Hokanson; Elliott Hong; Karin Hoth; Chao Agnes Hsiung; Yi-Jen Hung; Haley Huston; Chii Min Hwu; Rebecca Jackson; Deepti Jain; Min A. Jhun; Craig Johnson; Rich Johnston; Kimberly Jones; Sekar Kathiresan; Alyna Khan; Wonji Kim; Greg Kinney; Holly Kramer; Christoph Lange; Ethan Lange; Leslie Lange; Cecelia Laurie; Meryl LeBoff; Jiwon Lee; Seunggeun Shawn Lee; Wen-Jane Lee; David Levine; Joshua Lewis; Xiaohui Li; Yun Li; Henry Lin; Honghuang Lin; Keng Han Lin; Simin Liu; Yongmei Liu; Yu Liu; James Luo; Michael Mahaney; Barry Make; JoAnn Manson; Lauren Margolin; Lisa Martin; Susan Mathai; Susanne May; Patrick McArdle; Merry-Lynn McDonald; Sean McFarland; Daniel McGoldrick; Caitlin McHugh; Hao Mei; Luisa Mestroni; Nancy Min; Ryan L. Minster; Matt Moll; Arden Moscati; Solomon Musani; Stanford Mwasongwe; Josyf C. Mychaleckyj; Girish Nadkarni; Rakhi Naik; Take Naseri; Sergei Nekhai; Bonnie Neltner; Heather Ochs-Balcom; David Paik; James Pankow; Afshin Parsa; Juan Manuel Peralta; Marco Perez; James Perry; Ulrike Peters; Lawrence S. Phillips; Toni Pollin; Julia Powers Becker; Meher Preethi Boorgula; Michael Preuss; Dandi Qiao; Zhaohui Qin; Nicholas Rafaels; Laura Raffield; Laura Rasmussen-Torvik; Aakrosh Ratan; Robert Reed; Elizabeth Regan; Muagututi‘a Sefuiva Reupena; Carolina Roselli; Pamela Russell; Sarah Ruuska; Kathleen Ryan; Ester Cerdeira Sabino; Danish Saleheen; Shabnam Salimi; Steven Salzberg; Kevin Sandow; Vijay G. Sankaran; Christopher Scheller; Ellen Schmidt; Karen Schwander; Frank Sciurba; Christine Seidman; Jonathan Seidman; Stephanie L. Sherman; Aniket Shetty; Wayne Hui-Heng Sheu; Brian Silver; Josh Smith; Tanja Smith; Sylvia Smoller; Beverly Snively; Michael Snyder; Tamar Sofer; Garrett Storm; Elizabeth Streeten; Yun Ju Sung; Jody Sylvia; Adam Szpiro; Carole Sztalryd; Hua Tang; Margaret Taub; Matthew Taylor; Simeon Taylor; Machiko Threlkeld; Lesley Tinker; David Tirschwell; Sarah Tishkoff; Hemant Tiwari; Catherine Tong; Michael Tsai; Dhananjay Vaidya; Peter VandeHaar; Tarik Walker; Robert Wallace; Avram Walts; Fei Fei Wang; Heming Wang; Karol Watson; Jennifer Wessel; Kayleen Williams; L. Keoki Williams; Carla Wilson; Joseph Wu; Huichun Xu; Lisa Yanek; Ivana Yang; Rongze Yang; Norann Zaghloul; Maryam Zekavat; Snow Xueyan Zhao; Wei Zhao; Degui Zhi; Xiang Zhou; Xiaofeng Zhu; George J. Papanicolaou; Deborah A. Nickerson; Sharon R. Browning; Michael C. Zody; Sebastian Zöllner; James G. Wilson; L. Adrienne Cupples; Cathy C. Laurie; Cashell E. Jaquish; Ryan D. Hernandez; Timothy D. O’Connor; Gonçalo R. Abecasis
errShare
errSave
HTSlib: C library for reading/writing high-throughput sequencing data
err2021-02-16
err171
errOAAI
errBonfield, James K.; Marshall, John; Danecek, Petr; Li, Heng; Ohan, Valeriu; Whitwham, Andrew; Keane, Thomas; Davies, Robert M.
errShare
errSave
23andMe: a new two-sided data-banking market model
err2016-03-31
err53
errOAAI
errStoekle, Henri-Corto; Mamzer-Bruneel, Marie-France; Vogt, Guillaume; Herve, Christian
errShare
errSave
Speedup versus efficiency in parallel systems
err1989-03-01
err0
PREAI
errD.L. Eager; J. Zahorjan; E.D. Lazowska
errShare
errSave
Fast and Robust Identity-by-Descent Inference with the Templated Positional Burrows-Wheeler Transform
err2020-12-23
err18
errOAAI
errFreyman, William A.; McManus, Kimberly F.; Shringarpure, Suyash S.; Jewett, Ethan M.; Bryc, Katarzyna; Auton, Adam
errShare
errSave
CPU Overclocking: A Performance Assessment of Air, Cold Plates, and Two-Phase Immersion Cooling
err2021-10-01
err0
errOAAI
errBharath Ramakrishnan; Husam Alissa; Ioannis Manousakis; Robert Lankston; Ricardo Bianchini; Washington Kim; Rich Baca; Pulkit A. Misra; Inigo Goiri; Majid Jalili; Ashish Raniwala; Brijesh Warrier; Mark Monroe; Christian Belady; Mark Shaw; Marcus Fontoura
errShare
errSave
What is ancestry?
err2020-03-09
err104
errOAAI
errMathieson, Iain; Scally, Aylwyn
errShare
errSave
UK Biobank: An Open Access Resource for Identifying the Causes of a Wide Range of Complex Diseases of Middle and Old Age
err2015-03-31
err6.7K
errOAAI
errSudlow, Cathie; Gallacher, John; Allen, Naomi; Beral, Valerie; Burton, Paul; Danesh, John; Downey, Paul; Elliott, Paul; Green, Jane; Landray, Martin; Liu, Bette; Matthews, Paul; Ong, Giok; Pell, Jill; Silman, Alan; Young, Alan; Sprosen, Tim; Peakman, Tim; Collins, Rory
errShare
errSave
researcher View more