arrow
Return

Essential guidelines for computational method benchmarking

delete2019-06-20
delete90
delete
OA
AI
L
Lukas M. Weber
W
Wouter Saelens
R
Robrecht Cannoodt
C
Charlotte Soneson
A
Alexander Hapfelmeier
P
Paul P. Gardner
A
Anne‐Laure Boulesteix
Y
Yvan Saeys *
M
Mark D. Robinson *
DOI:10.1186/s13059-019-1738-8delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In computational biology and other sciences, researchers are frequently faced with a choice between several computational methods for performing data analyses. Benchmarking studies aim to rigorously compare the performance of different methods using well-characterized benchmark datasets, to determine the strengths of each method or to provide recommendations regarding suitable choices of methods for an analysis. However, benchmarking studies must be carefully designed and implemented to provide accurate, unbiased, and informative results. Here, we summarize key practical guidelines and recommendations for performing high-quality benchmarking analyses, based on our experiences in computational biology.
Keywords:
DIFFERENTIAL EXPRESSION
REPRODUCIBLE RESEARCH
METAANALYSIS METHODS
DATA SETS
RNA
BIOINFORMATICS
METAGENOME
SOFTWARE
SEQUENCE
DESIGN

Journal

G
Genome Biology
IF:
9.4
Papers:
6.4K
Citations:
9.1W

Organization

G
Ghent University
Scholars:
2.1K
Papers: 689
Citations: 2.1W
U
University of Zurich
Scholars:
1.8K
Papers: 676
Citations: 1.8W
T
technical university of munich
Scholars:
2.0K
Papers: 712
Citations: 2.0W
researcher View more organizations
Cited Papers

Cited Papers

Can Inflation be Falsified?
err1997-12-01
err0
PREAI
errJohn D. Barrow; Andrew R. Liddle
errShare
errSave
The 2006 outbreak of bluetongue in northern Europe—The entomological perspective
err2008-10-01
err0
PREAI
errR. Meiswinkel; T. Baldet; R. de Deken; W. Takken; J.-C. Delécolle; P.S. Mellor
errShare
errSave
errShare
errSave
A reflective display based on the electro-microfluidic assembly of particles within suppressed water-in-oil droplet array
err2023-12-05
err0
errOAAI
errShitao Shen; Haoqiang Feng; Yueming Deng; Shuting Xie; Zichuan Yi; Mingliang Jin; Guofu Zhou; Paul Mulvaney; Lingling Shui
errShare
errSave
The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements
err2006-09-08
err1.9K
errOAAI
errShi, Leming; Reid, Laura H.; Jones, Wendell D.; Shippy, Richard; Warrington, Janet A.; Baker, Shawn C.; Collins, Patrick J.; de Longueville, Francoise; Kawasaki, Ernest S.; Lee, Kathleen Y.; Luo, Yuling; Sun, Yongming Andrew; Willey, James C.; Setterquist, Robert A.; Fischer, Gavin M.; Tong, Weida; Dragan, Yvonne P.; Dix, David J.; Frueh, Felix W.; Goodsaid, Federico M.; Herman, Damir; Jensen, Roderick V.; Johnson, Charles D.; Lobenhofer, Edward K.; Puri, Raj K.; Scherf, Uwe; Thierry-Mieg, Jean; Wang, Charles; Wilson, Mike; Wolber, Paul K.; Zhang, Lu; Amur, Shashi; Bao, Wenjun; Barbacioru, Catalin C.; Lucas, Anne Bergstrom; Bertholet, Vincent; Boysen, Cecilie; Bromley, Bud; Brown, Donna; Brunner, Alan; Canales, Roger; Cao, Xiaoxi Megan; Cebula, Thomas A.; Chen, James J.; Cheng, Jing; Chu, Tzu-Ming; Chudin, Eugene; Corson, John; Corton, J. Christopher; Croner, Lisa J.; Davies, Christopher; Davison, Timothy S.; Delenstarr, Glenda; Deng, Xutao; Dorris, David; Eklund, Aron C.; Fan, Xiao-hui; Fang, Hong; Fulmer-Smentek, Stephanie; Fuscoe, James C.; Gallagher, Kathryn; Ge, Weigong; Guo, Lei; Guo, Xu; Hager, Janet; Haje, Paul K.; Han, Jing; Han, Tao; Harbottle, Heather C.; Harris, Stephen C.; Hatchwell, Eli; Hauser, Craig A.; Hester, Susan; Hong, Huixiao; Hurban, Patrick; Jackson, Scott A.; Ji, Hanlee; Knight, Charles R.; Kuo, Winston P.; LeClerc, J. Eugene; Levy, Shawn; Li, Quan-Zhen; Liu, Chunmei; Liu, Ying; Lombardi, Michael J.; Ma, Yunqing; Magnuson, Scott R.; Maqsodi, Botoul; McDaniel, Tim; Mei, Nan; Myklebost, Ola; Ning, Baitang; Novoradovskaya, Natalia; Orr, Michael S.; Osborn, Terry W.; Papallo, Adam; Patterson, Tucker A.; Perkins, Roger G.; Peters, Elizabeth H.; Peterson, Ron; Philips, Kenneth L.; Pine, P. Scott; Pusztai, Lajos; Qian, Feng; Ren, Hongzu; Rosen, Mitch; Rosenzweig, Barry A.; Samaha, Raymond R.; Schena, Mark; Schroth, Gary P.; Shchegrova, Svetlana; Smith, Dave D.; Staedtler, Frank; Su, Zhenqiang; Sun, Hongmei; Szallasi, Zoltan; Tezak, Zivana; Thierry-Mieg, Danielle; Thompson, Karol L.; Tikhonova, Irina; Turpaz, Yaron; Vallanat, Beena; Van, Christophe; Walker, Stephen J.; Wang, Sue Jane; Wang, Yonghong; Wolfinger, Russ; Wong, Alex; Wu, Jie; Xiao, Chunlin; Xie, Qian; Xu, Jun; Yang, Wen; Zhang, Liang; Zhong, Sheng; Zong, Yaping; Slikker, William, Jr.
errShare
errSave
The MicroArray Quality Control (MAQC)-IIII study of common practices for the development and validation of microarray-based predictive models
err2010-07-30
err683
errOAAI
errShi, Leming; Campbell, Gregory; Jones, Wendell D.; Campagne, Fabien; Wen, Zhining; Walker, Stephen J.; Su, Zhenqiang; Chu, Tzu-Ming; Goodsaid, Federico M.; Pusztai, Lajos; Shaughnessy, John D., Jr.; Oberthuer, Andre; Thomas, Russell S.; Paules, Richard S.; Fielden, Mark; Barlogie, Bart; Chen, Weijie; Du, Pan; Fischer, Matthias; Furlanello, Cesare; Gallas, Brandon D.; Ge, Xijin; Megherbi, Dalila B.; Symmans, W. Fraser; Wang, May D.; Zhang, John; Bitter, Hans; Brors, Benedikt; Bushel, Pierre R.; Bylesjo, Max; Chen, Minjun; Cheng, Jie; Cheng, Jing; Chou, Jeff; Davison, Timothy S.; Delorenzi, Mauro; Deng, Youping; Devanarayan, Viswanath; Dix, David J.; Dopazo, Joaquin; Dorff, Kevin C.; Elloumi, Fathi; Fan, Jianqing; Fan, Shicai; Fan, Xiaohui; Fang, Hong; Gonzaludo, Nina; Hess, Kenneth R.; Hong, Huixiao; Huan, Jun; Irizarry, Rafael A.; Judson, Richard; Juraeva, Dilafruz; Lababidi, Samir; Lambert, Christophe G.; Li, Li; Li, Yanen; Li, Zhen; Lin, Simon M.; Liu, Guozhen; Lobenhofer, Edward K.; Luo, Jun; Luo, Wen; McCall, Matthew N.; Nikolsky, Yuri; Pennello, Gene A.; Perkins, Roger G.; Philip, Reena; Popovici, Vlad; Price, Nathan D.; Qian, Feng; Scherer, Andreas; Shi, Tieliu; Shi, Weiwei; Sung, Jaeyun; Thierry-Mieg, Danielle; Thierry-Mieg, Jean; Thodima, Venkata; Trygg, Johan; Vishnuvajjala, Lakshmi; Wang, Sue Jane; Wu, Jianping; Wu, Yichao; Xie, Qian; Yousef, Waleed A.; Zhang, Liang; Zhang, Xuegong; Zhong, Sheng; Zhou, Yiming; Zhu, Sheng; Arasappan, Dhivya; Bao, Wenjun; Lucas, Anne Bergstrom; Berthold, Frank; Brennan, Richard J.; Buness, Andreas; Catalano, Jennifer G.; Chang, Chang; Chen, Rong; Cheng, Yiyu; Cui, Jian; Czika, Wendy; Demichelis, Francesca; Deng, Xutao; Dosymbekov, Damir; Eils, Roland; Feng, Yang; Fostel, Jennifer; Fulmer-Smentek, Stephanie; Fuscoe, James C.; Gatto, Laurent; Ge, Weigong; Goldstein, Darlene R.; Guo, Li; Halbert, Donald N.; Han, Jing; Harris, Stephen C.; Hatzis, Christos; Herman, Damir; Huang, Jianping; Jensen, Roderick V.; Jiang, Rui; Johnson, Charles D.; Jurman, Giuseppe; Kahlert, Yvonne; Khuder, Sadik A.; Kohl, Matthias; Li, Jianying; Li, Li; Li, Menglong; Li, Quan-Zhen; Li, Shao; Li, Zhiguang; Liu, Jie; Liu, Ying; Liu, Zhichao; Meng, Lu; Madera, Manuel; Martinez-Murillo, Francisco; Medina, Ignacio; Meehan, Joseph; Miclaus, Kelci; Moffitt, Richard A.; Montaner, David; Mukherjee, Piali; Mulligan, George J.; Neville, Padraic; Nikolskaya, Tatiana; Ning, Baitang; Page, Grier P.; Parker, Joel; Parry, R. Mitchell; Peng, Xuejun; Peterson, Ron L.; Phan, John H.; Quanz, Brian; Ren, Yi; Riccadonna, Samantha; Roter, Alan H.; Samuelson, Frank W.; Schumacher, Martin M.; Shambaugh, Joseph D.; Shi, Qiang; Shippy, Richard; Si, Shengzhu; Smalter, Aaron; Sotiriou, Christos; Soukup, Mat; Staedtler, Frank; Steiner, Guido; Stokes, Todd H.; Sun, Qinglan; Tan, Pei-Yi; Tang, Rong; Tezak, Zivana; Thorn, Brett; Tsyganova, Marina; Turpaz, Yaron; Vega, Silvia C.; Visintainer, Roberto; von Frese, Juergen; Wang, Charles; Wang, Eric; Wang, Junwei; Wang, Wei; Westermann, Frank; Willey, James C.; Woods, Matthew; Wu, Shujian; Xiao, Nianqing; Xu, Joshua; Xu, Lei; Yang, Lun; Zeng, Xiao; Zhang, Jialu; Zhang, Li; Zhang, Min; Zhao, Chen; Puri, Raj K.; Scherf, Uwe; Tong, Weida; Wolfinger, Russell D.
errShare
errSave
The Evaluation of Tools Used to Predict the Impact of Missense Variants Is Hindered by Two Types of Circularity
err2015-03-26
err286
errOAAI
errGrimm, Dominik G.; Azencott, Chloe-Agathe; Aicheler, Fabian; Gieraths, Udo; MacArthur, Daniel G.; Samocha, Kaitlin E.; Cooper, David N.; Stenson, Peter D.; Daly, Mark J.; Smoller, Jordan W.; Duncan, Laramie E.; Borgwardt, Karsten M.
errShare
errSave
Comparison of mapping algorithms used in high-throughput sequencing: application to Ion Torrent data
err2014-01-01
err87
errOAAI
errCaboche, Segolene; Audebert, Christophe; Lemoine, Yves; Hot, David
errShare
errSave
researcher View more