arrow
返回

DVID: Distributed Versioned Image-Oriented Dataservice

delete2019-02-05
delete16
delete
OA
AI
W
William T. Katz *
S
Stephen M. Plaza
DOI:10.3389/fncir.2019.00005delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Open-source software development has skyrocketed in part due to community tools like github.com , which allows publication of code as well as the ability to create branches and push accepted modifications back to the original repository. As the number and size of EM-based datasets increases, the connectomics community faces similar issues when we publish snapshot data corresponding to a publication. Ideally, there would be a mechanism where remote collaborators could modify branches of the data and then flexibly reintegrate results via moderated acceptance of changes. The DVID system provides a web-based connectomics API and the first steps toward such a distributed versioning approach to EM-based connectomics datasets. Through its use as the central data resource for Janelia's FlyEM team, we have integrated the concepts of distributed versioning into reconstruction workflows, allowing support for proofreader training and segmentation experiments through branched, versioned data. DVID also supports persistence to a variety of storage systems from high-speed local SSDs to cloud-based object stores, which allows its deployment on laptops as well as large servers. The tailoring of the backend storage to each type of connectomics data leads to efficient storage and fast queries. DVID is freely available as open-source software with an increasing number of supported storage options.
Keyword:
versioning
connectomics
EM reconstruction
dataservice
big data
datastore
collaboration
distributed version control
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Frontiers in Neural Circuits 封面图
Frontiers in Neural Circuits
IF:
3
论文数:
1.7K
被引数:
4.6K

机构

H
Howard Hughes Medical Institute
学者数:
1.2W
论文数: 7.8K
被引数: 6.0W
引用论文

引用论文

err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
BigDataViewer: visualization and processing for large image data sets
err2015-05-28
err187
PREAI
errPietzsch, Tobias; Saalfeld, Stephan; Preibisch, Stephan; Tomancak, Pavel
err分享
err收藏
A data model and data structures for moving objects databases
err2000-05-16
err0
PREAI
errLuca Forlizzi; Ralf Hartmut Güting; Enrico Nardelli; Markus Schneider
err分享
err收藏
High-precision automated reconstruction of neurons with flood-filling networks
err2018-07-16
err217
errOAAI
errJanuszewski, Michal; Kornfeld, Joergen; Li, Peter H.; Pope, Art; Blakely, Tim; Lindsey, Larry; Maitin-Shepard, Jeremy; Tyka, Mike; Denk, Winfried; Jain, Viren
err分享
err收藏
学者 查看更多内容