arrow
返回

Distributed asteroid discovery system for large astronomical data

delete2017-09-01
delete5
PRE
AI
C
Chi-Sheng Huang
M
Meng‐Feng Tsai *
H
Huang, Po-Hsuan
DOI:10.1016/j.jnca.2017.03.013delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Thanks to the advanced technology in astronomical observations, astronomers have collected massive data sets. One of the research tasks is to discover asteroids based on observational data. However, with the fast-growing volume of astronomical data sets, this task becomes enormously relied on computing power. Therefore, the cloud-enable distributed computation and super powerful computation power can offer a good solution to this field. We adopt the Hough transform to link the sequential DETECTIONs of asteroids, and also design a distributed algorithm to process this task on distributed cloud environment for flexible and efficient calculation. Our designs are developed on MapReduce and Spark frameworks. We also utilizes HDFS and HBase in order to reduce disk I/O overhead and increase reliability and scalability. The system architecture is built on the OpenStack which allocates hardware resources flexibly. Our experiment results show significant improvements of calculation time. We believe this will help astronomers to interactively access and analyze data to discover asteroids. The system can also incrementally update DETECTIONs linking with new observed data. It also provides the visual interface to inspect the linked DETECTIONs of asteroids.
Keyword:
Big data
Cloud computing
Distributed system
Asteroid track
Hough transform algorithm
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Network and Computer Applications 封面图
Journal of Network and Computer Applications
IF:
8
论文数:
3.7K
被引数:
1.1W

机构

N
National Central University
学者数:
1.0W
论文数: 8.6K
被引数: 6.4K
引用论文

引用论文

err分享
err收藏
Tn-Polyagglutinability Associated with Acute Myelomonocytic Leukemia
err1979-12-01
err0
PREAI
errMichael L. Baldwin; Christine Barrasso; Ren L. Ridolfi
err分享
err收藏
Defining a successful commercial asteroid mining program
err2015-03-01
err59
PREAI
errAndrews, Dana G.; Bonner, K. D.; Butterworth, A. W.; Calvert, H. R.; Dagang, B. R. H.; Dimond, K. J.; Eckenroth, L. G.; Erickson, J. M.; Gilbertson, B. A.; Gompertz, N. R.; Igbinosun, O. J.; Ip, T. J.; Khan, B. H.; Marquez, S. L.; Neilson, N. M.; Parker, C. O.; Ransom, E. H.; Reeve, B. W.; Robinson, T. L.; Rogers, M.; Schuh, P. M.; Tom, C. J.; Wall, S. E.; Watanabe, N.; Yoo, C. J.
err分享
err收藏
Exploiting Inherent Parallelisms for Accelerating Linear Hough Transform
err2009-10-01
err17
PREAI
errSathyanarayana, S. Suchitra; Satzoda, R. K.; Srikanthan, T.
err分享
err收藏
Parallelizing the Hough transform computation
err2008-01-01
err44
PREAI
errSatzoda, R. K.; Suchitra, S.; Srikanthan, T.
err分享
err收藏
学者 查看更多内容