arrow
返回

Verifying Properties of MapReduce-Based Big Data Processing

delete2022-03-01
delete5
PRE
AI
N
Nan Zhang
M
Meng Wang
Z
Zhenhua Duan
田聪 (Cong Tian) *
DOI:10.1109/TR.2020.2999441delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Big data techniques are widely used in various fields. To deal with large data sets efficiently, a new programming framework MapReduce has emerged. Thus, new verification challenges arise to improve the reliability of big data processing. In this article, MapReduce processes are implemented by modeling simulation and verification language programs. Then, several data properties such as data soundness, nonconflict, nonduplication, cooperation, and completeness are taken into account. Moreover, these properties are specified by propositional projection temporal logic formulas. To verify these properties, a runtime verification approach at code level based on unified model checking is employed. In addition, two case studies are conducted to demonstrate our approach: sparse matrix multiplication and tracking down suspected patients of an infectious disease.
Keyword:
Big Data
Reliability
Sparse matrices
Infectious diseases
Storms
Urban areas
Big data
formal verification
MapReduce
model checking
reliability

期刊

IEEE Transactions on Reliability 封面图
IEEE Transactions on Reliability
IF:
5.7
论文数:
2.7K
被引数:
8.5K

机构

X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

Temperature rises in the crystalline lens from focal irradiation
err2005-03-01
err0
PREAI
errTsutomu Okuno; Masami Kojima; Ikuho Hata; David H. Sliney
err分享
err收藏
Solvent-mediated pathways to gelation and phase separation in suspensions of grafted nanoparticles
err2009-01-01
err0
errOAAI
errManos Anyfantakis; Athanasios Bourlinos; Dimitris Vlassopoulos; George Fytas; Emmanuel Giannelis; Sanat K. Kumar
err分享
err收藏
err分享
err收藏
Optimization of smartphone psychotherapy for depression and anxiety among patients with cancer using the multiphase optimization strategy (MOST) framework and decentralized clinical trial system (SMartphone Intervention to LEssen depression/Anxiety and GAIN resilience: SMILE AGAIN project): a protocol for a randomized controlled trial
err2023-05-22
err0
errOAAI
errMegumi Uchida; Toshiaki A Furukawa; Takuhiro Yamaguchi; Fuminobu Imai; Kanae Momino; Fujika Katsuki; Naomi Sakurai; Tempei Miyaji; Masaru Horikoshi; Hiroji Iwata; Sadamoto Zenda; Tsuguo Iwatani; Asao Ogawa; Akira Inoue; Masakazu Abe; Tatsuya Toyama; Yosuke Uchitomi; Hiromichi Matsuoka; Hisashi Noma; Tatsuo Akechi
err分享
err收藏
DATA SECURITY AND PRIVACY IN WIRELESS BODY AREA NETWORKS
err2010-02-01
err361
PREAI
errLi, Ming; Lou, Wenjing; Ren, Kui
err分享
err收藏
学者 查看更多内容