.png){kind=icon}
返回
A Structured Approach Towards Big Data Identification
.png){kind=icon}
PRE
AI
DOI：10.1109/TBDATA.2021.3139069.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Big data is a relative concept. It is the combination of data, application, and platform properties. The term big data has been used with almost every problem involving large size, real time, and heterogeneous data. However, these data attributes are not enough to identify big data by ignoring the application and platform properties for finding processing thresholds. The equivocated identification of big data can lead to an inefficient use of optimization techniques, resulting into global inefficiency, reduced system performance, increasing power consumption, requiring greater effort on the part of the programming team, and misallocation of the hardware resources required for the task. In this regard, a structured approach has been presented for identification of big data. The approach is based on three equations that categorize the Volume, Velocity, and Variety characteristics by relating data, application, and platform properties. The 3Vs identification is necessary for enabling the relevant optimization techniques. In addition to 3Vs identification, it is required to discriminate whether the big data is due to 1V, 2Vs or 3Vs, as the involvement of more Vs increases the problem complexity. In this regard, the classification of big data into strong, moderate or weak level has been proposed . To evaluate the proposed methods, a set of well-known applications have been experimented and categorized, depicting a saving of up to 58% main memory and 44% disk reads, as well as prescribing lower clock rate, lesser cores, sequential programming, and non adaptive processing & storage formats. Moreover, four case studies reported as big data have been analyzed according to the proposed system. The proposed method is able to categorize two case studies as weak low big data presenting only volume, the third case is weak medium due to velocity, whereas in the fourth case no V is involved. Also, the proposed equations reduce the computation and human resources up to 75% of Spark cluster execution. In this manner, the proposed work can save the unnecessary investments by relevant prescriptions. Furthermore, the proposed equations can be integrated into different tools for assisting selective offloading of big data workloads to appropriate software and hardware solutions.
Keyword:
Big Data
Hardware
Complexity theory
Real-time systems
Personnel
Optimization
Mathematical models
Big data
identification
3Vs
offloading
mathematical equations
期刊
I
IF:
5.7
论文数:
887
被引数:
3.0K
机构
引用论文
Bictegravir/emtricitabine/tenofovir alafenamide in older individuals with HIV: Results of a 96‐week, phase 3b, open‐label, switch trial in virologically suppressed people ≥65 years of age.png)
HIV Medicine
OAAI
HIV MedicineIF0
OAAI分享收藏Vocal and anatomical evidence for two-voiced sound production in the greater sage-grouseCentrocercus urophasianus大圣人松鸡 urophasianus 产生两声声音的声音和解剖学证据
PREAI
分享收藏
查看更多内容