arrow
返回

Achieving efficient source camera identification on Hadoop

delete2019-04-22
delete1
PRE
AI
G
Giuseppe Cattaneo
U
Umberto Ferraro Petrillo *
A
Andrea F. Abate
F
Fabio Narducci
S
Silvio Barra
DOI:10.1007/s11042-019-7561-0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Hadoop is a software framework allowing for the possibility of coding distributed applications starting from a MapReduce algorithm with very low programming efforts. However, the performance of the implementations resulting from such a straightforward approach are often disappointing. This may happen because a vanilla implementation of a MapReduce distributed algorithm often suffers of some performance bottlenecks that may compromise the potential of a distributed system. As a consequence of this, the execution times of the considered algorithm are not up to the expectations. In this paper, we present the work we have done for efficiently engineering, on Apache Hadoop, a reference algorithm for the Source Camera Identification problem (i.e., determining the particular digital camera used for taking a given image). The algorithm we have chosen is the algorithm by Lukas et al.. A first implementation has been obtained in a small amount of time using the default facilities available with Hadoop. However, its performance, analyzed using a cluster of 33 PCs, was very unsatisfactory. A careful profiling of this code revealed some serious performance issues targeting the initial steps of the algorithm and resulting in a bad usage of the cluster resources. Several theoretical and practical optimizations were then tried, and their effects were measured by accurate experimentations. This allowed for the development of alternative implementations that, while leaving unaltered the original algorithm, were able to better use the underlying cluster resources as well as of the Hadoop framework, thus allowing for much better performance and reduced energy requirements than the original vanilla implementation.
Keyword:
Digital image forensics
Source camera identification
Distributed computing
Hadoop
Commodity hardware
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

U
University of Salerno
学者数:
1.2W
论文数: 1.1W
被引数: 1.2W
P
Parthenope University Naples
学者数:
2.6K
论文数: 2.9K
被引数: 10
U
university of cagliari
学者数:
1.2W
论文数: 9.7K
被引数: 9
S
sapienza university rome
学者数:
6.3W
论文数: 4.7W
被引数: 381
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
The Genome Analysis Toolkit: A MapReduce framework for analyzing next-generation DNA sequencing data基因组分析工具包: 用于分析下一代DNA测序数据的MapReduce框架
err2010-07-19
err2.1W
errOAAI
errMcKenna, Aaron; Hanna, Matthew; Banks, Eric; Sivachenko, Andrey; Cibulskis, Kristian; Kernytsky, Andrew; Garimella, Kiran; Altshuler, David; Gabriel, Stacey; Daly, Mark; DePristo, Mark A.
err分享
err收藏
Biometric recognition in surveillance scenarios: a survey
err2016-03-22
err34
PREAI
errNeves, Joao; Narducci, Fabio; Barra, Silvio; Proenca, Hugo
err分享
err收藏
err2003-01-01
err0
PREAI
errV. V. Talanova; T. V. Akimova; A. F. Titov
err分享
err收藏
学者 查看更多内容