返回
TITAN: A knowledge-based platform for Big Data workflow management
DOI:10.1016/j.knosys.2021.107489.png)
摘要
En 中文
Modern applications of Big Data are transcending from being scalable solutions of data processing and analysis, to now provide advanced functionalities with the ability to exploit and understand the underpinning knowledge. This change is promoting the development of tools in the intersection of data processing, data analysis, knowledge extraction and management. In this paper, we propose TITAN, a software platform for managing all the life cycle of science workflows from deployment to execution in the context of Big Data applications. This platform is characterised by a design and operation mode driven by semantics at different levels: data sources, problem domain and workflow components. The proposed platform is developed upon an ontological framework of meta-data consistently managing processes and models and taking advantage of domain knowledge. TITAN comprises a well-grounded stack of Big Data technologies including Apache Kafka for inter-component communication, Apache Avro for data serialisation and Apache Spark for data analytics. A series of use cases are conducted for validation, which comprises workflow composition and semantic meta-data management in academic and real-world fields of human activity recognition and land use monitoring from satellite images. (C) 2021 The Author(s). Published by Elsevier B.V.
Keyword:
Big Data analytics
Semantics
Knowledge extraction
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Big Data Systems Meet Machine Learning Challenges: Towards Big Data Science as a Service大数据系统迎接机器学习挑战: 走向大数据科学即服务
BIG DATA RESEARCH
IF4.2
Implementation of a Reuse Process for Liquid Crystal Displays Using an Eccentric-Form Tool使用偏心形式工具实现液晶显示器的重用过程

