返回
Optimising Queries for Pattern Detection Over Large Scale Temporally Evolving Graphs
DOI:10.1109/ACCESS.2024.3417352.png)
摘要
En 中文
Large-scale graph processing and Stream processing are two distinct computational paradigms for big data processing. Graph processing deals with computation on graphs of billions of vertices and edges. However, large-scale graph processing frameworks mostly work on graphs that do not change over time, while on the other end of the spectrum, stream processing operates on a continuous stream of data in real-time. Modern-day graphs change very rapidly over time, and finding patterns in temporally evolving graphs could reveal a lot of insights that can not be unveiled using traditional graph computations. We have proposed a novel framework called FlowGraph which could find patterns in dynamic and temporally evolving graphs. Computations on large-scale graphs are iterative and take multiple steps before final results can be calculated, which is very different from stream processing which is one-shot computation. Therefore, the most critical bottleneck of such a system is the time required to process the query. In this work, we have proposed a query optimization technique that could reduce the time required to process the pattern. The proposed system has an optimization technique that could reduce the time required to process the pattern, especially those related to the temporal evolution of the graph. Our method shows for eight clauses the execution time is reduced by 75%, we also proved that this improvement is not affected by the scaling of the graph or the change of elements in given clauses.
Keyword:
Optimization
Real-time systems
Query processing
Social networking (online)
Databases
Data structures
Transportation
Graph data structures
distributed computations
vertex-centric computations
temporal pattern recognition
query optimization
and dynamic graph computations
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Identification of two immortalized cell lines, ECV304 and bEnd3, for in vitro permeability studies of blood-brain barrier鉴定两种永生化细胞系ECV304和bEnd3,用于血脑屏障的体外通透性研究
PLOS ONE
IF0
Recommender Systems for Large-Scale Social Networks: A review of challenges and solutions面向大规模社交网络的推荐系统: 挑战与解决方案综述
Conjugated heat transfer and temperature distributions in a gas turbine combustion liner under base-load operation基本负荷运行下燃气轮机燃烧衬里中的共轭传热和温度分布

