.png){kind=icon}
.png){kind=icon}
Return
Integrated method; distributed processing of large XML data
.png){kind=icon}
PRE
AI
DOI：10.1007/s10586-023-04010-0.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The traditional standalone computing approach is difficult to handle the task of processing large XML data due to scalability, thus distributed processing using cluster systems becomes an inevitable choice. The currently distributed XML processing methods generally rely on existing distributed computing frameworks;
general purpose data, which have limitations such as complex configuration, inflexible working mechanism, and difficult per;
mance optimization in the context of XML semi-structural features and complex queries. In addition, XML distributed queries suffer from a low level of automatic processing and lack of effective integration with distributed XML parsing and indexing. In this paper we propose an integrated method;
distributed processing of large XML data, called the dXML method. Our method supports the distributed parsing of arbitrary XML fragment and the distributed creation of index, and adopts the efficient navigational XPath evaluation based on relation index. Through a distributed XPath evaluation approach based on filter-upon-pre-evaluate, our method enables data locality and reduces network traffic during the distributed evaluation of complex XPath predicates. dXML integrates the distributed processing technology of XML parsing, index creation and XPath query, provides a one-stop XML processing solution, supports the automatic distributed processing of large XML data, and has the characteristics of lightweight configuration and flexible working mechanism. Experimental evaluation verifies the effectiveness of dXML, and comparative experimental results show that dXML has better distributed query per;
mance than both the typical existing navigational and Twig distributed processing methods.
Keywords:
Large XML data
XML parsing
XPath evaluation
Distributed processing
Integrated method
Journal
C
IF:
4.1
Papers:
5.0K
Citations:
7.5K