Cluster based similarity extraction upon distributed datasets

Thanasis Moustakas

doi:10.1007/s10586-023-04116-5

Cluster based similarity extraction upon distributed datasets

2023-08-25

1

PRE

AI

DOI：10.1007/s10586-023-04116-5

Original

Original request for help

Save

Abstract

En 中文

The internet of things (IoT) offers a vast infrastructure where numerous devices interact to collect data or perform simple processing activities. These devices are, usually, equipped with sensors, software and storage capabilities being able to process the collected data and exchange knowledge with their peers. Data and knowledge may be transferred, in an upwards mode, to the edge infrastructure and Cloud to be the subject of more complex processing. Advanced processing may be also realized upon clusters of IoT devices or edge nodes, i.e., a set of interconnected devices/nodes.Such group of nodes may work to achieve a common goal, thus, we may desire to rely on their collected data to support activities like federated learning.A training process, when necessary, may be delivered across the cluster of nodes to conclude the view of the group. In this paper, we focus on the development of a monitoring process upon the collected data and a grouping method upon multiple datasets formulated by IoT devices (hosted by edge nodes) in order to deliver the most similar ones. Our vision is to continuously identify similar datasets to support knowledge extraction through the adoption of techniques like the aforementioned federated learning. We utilize a correlation detection method combined with a probabilistic model to conclude the most similar datasets.

Keywords:

Similarity extraction

Cluster computing

Distributed datasets

Distance function

Cluster based similarity extraction upon distributed datasets

Abstract

Journal

Organization