An Information Maximization Multi-task Clustering Method for egocentric temporal segmentation

doi:10.1016/j.asoc.2020.106425

An Information Maximization Multi-task Clustering Method for egocentric temporal segmentation

2020-09-01

7

PRE

AI

DOI：10.1016/j.asoc.2020.106425

Original

Original request for help

Save

Abstract

En 中文

With the widespread application of vision-based wearable devices, temporal segmentation helps people search for and localize all occurrences quickly in egocentric videos. In the same scenario, the activities are similar to each other, e.g., people staying at home typically cook, clean and watch TV. These relations among videos of different individuals are regarded as auxiliary information to improve task performance. Inspired by this, we propose an Information Maximization Multi-task Clustering (IMMC) algorithm for egocentric temporal segmentation. The algorithm mainly includes two parts: (1) within-task clustering: clustering on each task based on an information maximization approach, and (2) cross-task information transferring: a novel strategy is presented to transfer correlation information between tasks, which balances the correlation among clusters in different tasks to improve the performance of the individual task. A draw-merge method is designed to address the optimization problem. Experiments are performed on three publicly available first-person vision data sets and a new data set we construct (Outdoor data set). The results show that IMMC consistently outperforms the state-of-the-art clustering methods in multiple evaluation metrics. Moreover, it achieves relatively good performance on runtime cost and convergence. (C) 2020 Elsevier B.V. All rights reserved.

Keywords:

Temporal segmentation

First person vision

Multi-task clustering

An Information Maximization Multi-task Clustering Method for egocentric temporal segmentation

Abstract

AI Summary

Journal

Organization