arrow
返回

Micro Activity Recognition Using Multi-View 3D Point Clouds

delete2024-03-11
delete0
PRE
AI
Y
Yuki Mishima *
T
Tomokazu Matsui
Y
Yuki Matsuda
H
Hirohiko Suwa
K
Keiichi Yasumoto
DOI:10.1109/PerComWorkshops59983.2024.10502723delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent years, aiming to support residents' daily lives and activities, research and development activities on indoor activity recognition have become increasingly active. However, existing methods of activity recognition still have challenges including (i) concerns about privacy infringement, (ii) the necessity of wearing sensors constantly, (iii) the need for regular battery charging, and (iv) the difficulty in recognizing certain activities. Additionally, the methods primarily focused on macro activities like cooking and cleaning. Still, it is believed that a more accurate application to life support requires recognition of more detailed activities known as micro activities, such as handling ingredients in cooking or cutting. In this paper, we propose a method for micro activity recognition using 3D point clouds as a solution to these issues. 3D point clouds represent objects as sets of 3D coordinates and are expected to offer lower privacy risks and higher accuracy compared to video images. The challenges to be addressed in the proposed method include defining the micro activities of interest and recognizing them from 3D point clouds. In the proposed method, micro activities are defined as single actions like cutting, holding, or placing that occur in cooking activities in typical households. We then apply a deep learning model called P4Transformer, which can classify time-series 3D point cloud input data obtained from multiple Azure Kinect devices installed in typical households, allowing for occlusion-tolerant micro activity recognition. We have collected a time-series 3D point cloud data for more than 40 sessions of cooking activities in five typical households, then evaluated the accuracy of the micro activity recognition model using Leave-One-Session-Out cross-validation. The results showed that the proposed method achieves an average recognition accuracy of 74.3%.
Keyword:
Multi-View 3D point cloud
Micro Activity Recognition
Deep Learning

期刊

I
IEEE International Conference on Pervasive Computing and Communications Workshops and Other Affiliated Events, PERCOM Workshops
IF:
0
论文数:
5
被引数:
0

机构

N
nara institute of science & technology
学者数:
4.1K
论文数: 3.1K
被引数: 7
引用论文

引用论文

Anger management for people with mild to moderate learning disabilities: Study protocol for a multi-centre cluster randomized controlled trial of a manualized intervention delivered by day-service staff
err2011-02-09
err0
errOAAI
errPaul Willner; Andrew Jahoda; John Rose; Biza Stenfert-Kroese; Kerenza Hood; Julia K Townson; Jacqueline Nuttall; David Gillespie; David Felce
err分享
err收藏
err分享
err收藏
Traffic noise in LCA
err2009-08-11
err0
PREAI
errHans-Jörg Althaus; Peter de Haan; Roland W. Scholz
err分享
err收藏
err分享
err收藏
SALON: Simplified Sensing System for Activity of Daily Living in Ordinary Home
errSENSORS
IF3.5
err2020-08-29
err14
errOAAI
errMatsui, Tomokazu; Onishi, Kosei; Misaki, Shinya; Fujimoto, Manato; Suwa, Hirohiko; Yasumoto, Keiichi
err分享
err收藏
学者 查看更多内容