Image-recognition-based system for precise hand function evaluation*

doi:10.1016/j.displa.2023.102409

2023-07-01

PRE

DOI：10.1016/j.displa.2023.102409

原文链接

原文求助

摘要

En 中文

Hand dysfunction caused by hand injuries, strokes, or other neurological degenerative diseases such as cervical spondylosis is being increasingly reported. Currently, hand function assessments for diagnosis or rehabilitation are primarily based on qualitative scales, which are subjective and may vary considerably depending on the expertise of the attending clinician. Although wearable sensors and computer vision techniques have been proposed to obtain quantitative hand movement information, both have limitations. In this study, a multiview video tracking and recording system was set up using high-speed cameras and mapping of actual hand movements. The state-of-the-art software DeepLabCut was used to obtain precise 2D and 3D finger joint positions. Kinematic parameters, such as movement count, period, phase, and Pearson coefficient were used to characterize hand movement based on the relative distance-time curves of finger joints. Experimental results in a clinical setting showed that this video-based image-recognition neural network method can accurately distinguish healthy from dysfunctional hand movements. The proposed system is inexpensive, easy to set up and use, and exhibits high accuracy. Thus, it can revolutionize medical hand motion analysis and spur the development of automated quantitative systems for early hand-related disorder detection.

Keyword:

Hand function

Computer vision

Machine learning

Quantitative assessment

Cervical spondylosis

期刊

Displays

IF:

3.4

论文数:

2.3K

被引数:

3.2K

机构

peking university

学者数:

11.9W

论文数: 8.7W

被引数: 146

引用论文

Behavioral and thermoregulatory characteristics of Dorper sheep

Journal of Animal Behaviour and Biometeorology

IF0

2017-01-01

PREAI

Tatiana Saraiva Torres; Lucimar Oliveira Silva; Laylson da Silva Borges; Luciano Silva Sena; Antonia Leidiana Moreira; Leandra Polliny Morais Machado; João Paulo Barbosa Cardoso; Antônio de Sousa Junior

Root Cause Analysis Using Sequence Alignment and Latent Semantic Indexing 基于序列比对和潜在语义索引的根因分析

19th Australian Conference on Software Engineering (aswec 2008)

IF0

2008-03-01

PREAI

R. P. Jagadeesh Chandra Bose; U. Suresh

An investigation of two approaches to basin hopping minimization for atomic and molecular clusters

Chemical Physics Letters

IF0

1998-06-01

PREAI

Ronald P White; Howard R Mayne