arrow
Return

Image-recognition-based system for precise hand function evaluation*

delete2023-07-01
delete3
PRE
AI
X
Xinrui Huang
X
Xi Chen
X
Xiaoteng Shang
S
Shiwen Zhang
J
Jiyan Jin
S
Shuyang Li
F
Feifei Zhou *
伊鸣 cover
伊鸣 (Ming Yi) *
DOI:10.1016/j.displa.2023.102409delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Hand dysfunction caused by hand injuries, strokes, or other neurological degenerative diseases such as cervical spondylosis is being increasingly reported. Currently, hand function assessments for diagnosis or rehabilitation are primarily based on qualitative scales, which are subjective and may vary considerably depending on the expertise of the attending clinician. Although wearable sensors and computer vision techniques have been proposed to obtain quantitative hand movement information, both have limitations. In this study, a multiview video tracking and recording system was set up using high-speed cameras and mapping of actual hand movements. The state-of-the-art software DeepLabCut was used to obtain precise 2D and 3D finger joint positions. Kinematic parameters, such as movement count, period, phase, and Pearson coefficient were used to characterize hand movement based on the relative distance-time curves of finger joints. Experimental results in a clinical setting showed that this video-based image-recognition neural network method can accurately distinguish healthy from dysfunctional hand movements. The proposed system is inexpensive, easy to set up and use, and exhibits high accuracy. Thus, it can revolutionize medical hand motion analysis and spur the development of automated quantitative systems for early hand-related disorder detection.
Keywords:
Hand function
Computer vision
Machine learning
Quantitative assessment
Cervical spondylosis

Journal

Displays cover
Displays
IF:
3.4
Papers:
2.3K
Citations:
3.2K

Organization

P
peking university
Scholars:
11.9W
Papers: 8.7W
Citations: 146
Cited Papers

Cited Papers

Behavioral and thermoregulatory characteristics of Dorper sheep
err2017-01-01
err0
PREAI
errTatiana Saraiva Torres; Lucimar Oliveira Silva; Laylson da Silva Borges; Luciano Silva Sena; Antonia Leidiana Moreira; Leandra Polliny Morais Machado; João Paulo Barbosa Cardoso; Antônio de Sousa Junior
errShare
errSave
A Survey on Hand Pose Estimation with Wearable Sensors and Computer-Vision-Based Methods
errSENSORS
IF3.5
err2020-02-16
err92
errOAAI
errChen, Weiya; Yu, Chenchen; Tu, Chenyu; Lyu, Zehua; Tang, Jing; Ou, Shiqi; Fu, Yan; Xue, Zhidong
errShare
errSave
Methane removal seen as tool to slow warming
err2021-11-05
err0
PREAI
errCathleen O’Grady
errShare
errSave
ZnO/ZnTe Core/Shell Nanowire Array Heterojunctions
err2014-05-01
err0
PREAI
errChunlan Tao; Lulu Chen; Zhenxing Zhang; Haijun Zhang; Erqing Xie
errShare
errSave
researcher View more