返回
IAR 2.0: An Algorithm for Refining Inconsistent Annotations for Time-Series Data Using Discriminative Classifiers
DOI:10.1109/ACCESS.2025.3534637.png)
摘要
En 中文
The performance of discriminative machine-learning classifiers, such as neural networks, is limited by training label inconsistencies. Even expert-based annotations can suffer from label inconsistencies, especially in the case of ambiguous phenomena-to-annotate. To address this, we propose a novel algorithm, iterative annotation refinement (IAR) 2.0, for refining inconsistent annotations for time-series data. IAR 2.0 uses a procedure that utilizes discriminative classifiers to iteratively combine original annotations with increasingly accurate posterior estimates of classes present in the data. Unlike most existing label refinement approaches, IAR 2.0 offers a simpler yet effective solution for resolving ambiguities in training labels, working with real label noise on time-series data instead of synthetic label noise on image data. We demonstrate the effectiveness of our algorithm through five distinct classification tasks on two highly distinct data modalities. As a result, we show that the labels produced by IAR 2.0 systematically improve classifier performance compared to using the original labels or a previous state-of-the-art method for label refinement. We also conduct a set of controlled simulations to systematically investigate when IAR 2.0 fails to improve on the original training labels. The simulation results demonstrate that IAR 2.0 improves performance in nearly all tested conditions. We also find that the decrease in performance when IAR 2.0 fails is small compared to the average performance gain when IAR 2.0 succeeds, encouraging the use of IAR 2.0 even when the nature of data is unknown. The code is freely available at https://github.com/SPEECHCOG/IAR_2.
Keyword:
Training
Annotations
Noise measurement
Data models
Predictive models
Classification algorithms
Prediction algorithms
Computational modeling
Neural networks
Standards
Annotation refinement
daylong audio recordings
discriminative classifiers
human activity recognition
inconsistent labels
label refinement
movement sensors
multi-sensor inertial measurement unit
speech emotion recognition
time-series data
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Factors affecting the cognitive profile of 11-year-old children born very preterm
PEDIATRIC RESEARCH
IF3.1
Comparison of End-to-End Neural Network Architectures and Data Augmentation Methods for Automatic Infant Motility Assessment Using Wearable Sensors
SENSORS
IF3.5
Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系?
Automatic Posture and Movement Tracking of Infants with Wearable Movement Sensors
SCIENTIFIC REPORTS
IF3.9

