arrow
返回

On removing conflicts for machine learning

delete2022-11-01
delete4
PRE
AI
S
Sergio Ledesma
M
Mario-Alberto Ibarra-Manzano *
D
Dora-Luz Almanza-Ojeda
J
Juan Gabriel Avina‐Cervantes
E
Eduardo Cabal‐Yépez
DOI:10.1016/j.eswa.2022.117835delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
A Machine Learning (ML) system learns from a set of samples called the training set. In some cases, the training set may have learning conflicts that affect the performance of the machine learning system. A learning conflict is produced when two or more samples in a dataset have similar input values but different target values. We propose a method to remove learning conflicts from a dataset in this work. Our method is based on a genetic algorithm tries to keep those samples that free of conflicts and intents to remove those samples with conflicts. Each individual in the genetic algorithm represents a possible dataset. We introduce the concept of retention error in the fitness function, which describes how many samples are kept while removing learning conflicts. Additionally, the fitness function comprises the Mean-Squared Error (MSE) that validates the machine learning performance. The algorithm is designed to keep as many samples as possible while the machine learning system exhibits the highest possible performance. Therefore, the proposal consists in cleaning first the dataset that compares and highlights the individual with the best performance in the Genetic Algorithm (GA), recommending which samples must be included for training and testing. Three different datasets with learning conflicts are used to test the proposed methodology. Besides, one artificial neural network is trained using the datasets with learning conflicts for each dataset. After removing the conflicts, a second artificial neural network is trained using the cleaned datasets. A noticeable reduction in the mean-square error is observed when the neural network is trained using the cleaned dataset.
Keyword:
Learning conflicts
Training issues
Machine learning
Artificial neural networks
Genetic algorithm

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.1W
被引数:
13.6W

机构

U
Universidad de Guanajuato
学者数:
116
论文数: 61
被引数: 939
引用论文

引用论文

Geospatial Modelling for Delineation of Crop Management Zones Using Local Terrain Attributes and Soil Properties
err2022-04-27
err0
errOAAI
errRoomesh Kumar Jena; Siladitya Bandyopadhyay; Upendra Kumar Pradhan; Pravash Chandra Moharana; Nirmal Kumar; Gulshan Kumar Sharma; Partha Deb Roy; Dibakar Ghosh; Prasenjit Ray; Shelton Padua; Sundaram Ramachandran; Bachaspati Das; Surendra Kumar Singh; Sanjay Kumar Ray; Amnah Mohammed Alsuhaibani; Ahmed Gaber; Akbar Hossain
err分享
err收藏
err分享
err收藏
Differential Neural Networks (DNN)差分神经网络 (DNN)
err2020-01-01
err7
errOAAI
errLedesma, Sergio; Almanza-Ojeda, Dora-Luz; Ibarra-Manzano, Mario-Alberto; Yepez, Eduardo Cabal; Avina-Cervantes, Juan Gabriel; Fallavollita, Pascal
err分享
err收藏
err分享
err收藏
Real-time machine learning-based approach for pothole detection
err2021-12-01
err27
errOAAI
errEgaji, Oche Alexander; Evans, Gareth; Griffiths, Mark Graham; Islas, Gregory
err分享
err收藏
学者 查看更多内容