arrow
Return

A novel multi-scale loss function for classification problems in machine learning

delete2024-02-01
delete1
delete
OA
AI
L
Leonid Berlyand *
R
Robert C. Creese
P
Pierre‐Emmanuel Jabin
DOI:10.1016/j.jcp.2023.112679delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We introduce two-scale loss functions for use in various gradient descent algorithms applied to classification problems via deep neural networks. This new method is generic in the sense that it can be applied to a wide range of machine learning architectures, from deep neural networks to support vector machines for example. These two-scale loss functions allow to focus the training onto objects in the training set which are not well classified. This leads to an increase in several measures of performance for appropriately-defined two-scale loss functions with respect to the more classical cross-entropy when tested on traditional deep neural networks on the MNIST, CIFAR10, and CIFAR100 data-sets.
Keywords:
Multi-scale
Deep neural networks
Machine learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Computational Physics cover
Journal of Computational Physics
IF:
3.8
Papers:
1.5W
Citations:
7.4W

Organization

P
pennsylvania commonwealth system of higher education (pcshe)
Scholars:
12.9W
Papers: 11.7W
Citations: 177