arrow
返回

Approximate Importance-Based Sampling for Neural Network Training

delete2026-01-01
delete0
PRE
AI
P
Piotr Duda *
M
Mateusz Wojtulewicz
L
Leszek Rutkowski
DOI:10.1007/978-3-032-03705-3_7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
本文介绍了一种BBATDD算法(基于提升算法并使用漂移检测器训练的算法)的简化版本,称为A-BBATDD,旨在加速神经网络训练。新版本不单独更新每个训练样本的重要性,而是基于整个小批量进行近似。这使得该方法更容易与TensorFlow或PyTorch等标准机器学习工具配合使用。该算法仍专注于对网络最困难的样本进行采样,并包含一个漂移检测机制(CUSUM)以在网络性能显著变化时重置重要性值。在MNIST数据集上的实验表明,该方法的表现特别敏感于小批量大小。
Keyword:
Neural network training
sampling methods
drift detection

期刊

A
ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2025, PT I
IF:
0
论文数:
24
被引数:
0

机构

A
agh university of krakow
学者数:
1.7K
论文数: 769
被引数: 0
T
technical university czestochowa
学者数:
1.3K
论文数: 1.5K
被引数: 1
引用论文

引用论文

Accelerating deep neural network learning using data stream methodology
err2024-05-01
err0
PREAI
errDuda,Piotr; Wojtulewicz,Mateusz; Rutkowski,Leszek
err分享
err收藏
err分享
err收藏
Not All Samples Are Born Equal: Towards Effective Clean-Label Backdoor Attacks
err2023-07-01
err17
PREAI
errGao, Yinghua; Li, Yiming; Zhu, Linghui; Wu, Dongxian; Jiang, Yong; Xia, Shu-Tao
err分享
err收藏
Accelerating User Profiling in E-Commerce Using Conditional GAN Networks for Synthetic Data Generation
err2024-07-29
err1
errOAAI
errGabryel, Marcin; Kocic, Eliza; Kocic, Milan; Patora-Wysocka, Zofia; Xiao, Min; Pawlak, Miroslaw
err分享
err收藏
Continuous Inspection Schemes
err1954-06-01
err0
PREAI
errE. S. Page
err分享
err收藏
The Streaming Approach to Training Restricted Boltzmann Machines
err2021-01-01
err0
PREAI
errDuda,Piotr; Rutkowski,Leszek; Woldan,Piotr; Najgebauer,Patryk
err分享
err收藏
没有更多内容