arrow
返回

Memory-efficient DRASiW Models

delete2024-12-01
delete0
PRE
AI
O
Otávio O. Napoli *
A
Ana de Almeida
E
Edson Borin
M
Maurício Breternitz
DOI:10.1016/j.neucom.2024.128443delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Weightless Neural Networks (WNN) are ideal for Federated Learning due to their robustness and computational efficiency. These scenarios require models with a small memory footprint and the ability to aggregate knowledge from multiple models. In this work, we demonstrate the effectiveness of using Bloom filter variations to implement DRASiW models-an adaptation of WNN that records both the presence and frequency of patterns-with minimized memory usage. Across various datasets, DRASiW models show competitive performance compared to models like Random Forest, k-Nearest Neighbors, Multi-layer Perceptron, and Support Vector Machines, with an acceptable space trade-off. Furthermore, our findings indicate that Bloom filter variations, such as Count Min Sketch, can reduce the memory footprint of DRASiW models by up to 27% while maintaining performance and enabling distributed and federated learning strategies.
Keyword:
Bloom filters
DRASiW
Knowledge aggregation
Weightless neural network

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
universidade estadual de campinas
学者数:
3.3W
论文数: 2.3W
被引数: 19
I
instituto universitario de lisboa
学者数:
1.6K
论文数: 1.8K
被引数: 2
引用论文

引用论文

Experimenting WNN support in object tracking systems
err2016-03-01
err7
PREAI
errde Gregorio, Massimo; Giordano, Maurizio; Rossi, Silvia; Staffa, Mariacarla
err分享
err收藏
Extending the weightless WiSARD classifier for regression
err2020-11-01
err7
PREAI
errLusquino Filho, Leopoldo A. D.; Oliveira, Luiz F. R.; Lima Filho, Aluizio; Guarisa, Gabriel P.; Felix, Lucca M.; Lima, Priscila M. V.; Franca, Felipe M. G.
err分享
err收藏
err分享
err收藏
Weightless Neural Networks as Memory Segmented Bloom Filters
err2020-11-01
err15
PREAI
errSantiago, Leandro; Verona, Leticia; Rangel, Fabio; Firmino, Fabricio; Menasche, Daniel S.; Caarls, Wouter; Breternitz, Mauricio, Jr.; Kundu, Sandip; Lima, Priscila M. V.; Franca, Felipe M. G.
err分享
err收藏
Producing pattern examples from mental images
err2010-03-01
err34
PREAI
errGrieco, Bruno P. A.; Lima, Priscila M. V.; De Gregorio, Massimo; Franca, Felipe M. G.
err分享
err收藏
A survey on federated learning关于联邦学习的调查
err2021-03-01
err671
PREAI
errZhang, Chen; Xie, Yu; Bai, Hang; Yu, Bin; Li, Weihong; Gao, Yuan
err分享
err收藏
学者 查看更多内容