arrow
返回

Distributed Sparse Class-Imbalance Learning and Its Applications

delete2021-11-01
delete2
PRE
AI
C
Chandresh Kumar Maurya *
D
Durga Toshniwal
DOI:10.1109/TBDATA.2017.2688372delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In the present work, the study on class imbalance problems in a distributed setting exploiting sparsity structure in the data has been carried out. We formulate the class-imbalance learning problem as a cost-sensitive learning problem with L-1 regularization. The cost-sensitive loss function is a cost-weighted smooth hinge loss. The resultant optimization problem is minimized within the Distributed Alternating Direction Method of Multiplier (DADMM) framework. We partition the data matrix across samples. This operation splits the original problem into a distributed L-2 regularized smooth loss minimization and a L-1 regularized squared loss minimization. L-2 regularized subproblem is solved via Limited-memory Broyden-Fletcher-Goldfarb-Shanno (L-BFGS) and random coordinate descent method in parallel at multiple processing nodes using MPI whereas L-1 regularized problem is just a simple soft-thresholding operation. We show, empirically, that the distributed solution approximates the centralized solution on many benchmark data sets. The centralized solution is obtained via Cost-Sensitive Stochastic Coordinate Descent (CSSCD). Empirical results on small and large-scale benchmark datasets show some promising avenues to further investigate the real-world applications of the proposed algorithms such as anomaly detection, class-imbalance learning, etc. To the best of our knowledge, ours is the first work to study class-imbalance in a distributed environment on large-scale sparse data.
Keyword:
Class-imbalance learning
distributed algorithm
anomaly detection
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE Transactions on Big Data
IF:
5.7
论文数:
887
被引数:
3.0K

机构

I
indian institute of technology (iit) - roorkee
学者数:
3.8K
论文数: 4.0K
被引数: 4
I
indian institute of technology system (iit system)
学者数:
9.5W
论文数: 9.9W
被引数: 93
引用论文

引用论文

The effect of ERCC1 and ERCC2 gene polymorphysims on response to cisplatin based therapy in osteosarcoma patients
err2018-07-06
err0
errOAAI
errHadeel Obiedat; Nasr Alrabadi; Eyad Sultan; Marwa Al Shatti; Malek Zihlif
err分享
err收藏
Test strategies for cost-sensitive decision trees
err2006-08-01
err113
PREAI
errLing, Charles X.; Sheng, Victor S.; Yang, Qiang
err分享
err收藏
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent使用新型MIL-53(Fe) 作为高效吸附剂通过吸附从水溶液中去除砷
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
err分享
err收藏
Neuronal-binding antibodies from patients with antiphospholipid syndrome induce cognitive deficits following intrathecal passive transfer
err2003-06-01
err0
PREAI
errY Shoenfeld; A Nahum; A D Korczyn; M Dano; R Rabinowitz; O Beilin; C G Pick; L Leider-Trejo; L Kalashnikova; M Blank; J Chapman
err分享
err收藏
Cost-Sensitive Online Classification
err2014-10-01
err83
errOAAI
errWang, Jialei; Zhao, Peilin; Hoi, Steven C. H.
err分享
err收藏
Cost-Sensitive Multi-Label Learning for Audio Tag Annotation and Retrieval
err2011-06-01
err88
PREAI
errLo, Hung-Yi; Wang, Ju-Chiang; Wang, Hsin-Min; Lin, Shou-De
err分享
err收藏
err分享
err收藏
学者 查看更多内容