返回
Random-Forest-Inspired Neural Networks
DOI:10.1145/3232230.png)
摘要
En 中文
Neural networks have become very popular in recent years, because of the astonishing success of deep learning in various domains such as image and speech recognition. In many of these domains, specific architectures of neural networks, such as convolutional networks, seem to fit the particular structure of the problem domain very well and can therefore perform in an astonishingly effective way. However, the success of neural networks is not universal across all domains. Indeed, for learning problems without any special structure, or in cases where the data are somewhat limited, neural networks are known not to perform well with respect to traditional machine-learning methods such as random forests. In this article, we show that a carefully designed neural network with random forest structure can have better generalization ability. In fact, this architecture is more powerful than random forests, because the back-propagation algorithm reduces to a more powerful and generalized way of constructing a decision tree. Furthermore, the approach is efficient to train and requires a small constant factor of the number of training examples. This efficiency allows the training of multiple neural networks to improve the generalization accuracy. Experimental results on real-world benchmark datasets demonstrate the effectiveness of the proposed enhancements for classification and regression.
Keyword:
Neural network
random forest
classification
regression
期刊
IF:
6.6
论文数:
1.5K
被引数:
6.2K
机构
引用论文
On the Development and Applications of Cellulosic Nanofibrillar and Nanocrystalline Materials纤维素纳米原纤和纳米晶材料的发展与应用
Factors associated with desire for children among HIV-infected women and men: A quantitative and qualitative analysis from Malawi and implications for the delivery of safer conception counseling
AIDS Care
IF0
Room temperature synthesis of reduced graphene oxide nanosheets as anode material for supercapacitors室温合成还原氧化石墨烯纳米片作为超级电容器负极材料的研究
Adaptive Energy Management Strategy Calibration in PHEVs Based on a Sensitivity Study基于灵敏度研究的phev自适应能量管理策略标定

