arrow
Return

Vector-kernel convolutional neural networks

delete2019-02-01
delete44
PRE
AI
J
Jun Ou *
Y
Yujian Li
DOI:10.1016/j.neucom.2018.11.028delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In computer vision, convolutional neural networks (CNNs) obtain extremely striking recognition performance. However, in many CNNs there exists a great deal of parameter redundancy because of matrix kernels. To address this problem, we propose a novel model, namely, vector-kernel convolutional neural network (VeckerNet). In a VeckerNet, each convolutional layer can only use vector kernels of either size k x 1 or 1 x k. Compared to the popular models, e.g., AlexNet, VGG, ResNet and DenseNet, the VeckerNets obtain up to 20.8% relative performance improvement with the parameter reduction by 3 to 97%. Impressively, compared to the ResNets with the same depth, e.g., 44, 56, 101 and 110 layers, the VeckerNets obtain 0.57 to 1.4% relative performance improvement with a decrease of parameters by up to more than two-thirds. The experimental results indicate that the VeckerNets can retain good recognition performance while effectively reducing network parameters. (C) 2018 Elsevier B.V. All rights reserved.
Keywords:
Convolutional neural networks
Parameter redundancy
Matrix kernels
Vector kernels
Parameter reduction
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

B
Beijing University of Technology
Scholars:
2.8W
Papers: 2.1W
Citations: 2.7W
Cited Papers

Cited Papers

Allele-Specific HLA Loss and Immune Escape in Lung Cancer Evolution
errCell
IF0
err2017-11-01
err0
errOAAI
errNicholas McGranahan; Rachel Rosenthal; Crispin T. Hiley; Andrew J. Rowan; Thomas B.K. Watkins; Gareth A. Wilson; Nicolai J. Birkbak; Selvaraju Veeriah; Peter Van Loo; Javier Herrero; Charles Swanton; Charles Swanton; Mariam Jamal-Hanjani; Selvaraju Veeriah; Seema Shafi; Justyna Czyzewska-Khan; Diana Johnson; Joanne Laycock; Leticia Bosshard-Carter; Rachel Rosenthal; Pat Gorman; Robert E. Hynds; Gareth Wilson; Nicolai J. Birkbak; Thomas B.K. Watkins; Nicholas McGranahan; Stuart Horswell; Richard Mitter; Mickael Escudero; Aengus Stewart; Peter Van Loo; Andrew Rowan; Hang Xu; Samra Turajlic; Crispin Hiley; Christopher Abbosh; Jacki Goldman; Richard Kevin Stone; Tamara Denner; Nik Matthews; Greg Elgar; Sophia Ward; Marta Costa; Sharmin Begum; Ben Phillimore; Tim Chambers; Emma Nye; Sofia Graca; Maise Al Bakir; Kroopa Joshi; Andrew Furness; Assma Ben Aissa; Yien Ning Sophia Wong; Andy Georgiou; Sergio Quezada; John A. Hartley; Helen L. Lowe; Javier Herrero; David Lawrence; Martin Hayward; Nikolaos Panagiotopoulos; Shyam Kolvekar; Mary Falzon; Elaine Borg; Teresa Marafioti; Celia Simeon; Gemma Hector; Amy Smith; Marie Aranda; Marco Novelli; Dahmane Oukrif; Sam M. Janes; Ricky Thakrar; Martin Forster; Tanya Ahmad; Siow Ming Lee; Dionysis Papadatos-Pastos; Dawn Carnell; Ruheena Mendes; Jeremy George; Neal Navani; Asia Ahmed; Magali Taylor; Junaid Choudhary; Yvonne Summers; Raffaele Califano; Paul Taylor; Rajesh Shah; Piotr Krysiak; Kendadai Rammohan; Eustace Fontaine; Richard Booton; Matthew Evison; Phil Crosbie; Stuart Moss; Faiza Idries; Leena Joseph; Paul Bishop; Anshuman Chaturved; Anne Marie Quinn; Helen Doran; Angela Leek; Phil Harrison; Katrina Moore; Rachael Waddington; Juliette Novasio; Fiona Blackhall; Jane Rogan; Elaine Smith; Caroline Dive; Jonathan Tugwood; Ged Brady; Dominic G. Rothwell; Francesca Chemi; Jackie Pierce; Sakshi Gulati; Babu Naidu; Gerald Langman; Simon Trotter; Mary Bellamy; Hollie Bancroft; Amy Kerr; Salma Kadiri; Joanne Webb; Gary Middleton; Madava Djearaman; Dean Fennell; Jacqui A. Shaw; John Le Quesne; David Moore; Apostolos Nakas; Sridhar Rathinam; William Monteiro; Hilary Marshall; Louise Nelson; Jonathan Bennett; Joan Riley; Lindsay Primrose; Luke Martinson; Girija Anand; Sajid Khan; Anita Amadi; Marianne Nicolson; Keith Kerr; Shirley Palmer; Hardy Remmen; Joy Miller; Keith Buchan; Mahendran Chetty; Lesley Gomersall; Jason Lester; Alison Edwards; Fiona Morgan; Haydn Adams; Helen Davies; Malgorzata Kornaszewska; Richard Attanoos; Sara Lock; Azmina Verjee; Mairead MacKenzie; Maggie Wilcox; Harriet Bell; Allan Hackshaw; Yenting Ngai; Sean Smith; Nicole Gower; Christian Ottensmeier; Serena Chee; Benjamin Johnson; Aiman Alzetani; Emily Shaw; Eric Lim; Paulo De Sousa; Monica Tavares Barbosa; Alex Bowman; Simon Jordan; Alexandra Rice; Hilgardt Raubenheimer; Chiara Proli; Maria Elena Cufari; John Carlo Ronquillo; Angela Kwayie; Harshil Bhayani; Morag Hamilton; Yusura Bakar; Natalie Mensah; Lyn Ambrose; Anand Devaraj; Silviu Buderi; Jonathan Finch; Leire Azcarate; Hema Chavan; Sophie Green; Hillaria Mashinga; Andrew G. Nicholson; Kelvin Lau; Michael Sheaff; Peter Schmid; John Conibear; Veni Ezhil; Babikir Ismail; Melanie Irvin-sellers; Vineet Prakash; Peter Russell; Teresa Light; Tracey Horey; Sarah Danson; Jonathan Bury; John Edwards; Jennifer Hill; Sue Matthews; Yota Kitsanta; Kim Suvarna; Patricia Fisher; Allah Dino Keerio; Michael Shackcloth; John Gosney; Pieter Postmus; Sarah Feeney; Julius Asante-Siaw; Hugo J.W.L. Aerts; Stefan Dentro; Christophe Dessimoz
errShare
errSave
FUIQA: Fetal Ultrasound Image Quality Assessment With Deep Convolutional Networks
err2017-05-01
err168
PREAI
errWu, Lingyun; Cheng, Jie-Zhi; Li, Shengli; Lei, Baiying; Wang, Tianfu; Ni, Dong
errShare
errSave
G-CNN: Object Detection via Grid Convolutional Neural Network
err2017-01-01
err30
errOAAI
errLu, Qishuo; Liu, Chonghua; Jiang, Zhuqing; Men, Aidong; Yang, Bo
errShare
errSave
Neural Network for Nanoscience Scanning Electron Microscope Image Recognition
err2017-10-16
err102
errOAAI
errModarres, Mohammad Hadi; Aversa, Rossella; Cozzini, Stefano; Ciancio, Regina; Leto, Angelo; Brandino, Giuseppe Piero
errShare
errSave
Stacked Convolutional Denoising Auto-Encoders for Feature Representation
err2017-04-01
err367
PREAI
errDu, Bo; Xiong, Wei; Wu, Jia; Zhang, Lefei; Zhang, Liangpei; Tao, Dacheng
errShare
errSave
Targeted Deletion of the Cytosolic Domain of Tissue Factor in Mice Does Not Affect Development
err2001-08-01
err0
PREAI
errEls Melis; Lieve Moons; Maria De Mol; Jean-Marc Herbert; Nigel Mackman; Désiré Collen; Peter Carmeliet; Mieke Dewerchin
errShare
errSave
errShare
errSave
researcher View more