arrow
返回

Enabling Flexible Resource Allocation in Mobile Deep Learning Systems

delete2019-02-01
delete8
PRE
AI
C
Chao Wu *
张
张兰 (Lan Zhang)
Q
Qiushi Li
Z
Ziyan Fu
Wenwu Zhu 封面图
Wenwu Zhu (Wenwu Zhu)
Y
Yaoxue Zhang
DOI:10.1109/TPDS.2018.2865359delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning provides new opportunities for mobile applications to achieve higher performance than before. Rather, the deep learning implementation on mobile device today is largely demanding on expensive resource overheads, imposes a significant burden on the battery life and limited memory space. Existing methods either utilize cloud or edge infrastructure that require to upload user data, however, resulting in a risk of privacy leakage and large data transfers; or adopt compressed deep models, nevertheless, downgrading the algorithm accuracy. This paper provides DeepShark, a platform to enable mobile devices with the ability of flexible resource allocation in using commercial-off-the-shelf (COTS) deep learning systems. Compared to existing approaches, DeepShark seeks a balanced point between time and memory efficiency by user requirements, breaks down sophisticated deep model into code block stream and incrementally executes such blocks on system-on-chip (SoC). Thus, DeepShark requires significantly less memory space on mobile device and achieves the default accuracy. In addition, all referred user data of model processing is handled locally, thus to avoid unnecessary data transfer and network latency. DeepShark is now developed on two COTS deep learning systems, i.e., Caffe and TensorFlow. The experimental evaluations demonstrate its effectiveness in the aspects of memory space and energy cost.
Keyword:
Deep learning system
flexible resource allocation
computation optimization
mobile device
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Allele-Specific HLA Loss and Immune Escape in Lung Cancer Evolution
errCell
IF0
err2017-11-01
err0
errOAAI
errNicholas McGranahan; Rachel Rosenthal; Crispin T. Hiley; Andrew J. Rowan; Thomas B.K. Watkins; Gareth A. Wilson; Nicolai J. Birkbak; Selvaraju Veeriah; Peter Van Loo; Javier Herrero; Charles Swanton; Charles Swanton; Mariam Jamal-Hanjani; Selvaraju Veeriah; Seema Shafi; Justyna Czyzewska-Khan; Diana Johnson; Joanne Laycock; Leticia Bosshard-Carter; Rachel Rosenthal; Pat Gorman; Robert E. Hynds; Gareth Wilson; Nicolai J. Birkbak; Thomas B.K. Watkins; Nicholas McGranahan; Stuart Horswell; Richard Mitter; Mickael Escudero; Aengus Stewart; Peter Van Loo; Andrew Rowan; Hang Xu; Samra Turajlic; Crispin Hiley; Christopher Abbosh; Jacki Goldman; Richard Kevin Stone; Tamara Denner; Nik Matthews; Greg Elgar; Sophia Ward; Marta Costa; Sharmin Begum; Ben Phillimore; Tim Chambers; Emma Nye; Sofia Graca; Maise Al Bakir; Kroopa Joshi; Andrew Furness; Assma Ben Aissa; Yien Ning Sophia Wong; Andy Georgiou; Sergio Quezada; John A. Hartley; Helen L. Lowe; Javier Herrero; David Lawrence; Martin Hayward; Nikolaos Panagiotopoulos; Shyam Kolvekar; Mary Falzon; Elaine Borg; Teresa Marafioti; Celia Simeon; Gemma Hector; Amy Smith; Marie Aranda; Marco Novelli; Dahmane Oukrif; Sam M. Janes; Ricky Thakrar; Martin Forster; Tanya Ahmad; Siow Ming Lee; Dionysis Papadatos-Pastos; Dawn Carnell; Ruheena Mendes; Jeremy George; Neal Navani; Asia Ahmed; Magali Taylor; Junaid Choudhary; Yvonne Summers; Raffaele Califano; Paul Taylor; Rajesh Shah; Piotr Krysiak; Kendadai Rammohan; Eustace Fontaine; Richard Booton; Matthew Evison; Phil Crosbie; Stuart Moss; Faiza Idries; Leena Joseph; Paul Bishop; Anshuman Chaturved; Anne Marie Quinn; Helen Doran; Angela Leek; Phil Harrison; Katrina Moore; Rachael Waddington; Juliette Novasio; Fiona Blackhall; Jane Rogan; Elaine Smith; Caroline Dive; Jonathan Tugwood; Ged Brady; Dominic G. Rothwell; Francesca Chemi; Jackie Pierce; Sakshi Gulati; Babu Naidu; Gerald Langman; Simon Trotter; Mary Bellamy; Hollie Bancroft; Amy Kerr; Salma Kadiri; Joanne Webb; Gary Middleton; Madava Djearaman; Dean Fennell; Jacqui A. Shaw; John Le Quesne; David Moore; Apostolos Nakas; Sridhar Rathinam; William Monteiro; Hilary Marshall; Louise Nelson; Jonathan Bennett; Joan Riley; Lindsay Primrose; Luke Martinson; Girija Anand; Sajid Khan; Anita Amadi; Marianne Nicolson; Keith Kerr; Shirley Palmer; Hardy Remmen; Joy Miller; Keith Buchan; Mahendran Chetty; Lesley Gomersall; Jason Lester; Alison Edwards; Fiona Morgan; Haydn Adams; Helen Davies; Malgorzata Kornaszewska; Richard Attanoos; Sara Lock; Azmina Verjee; Mairead MacKenzie; Maggie Wilcox; Harriet Bell; Allan Hackshaw; Yenting Ngai; Sean Smith; Nicole Gower; Christian Ottensmeier; Serena Chee; Benjamin Johnson; Aiman Alzetani; Emily Shaw; Eric Lim; Paulo De Sousa; Monica Tavares Barbosa; Alex Bowman; Simon Jordan; Alexandra Rice; Hilgardt Raubenheimer; Chiara Proli; Maria Elena Cufari; John Carlo Ronquillo; Angela Kwayie; Harshil Bhayani; Morag Hamilton; Yusura Bakar; Natalie Mensah; Lyn Ambrose; Anand Devaraj; Silviu Buderi; Jonathan Finch; Leire Azcarate; Hema Chavan; Sophie Green; Hillaria Mashinga; Andrew G. Nicholson; Kelvin Lau; Michael Sheaff; Peter Schmid; John Conibear; Veni Ezhil; Babikir Ismail; Melanie Irvin-sellers; Vineet Prakash; Peter Russell; Teresa Light; Tracey Horey; Sarah Danson; Jonathan Bury; John Edwards; Jennifer Hill; Sue Matthews; Yota Kitsanta; Kim Suvarna; Patricia Fisher; Allah Dino Keerio; Michael Shackcloth; John Gosney; Pieter Postmus; Sarah Feeney; Julius Asante-Siaw; Hugo J.W.L. Aerts; Stefan Dentro; Christophe Dessimoz
err分享
err收藏
Evaluating the temperament in shelter dogs
err2005-01-01
err0
errOAAI
errAnne B. Dufour; Emanuela Viggiano; Rupert Palme; Costanza De Palma; Eugenia Natoli; Claudio Fantini; Emanuela Barillari
err分享
err收藏
Friction Models and Friction Compensation摩擦模型与摩擦补偿
err1998-01-01
err0
PREAI
errH. Olsson; K.J. Åström; C. Canudas de Wit; M. Gäfvert; P. Lischinsky
err分享
err收藏
err分享
err收藏
学者 查看更多内容