arrow
Return

CNNs Based Viewpoint Estimation for Volume Visualization

delete2019-04-12
delete19
delete
OA
AI
N
Neng Shi
Y
Yubo Tao *
DOI:10.1145/3309993delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Viewpoint estimation from 2D rendered images is helpful in understanding how users select viewpoints for volume visualization and guiding users to select better viewpoints based on previous visualizations. In this article, we propose a viewpoint estimation method based on Convolutional Neural Networks (CNNs) for volume visualization. We first design an overfit-resistant image rendering pipeline to generate the training images with accurate viewpoint annotations, and then train a category-specific viewpoint classification network to estimate the viewpoint for the given rendered image. Our method can achieve good performance on images rendered with different transfer functions and rendering parameters in several categories. We apply our model to recover the viewpoints of the rendered images in publications, and show how experts look at volumes. We also introduce a CNN feature-based image similarity measure for similarity voting based viewpoint selection, which can suggest semantically meaningful optimal viewpoints for different volumes and transfer functions.
Keywords:
Viewpoint estimation
convolutional neural networks
volume visualization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Transactions on Intelligent Systems and Technology cover
ACM Transactions on Intelligent Systems and Technology
IF:
6.6
Papers:
1.5K
Citations:
6.2K

Organization

Z
zhejiang university
Scholars:
17.7W
Papers: 12.1W
Citations: 152
Cited Papers

Cited Papers

Concept and Attention-Based CNN for Question Retrieval in Multi-View Learning
err2018-01-31
err22
PREAI
errWang, Pengwei; Ji, Lei; Yan, Jun; Dou, Dejing; De Silva, Nisansa; Zhang, Yong; Jin, Lianwen
errShare
errSave
Allele-Specific HLA Loss and Immune Escape in Lung Cancer Evolution
errCell
IF0
err2017-11-01
err0
errOAAI
errNicholas McGranahan; Rachel Rosenthal; Crispin T. Hiley; Andrew J. Rowan; Thomas B.K. Watkins; Gareth A. Wilson; Nicolai J. Birkbak; Selvaraju Veeriah; Peter Van Loo; Javier Herrero; Charles Swanton; Charles Swanton; Mariam Jamal-Hanjani; Selvaraju Veeriah; Seema Shafi; Justyna Czyzewska-Khan; Diana Johnson; Joanne Laycock; Leticia Bosshard-Carter; Rachel Rosenthal; Pat Gorman; Robert E. Hynds; Gareth Wilson; Nicolai J. Birkbak; Thomas B.K. Watkins; Nicholas McGranahan; Stuart Horswell; Richard Mitter; Mickael Escudero; Aengus Stewart; Peter Van Loo; Andrew Rowan; Hang Xu; Samra Turajlic; Crispin Hiley; Christopher Abbosh; Jacki Goldman; Richard Kevin Stone; Tamara Denner; Nik Matthews; Greg Elgar; Sophia Ward; Marta Costa; Sharmin Begum; Ben Phillimore; Tim Chambers; Emma Nye; Sofia Graca; Maise Al Bakir; Kroopa Joshi; Andrew Furness; Assma Ben Aissa; Yien Ning Sophia Wong; Andy Georgiou; Sergio Quezada; John A. Hartley; Helen L. Lowe; Javier Herrero; David Lawrence; Martin Hayward; Nikolaos Panagiotopoulos; Shyam Kolvekar; Mary Falzon; Elaine Borg; Teresa Marafioti; Celia Simeon; Gemma Hector; Amy Smith; Marie Aranda; Marco Novelli; Dahmane Oukrif; Sam M. Janes; Ricky Thakrar; Martin Forster; Tanya Ahmad; Siow Ming Lee; Dionysis Papadatos-Pastos; Dawn Carnell; Ruheena Mendes; Jeremy George; Neal Navani; Asia Ahmed; Magali Taylor; Junaid Choudhary; Yvonne Summers; Raffaele Califano; Paul Taylor; Rajesh Shah; Piotr Krysiak; Kendadai Rammohan; Eustace Fontaine; Richard Booton; Matthew Evison; Phil Crosbie; Stuart Moss; Faiza Idries; Leena Joseph; Paul Bishop; Anshuman Chaturved; Anne Marie Quinn; Helen Doran; Angela Leek; Phil Harrison; Katrina Moore; Rachael Waddington; Juliette Novasio; Fiona Blackhall; Jane Rogan; Elaine Smith; Caroline Dive; Jonathan Tugwood; Ged Brady; Dominic G. Rothwell; Francesca Chemi; Jackie Pierce; Sakshi Gulati; Babu Naidu; Gerald Langman; Simon Trotter; Mary Bellamy; Hollie Bancroft; Amy Kerr; Salma Kadiri; Joanne Webb; Gary Middleton; Madava Djearaman; Dean Fennell; Jacqui A. Shaw; John Le Quesne; David Moore; Apostolos Nakas; Sridhar Rathinam; William Monteiro; Hilary Marshall; Louise Nelson; Jonathan Bennett; Joan Riley; Lindsay Primrose; Luke Martinson; Girija Anand; Sajid Khan; Anita Amadi; Marianne Nicolson; Keith Kerr; Shirley Palmer; Hardy Remmen; Joy Miller; Keith Buchan; Mahendran Chetty; Lesley Gomersall; Jason Lester; Alison Edwards; Fiona Morgan; Haydn Adams; Helen Davies; Malgorzata Kornaszewska; Richard Attanoos; Sara Lock; Azmina Verjee; Mairead MacKenzie; Maggie Wilcox; Harriet Bell; Allan Hackshaw; Yenting Ngai; Sean Smith; Nicole Gower; Christian Ottensmeier; Serena Chee; Benjamin Johnson; Aiman Alzetani; Emily Shaw; Eric Lim; Paulo De Sousa; Monica Tavares Barbosa; Alex Bowman; Simon Jordan; Alexandra Rice; Hilgardt Raubenheimer; Chiara Proli; Maria Elena Cufari; John Carlo Ronquillo; Angela Kwayie; Harshil Bhayani; Morag Hamilton; Yusura Bakar; Natalie Mensah; Lyn Ambrose; Anand Devaraj; Silviu Buderi; Jonathan Finch; Leire Azcarate; Hema Chavan; Sophie Green; Hillaria Mashinga; Andrew G. Nicholson; Kelvin Lau; Michael Sheaff; Peter Schmid; John Conibear; Veni Ezhil; Babikir Ismail; Melanie Irvin-sellers; Vineet Prakash; Peter Russell; Teresa Light; Tracey Horey; Sarah Danson; Jonathan Bury; John Edwards; Jennifer Hill; Sue Matthews; Yota Kitsanta; Kim Suvarna; Patricia Fisher; Allah Dino Keerio; Michael Shackcloth; John Gosney; Pieter Postmus; Sarah Feeney; Julius Asante-Siaw; Hugo J.W.L. Aerts; Stefan Dentro; Christophe Dessimoz
errShare
errSave
errShare
errSave
Antiferromagnetic ruthenium(III)
err2002-05-01
err0
PREAI
errRichard L. Carlin; Ramon Burriel; Kenneth R. Seddon; Russell I. Crisp
errShare
errSave
Rural-Urban Contraceptive Use in Uganda: Evidence from UDHS 2011
err2017-10-24
err0
PREAI
errBigala Paul; Adebowale Stephen Ayo; Natal Ayiga
errShare
errSave
researcher View more