arrow
Return

Deep 3D semantic scene extrapolation

delete2018-08-17
delete11
delete
OA
AI
A
Ali Abbasi *
S
Sinan Kalkan
Y
Yusuf Sahillioğlu
DOI:10.1007/s00371-018-1586-7delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Scene extrapolation is a challenging variant of the scene completion problem, which pertains to predicting the missing part(s) of a scene. While the 3D scene completion algorithms in the literature try to fill the occluded part of a scene such as a chair behind a table, we focus on extrapolating the available half-scene information to a full one, a problem that, to our knowledge, has not been studied yet. Our approaches are based on convolutional neural networks (CNN). As input, we take the half of 3D voxelized scenes, then our models complete the other half of scenes as output. Our baseline CNN model consisting of convolutional and ReLU layers with multiple residual connections and Softmax classifier with voxel-wise cross-entropy loss function at the end. We train and evaluate our models on the synthetic 3D SUNCG dataset. We show that our trained networks can predict the other half of the scenes and complete the objects correctly with suitable lengths. With a discussion on the challenges, we propose scene extrapolation as a challenging test bed for future research in deep learning. We made our models available on https://github.com/aliabbasi/d3dsse.
Keywords:
3D scenes
Extrapolation
Convolutional neural networks
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Visual Computer cover
Visual Computer
IF:
2.9
Papers:
4.6K
Citations:
6.5K

Organization

M
Middle East Technical University
Scholars:
7.4K
Papers: 6.7K
Citations: 6.3K
Cited Papers

Cited Papers

Mechanical properties of the macaw palm fruit-rachilla system1
err2017-06-01
err0
errOAAI
errNara Silveira Velloso; Fábio Lúcio Santos; Francisco de Assis de Carvalho Pinto; Flora Maria de Melo Villar; Domingos Sárvio Magalhães Valente
errShare
errSave
Subversion of Autophagy in Adherent Invasive Escherichia coli-Infected Neutrophils Induces Inflammation and Cell Death
err2012-12-14
err0
errOAAI
errAbderrahman Chargui; Annabelle Cesaro; Sanda Mimouna; Mohamed Fareh; Patrick Brest; Philippe Naquet; Arlette Darfeuille-Michaud; Xavier Hébuterne; Baharia Mograbi; Valérie Vouret-Craviari; Paul Hofman
errShare
errSave
Genetic variants in lncRNA SRA and risk of breast cancer
err2016-03-08
err0
errOAAI
errRui Yan; Kaijuan Wang; Rui Peng; Shuaibing Wang; Jingjing Cao; Peng Wang; Chunhua Song
errShare
errSave
errShare
errSave
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
errShare
errSave
Synthesizing Obama: Learning Lip Sync from Audio
err2017-07-20
err665
PREAI
errSuwajanakorn, Supasorn; Seitz, Steven M.; Kemelmacher-Shlizerman, Ira
errShare
errSave
Molecular Basis of Filamin A-FilGAP Interaction and Its Impairment in Congenital Disorders Associated with Filamin A Mutations
err2009-03-18
err0
errOAAI
errFumihiko Nakamura; Outi Heikkinen; Olli T. Pentikäinen; Teresia M. Osborn; Karen E. Kasza; David A. Weitz; Olga Kupiainen; Perttu Permi; Ilkka Kilpeläinen; Jari Ylänne; John H. Hartwig; Thomas P. Stossel
errShare
errSave
Icosahedral Carboranes
err2016-01-01
err0
PREAI
errRussell N. Grimes
errShare
errSave
researcher View more