Leveraging Pyramidal Feature Hierarchy for 3D Reconstruction

LanguageEnglish
TypeProceedings of International Conferences
AuthorsFairuz Safwan Mahad, Masakazu Iwamura, Koichi Kise
TitleLeveraging Pyramidal Feature Hierarchy for 3D Reconstruction
JournalProc. International Workshop on Frontiers of Computer Vision (IW-FCV)
Pagespp.347-362
LocationIbusuki, Japan
ReviewedReviewed
Presentation typeOral
DateFebruary 2020
Research fields3D Reconstruction
DOI10.1007/978-981-15-4818-5_26
KeyMahad2020 (id=1736)

Abstract

3D reconstruction methods with neural networks has been on a rising trend and extensive research has been done. However, they do not pay particular attention to reconstructing the detailed parts of the objects. Although the reconstructed 3D models often look complete generally, close-up observations reveal that most of them lose out on the detailed parts, which reduces the quality of the 3D model. We observe that especially fine parts of the object either fail to be reconstructed or are less dense and incomplete. This happens because the network is not designed to capture the fine details of the object. Therefore, in this paper, we propose a network which is designed to capture both the coarse and fine details of the object in an effort to improve the reconstruction of the fine parts of the object. In order to do so, we design a multi-branch deep generative network which learns the local features, generic features and also intermediate features. Utilizing these features allows the network to learn features at different levels which are able to reconstruct the fine parts as well as the overall shape of the reconstructed 3D model. We show that our method outperformed the state-of-the-art.

Files

Export this publication

Format definition
Edits apply immediately and stay in effect until you pick a style again or reset. First line is the default; add lines like "book: …" to override per type.
How to write the definition

Insert a field with braces like {authors}. A part enclosed in [ ... ] is omitted entirely when any field inside it is empty. Available fields:

{authors}{authors_and}{authors_ja}{authors_ja_tight}{authors_en}{authors_en_and}{authors_tight}{first_author}{title}{title_ja}{title_en}{journal}{journal_ja}{journal_en}{book_title}{volume}{number}{series}{presen_id}{pages}{pp}{num_pages}{year}{month}{month_en}{month_short}{ym}{date}{date_ja}{date_en}{publisher}{address}{location}{review}{review_ja}{review_en}{reviewed_mark}{presen_type}{type}{type_label}{doi}{url}{key}{awards}

← Back to list