Robotics and Computer Vision Laboratory Login  
  Robotics and Computer Vision Laboratory kaist logo
Archive Courses

Home  >  Research  >  Publications

[International Journal] Category-specific Salient View Selection via Deep Convolutional Neural Networks
Computer Graphics Forum (invited to Eurographics 2017) , April 2017
  Kim_et_al-2017-Computer_Graphics_Forum.pdf Kim_et_al-2017-Computer_Graphics_Forum.pdf (13.5M) [88]
In this paper, we present a new framework to determine up front orientations and detect salient views of 3D models. The salient viewpoint to human preferences is the most informative projection with correct upright orientation. Our method utilizes two Convolutional Neural Network (CNN) architectures to encode category-specific information learnt from a large number of 3D shapes and 2D images on the web. Using the first CNN model with 3D voxel data, we generate a CNN shape feature to decide natural upright orientation of 3D objects. Once a 3D model is upright-aligned, the front projection and salient views are scored by category recognition using the second CNN model. The second CNN is trained over popular photo collections from internet users. In order to model comfortable viewing angles of 3D models, a category dependent prior is also learnt from the users. Our approach effectively combines category-specific scores and classical evaluations to produce a data-driven viewpoint saliency map. The best viewpoints from the method are quantitatively and qualitatively validated with more than 100 objects from 20 categories. Our thumbnail images of 3D models are the most favored among those from different approaches.
This work was supported by Institute for Information \& communications Technology Promotion(IITP) grant funded by the Korea government(MSIP) and Korea Creative Content Agency(KOCCA) grant funded by the Korea government(MCST) (R0132-15-1006, Developing the technology of open composable content editors for realistic media).


Robotics and Computer Vision Laboratory
KAIST | Electrical Engineering | Contact Us | Sitemap