Robotics and Computer Vision Lab

Publications

조회 수 778 댓글 0
Extra Form
저 자 Seong-Heum Kim, Yu-Wing Tai, Joon-Young Lee, Jaesik Park, In So Kweon
학 회 Computer Graphics Forum (invited to Eurographics 2017)
Notes This work was supported by Institute for Information & communications Technology Promotion(IITP) grant funded by the Korea government(MSIP) and Korea Creative Content Agency(KOCCA) grant funded by the Korea government(MCST) (R0132-15-1006, Developing the technology of open composable content editors for realistic media).
논문일시(Year) 2017
논문일시(Month) 04
In this paper, we present a new framework to determine up front orientations and detect salient views of 3D models. The salient viewpoint to human preferences is the most informative projection with correct upright orientation. Our method utilizes two Convolutional Neural Network (CNN) architectures to encode category-specific information learnt from a large number of 3D shapes and 2D images on the web. Using the first CNN model with 3D voxel data, we generate a CNN shape feature to decide natural upright orientation of 3D objects. Once a 3D model is upright-aligned, the front projection and salient views are scored by category recognition using the second CNN model. The second CNN is trained over popular photo collections from internet users. In order to model comfortable viewing angles of 3D models, a category dependent prior is also learnt from the users. Our approach effectively combines category-specific scores and classical evaluations to produce a data-driven viewpoint saliency map. The best viewpoints from the method are quantitatively and qualitatively validated with more than 100 objects from 20 categories. Our thumbnail images of 3D models are the most favored among those from different approaches.

List of Articles
519. Local deformation calibration for autostereoscopic 3D display
Hyoseok Hwang, Hyun Sung Chang, In So Kweon
OSA Optics Express 2017 / 05
518. A Unified Approach of Multi-scale Deep and Hand-crafted Features for Defocus Estimation
Jinsun Park, Yu-Wing Tai, Donghyeon Cho, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017 / 07
517. Multi-Image Deblurring using Complementary Sets of Fluttering Patterns
Hae-Gon Jeon, Joon-Young Lee, Yudeog Han, Seon Joo Kim, In So Kweon
IEEE Transactions on Image Processing 2017 / 05
516. Light Field Image Super-Resolution using Convolutional Neural Network
Youngjin Yoon, Hae-Gon Jeon, Donggeun Yoo, Joon-Young Lee, In So Kweon
IEEE Signal Processing Letters 2017 / 02
515. Structure-From-Motion in 3D Space Using 2D Lidars
Dong-Geol Choi, Yunsu Bok, Jun-sik Kim, Inwook Shim, In So Kweon
Sensors 2017 / 02
514. Deep Representation of Industrial Components using Simulated Images
Seong-Heum Kim, Gyeongmin Choe, Byungtae Ahn, In So Kweon
IEEE International Conference on Robotics and Automation (ICRA) 2017 / 05
513. 3D Display Calibration by Visual Pattern Analysis
Hyoseok Hwang, Hyun Sung Chang, Dongkyung Nam, In So Kweon
IEEE Transactions on Image Processing (TIP), accepted 2017 / 02
512. Single Image Depth Estimation using Convolutional Neural Networks with NCC-based Loss
Jinsun Park, In So Kweon
International Workshop on Frontiers of Computer Vision (FCV) 2017 / 02
511. Robust Road Marking Detection and Recognition Using Density-Based Grouping and Machine Learning Techniques
Oleksandr Bailo, Seokju Lee, Francois Rameau, Jae Shin Yoon, In So Kweon
Winter Conference of Applications on Computer Vision (WACV) 2017 / 03
510. Robot System of DRC‐HUBO+ and Control Strategy of Team KAIST in DARPA Robotics Challenge Finals
Jeongsoo Lim, Inho Lee, Inwook Shim, Hyobin Jung, Hyun Min Joe, Hyoin Bae, Okkee Sim, Jaesung Oh, Taejin Jung, Seunghak Shin, Kyungdon Joo, Mingeuk Kim, Kangkyu Lee, Yunsu Bok, Dong-Geol Choi, Buyoun Cho, Sungwoo Kim, Jungwoo Heo, Inhyeok Kim, Jungho Lee, In So Kweon, Jun‐Ho Oh
Journal of Field Robotics 2016 / 09
509. Control strategies for a humanoid robot to drive and then egress a utility vehicle for remote approach
Hyobin Jeong, Jaesung Oh, Mingeuk Kim, Kyungdon Joo, In So Kweon, Jun-Ho Oh
IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids) 2015 / 11
508. 다시점 객체 공분할을 이용한 2D-3D 물체 자세 추정
Seong-Heum Kim, Yunsu Bok, In So Kweon
한국로봇공학회 2017 / 02
507. 객체화 접근을 통한 3D 모델 검색 인터페이스
Seong-Heum Kim, In So Kweon
제 11 회 한국로봇종합학술대회 2016 / 01
506. Generating Fluttering Pattern with Low Autocorrelation for Coded Exposure Imaging
Hae-Gon Jeon, Joon-Young Lee, Yudeog Han, Seon Joo Kim, In So Kweon
International Journal of Computer Vision (IJCV) 2017 / 06
505. Fast Randomized Singular Value Thresholding for Low-Rank Optimization
Tae-Hyun Oh, Yasuyuki Matsushita, Yu-Wing Tai, In So Kweon
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2017 / 03
» Category-specific Salient View Selection via Deep Convolutional Neural Networks
Seong-Heum Kim, Yu-Wing Tai, Joon-Young Lee, Jaesik Park, In So Kweon
Computer Graphics Forum (invited to Eurographics 2017) 2017 / 04
503. Robust Multiview Photometric Stereo using Planar Mesh Parameterization
Jaesik Park, Sudipta N. Sinha, Yasuyuki Matsushita, Yu-Wing Tai, In So Kweon
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2016 / 08
502. Automatic Trimap Generation and Consistent Matting for Light-Field Images
Donghyeon Cho, Sunyeong Kim, Yu-Wing Tai, In So Kweon
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2016 2016 / 08
501. A Real-time Vehicular Vision System to Seamlessly See-through Cars
Francois Rameau, Hyowon Ha, Kyungdon Joo, Jinsoo Choi, In So Kweon
European Conference on Computer Vision Workshops (ECCVW - ACVR) 2016 / 10
500. A Real-time Augmented Reality System to See-Through Cars
Francois Rameau, Hyowon Ha, Kyungdon Joo, Jinsoo Choi, Kibaek Park, In So Kweon
IEEE Transactions on Visualization and Computer Graphics (TVCG) 2016 / 09
Board Pagination Prev 1 2 3 4 5 6 7 8 9 10 ... 30 Next
/ 30