Robotics and Computer Vision Lab

Publications

International Journal
2016.08.05 16:08

Refining Geometry from Depth Sensors using IR Shading Images

조회 수 425 댓글 0
Extra Form
저 자 Gyeongmin Choe, Jaesik Park, Yu-Wing Tai, In So Kweon
학 회 International Journal of Computer Vision (IJCV)
Notes This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (No. 2010-0028680).
논문일시(Year) 2016
논문일시(Month) 09
http://link.springer.com/article/10.1007/s11263-016-0937-y?wt_mc=Internal.Event.1.SEM.ArticleAuthorOnlineFirstWe propose a method to refine geometry of 3D meshes from a consumer level depth camera, e.g. Kinect, by exploiting shading cues captured from an infrared (IR) camera. A major benefit to using an IR camera instead of an RGB camera is that the IR images captured are narrow band images that filter out most undesired ambient light, which makes our system robust against natural indoor illumination. Moreover, for many natural objects with colorful textures in the visible spectrum, the subjects appear to have a uniform albedo in the IR spectrum. Based on our analyses on the IR projector light of the Kinect, we define a near light source IR shading model that describes the captured intensity as a function of surface normals, albedo, lighting direction, and distance between light source and surface points. To resolve the ambiguity in our model between the normals and distances, we utilize an initial 3D mesh from the Kinect fusion and multiview information to reliably estimate surface details that were not captured and reconstructed by the Kinect fusion. Our approach directly operates on the mesh model for geometry refinement. We ran experiments on our algorithm for geometries captured by both the Kinect I and Kinect II, as the depth acquisition in Kinect I is based on a structured-light technique and that of the Kinect II is based on a time-of-flight technology. The effectiveness of our approach is demonstrated through several challenging real-world examples. We have also performed a user study to evaluate the quality of the mesh models before and after our refinements.

List of Articles
499. A Real-time Augmented Reality System to See-Through Cars
Francois Rameau, Hyowon Ha, Kyungdon Joo, Jinsoo Choi, Kibaek Park, In So Kweon
IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2016 / 09
498. Pixel-Level Domain Transfer
Donggeun Yoo, Namil Kim, Sunggyun Park, Anthony S. Paek, In So Kweon
European Conference on Computer Vision (ECCV) 2016 / 10
497. A Pseudo-Bayesian Algorithm for Robust PCA
Tae-Hyun Oh, Yasuyuki Matsushita, In So Kweon, David Wipf
Neural Information Processing Systems (NIPS) 2016 / 12
» Refining Geometry from Depth Sensors using IR Shading Images
Gyeongmin Choe, Jaesik Park, Yu-Wing Tai, In So Kweon
International Journal of Computer Vision (IJCV) 2016 / 09
495. Natural Image Matting using Deep Convolutional Neural Networks
Donghyeon Cho, Yu-Wing Tai, In So Kweon
European Conference on Computer Vision (ECCV), 2016 2016 / 10
494. Photometric Stereo under Non-uniform Light Intensities and Exposures
Donghyeon Cho, Yasuyuki Matsushita, Yu-Wing Tai, In So Kweon
European Conference on Computer Vision (ECCV), 2016 2016 / 10
493. Fine-scale Surface Normal Estimation using a Single NIR Image
Youngjin Yoon, Gyeongmin Choe, Namil Kim, Joon-Young Lee, In So Kweon
European Conference on Computer Vision (ECCV) , October 2016 2016 / 10
492. All-around Depth from Small Motion with A Spherical Panoramic Camera
Sunghoon Im, Hyowon Ha, Francois Rameau, Hae-Gon Jeon, Gyeongmin Choe, In So Kweon
European Conference on Computer Vision (ECCV) 2016 / 10
491. Human Body Part Classification from Optical Flow
Junsik Kim, Kyungdon Joo, Tae-Hyun Oh, In So Kweon
The International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2016 / 08
490. Asymmetric Stereo with Catadioptric Lens: High Quality Image Generation for Intelligent Robot
Donghyeon Cho, Jinsun Park, Yu-Wing Tai, In So Kweon
The International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2016 / 08
489. Sentence Learning on Deep Convolutional Networks for Image Caption Generation
Dong-Jin Kim, Donggeun Yoo, Bonggeun Sim, In So Kweon
The International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2016 / 08
488. EureCar Turbo: a Self-Driving Car that can Handle Adverse Weather Conditions
Unghui Lee, Jiwon Jung, Seunghak Shin, Yongseop Jeong, Kibaek Park, David Hyunchul Shim, In So Kweon
The International Conference of Intelligent Robots and Systems (IROS) 2016 / 10
487. Object Proposal Using 3D Point Cloud for DRC-HUBO+
Seunghak Shin, Inwook Shim, Jiyoung Jung, Yunsu Bok, Jun-Ho Oh, In So Kweon
The International Conference of Intelligent Robots and Systems (IROS) 2016 / 10
486. Fast Multiple Objects Detection and Tracking Fusing Color Camera and 3D LIDAR for Intelligent Vehicles
Soonmin Hwang, Namil Kim, Yukyung Choi, Seokju Lee, In So Kweon
The International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2016 / 08
1
485. Thermal Image Enhancement using Convolution Neural Network
Yukyung Choi, Namil Kim, Soonmin Hwang, In So Kweon
The International Conference of Intelligent Robots and Systems (IROS) 2016 / 10
484. Thermal-Infrared based Drivable Region Detection
Jae Shin Yoon, Kibaek Park, Soonmin Hwang, Namil Kim, Yukyung Choi, Francois Rameau, In So Kweon
IEEE Intelligent Vehicles Symposium (IV) 2016 / 06
483. Multi-view Object Extraction with Fractional Boundaries
Seong-Heum Kim, Yu-Wing Tai, Jaesik Park, In So Kweon
IEEE Transactions on Image Processing 2016 / 08
482. Vision system and depth processing for DRC-HUBO+
Inwook Shim, Seunghak Shin, Yunsu Bok, Kyungdon Joo, Dong-Geol Choi, Joon-Young Lee, Jaesik Park, Jun-Ho Oh, In So Kweon
IEEE International Conference on Robotics and Automation(ICRA) 2016 / 05
481. Efficient and Robust Color Consistency for Community Photo Collections
Jaesik Park, Yu-Wing Tai, Sudipta N. Sinha, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016 / 06
480. Globally Optimal Manhattan Frame Estimation in Real-time
Kyungdon Joo, Tae-Hyun Oh, Junsik Kim, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016 / 06
Board Pagination Prev 1 2 3 4 5 6 7 8 9 10 ... 30 Next
/ 30