Robotics and Computer Vision Lab

Publications

조회 수 538 댓글 0
Extra Form
저 자 Gyeongmin Choe, Jaesik Park, Yu-Wing Tai, In So Kweon
학 회 International Journal of Computer Vision (IJCV)
Notes This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (No. 2010-0028680).
논문일시(Year) 2016
논문일시(Month) 09
http://link.springer.com/article/10.1007/s11263-016-0937-y?wt_mc=Internal.Event.1.SEM.ArticleAuthorOnlineFirstWe propose a method to refine geometry of 3D meshes from a consumer level depth camera, e.g. Kinect, by exploiting shading cues captured from an infrared (IR) camera. A major benefit to using an IR camera instead of an RGB camera is that the IR images captured are narrow band images that filter out most undesired ambient light, which makes our system robust against natural indoor illumination. Moreover, for many natural objects with colorful textures in the visible spectrum, the subjects appear to have a uniform albedo in the IR spectrum. Based on our analyses on the IR projector light of the Kinect, we define a near light source IR shading model that describes the captured intensity as a function of surface normals, albedo, lighting direction, and distance between light source and surface points. To resolve the ambiguity in our model between the normals and distances, we utilize an initial 3D mesh from the Kinect fusion and multiview information to reliably estimate surface details that were not captured and reconstructed by the Kinect fusion. Our approach directly operates on the mesh model for geometry refinement. We ran experiments on our algorithm for geometries captured by both the Kinect I and Kinect II, as the depth acquisition in Kinect I is based on a structured-light technique and that of the Kinect II is based on a time-of-flight technology. The effectiveness of our approach is demonstrated through several challenging real-world examples. We have also performed a user study to evaluate the quality of the mesh models before and after our refinements.

List of Articles
99. Local deformation calibration for autostereoscopic 3D display
Hyoseok Hwang, Hyun Sung Chang, In So Kweon
OSA Optics Express 2017 / 05
98. Multi-Image Deblurring using Complementary Sets of Fluttering Patterns
Hae-Gon Jeon, Joon-Young Lee, Yudeog Han, Seon Joo Kim, In So Kweon
IEEE Transactions on Image Processing 2017 / 05
97. Light Field Image Super-Resolution using Convolutional Neural Network
Youngjin Yoon, Hae-Gon Jeon, Donggeun Yoo, Joon-Young Lee, In So Kweon
IEEE Signal Processing Letters 2017 / 02
96. Structure-From-Motion in 3D Space Using 2D Lidars
Dong-Geol Choi, Yunsu Bok, Jun-sik Kim, Inwook Shim, In So Kweon
Sensors 2017 / 02
95. 3D Display Calibration by Visual Pattern Analysis
Hyoseok Hwang, Hyun Sung Chang, Dongkyung Nam, In So Kweon
IEEE Transactions on Image Processing (TIP), accepted 2017 / 02
94. Robot System of DRC‐HUBO+ and Control Strategy of Team KAIST in DARPA Robotics Challenge Finals
Jeongsoo Lim, Inho Lee, Inwook Shim, Hyobin Jung, Hyun Min Joe, Hyoin Bae, Okkee Sim, Jaesung Oh, Taejin Jung, Seunghak Shin, Kyungdon Joo, Mingeuk Kim, Kangkyu Lee, Yunsu Bok, Dong-Geol Choi, Buyoun Cho, Sungwoo Kim, Jungwoo Heo, Inhyeok Kim, Jungho Lee, In So Kweon, Jun‐Ho Oh
Journal of Field Robotics 2016 / 09
93. Generating Fluttering Pattern with Low Autocorrelation for Coded Exposure Imaging
Hae-Gon Jeon, Joon-Young Lee, Yudeog Han, Seon Joo Kim, In So Kweon
International Journal of Computer Vision (IJCV) 2017 / 06
92. Fast Randomized Singular Value Thresholding for Low-Rank Optimization
Tae-Hyun Oh, Yasuyuki Matsushita, Yu-Wing Tai, In So Kweon
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2017 / 03
91. Category-specific Salient View Selection via Deep Convolutional Neural Networks
Seong-Heum Kim, Yu-Wing Tai, Joon-Young Lee, Jaesik Park, In So Kweon
Computer Graphics Forum (invited to Eurographics 2017) 2017 / 04
90. Robust Multiview Photometric Stereo using Planar Mesh Parameterization
Jaesik Park, Sudipta N. Sinha, Yasuyuki Matsushita, Yu-Wing Tai, In So Kweon
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2016 / 08
89. Automatic Trimap Generation and Consistent Matting for Light-Field Images
Donghyeon Cho, Sunyeong Kim, Yu-Wing Tai, In So Kweon
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2016 2016 / 08
88. A Real-time Augmented Reality System to See-Through Cars
Francois Rameau, Hyowon Ha, Kyungdon Joo, Jinsoo Choi, Kibaek Park, In So Kweon
IEEE Transactions on Visualization and Computer Graphics (TVCG) 2016 / 09
» Refining Geometry from Depth Sensors using IR Shading Images
Gyeongmin Choe, Jaesik Park, Yu-Wing Tai, In So Kweon
International Journal of Computer Vision (IJCV) 2016 / 09
86. Multi-view Object Extraction with Fractional Boundaries
Seong-Heum Kim, Yu-Wing Tai, Jaesik Park, In So Kweon
IEEE Transactions on Image Processing 2016 / 08
85. Geometric Calibration of Micro-Lens-Based Light Field Cameras using Line Features
Yunsu Bok, Hae-Gon Jeon, In So Kweon
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2017 / 02
84. Ambiguous Surface Defect Image Classification of AMOLED Displays in Smartphones
Yunwon Park, In So Kweon
IEEE Transactions on Industrial Informatics, (Accepted) 2016 / 01
83. Extrinsic calibration of a camera and a 2D laser without overlap
Yunsu Bok, Dong-Geol Choi, In So Kweon
Robotics and Autonomous Systems (RAS) 2016 / 04
82. Automated checkerboard detection and indexing using circular boundaries
Yunsu Bok, Hyowon Ha, In So Kweon
Pattern Recognition Letters (PRL) 2016 / 02
81. New Design Criteria for Robust PCA and a Compliant Bayesian-Inspired Algorithm
Tae-Hyun Oh, David Wipf, Yasuyuki Matsushita, In So Kweon
Tech. Report on arXiv 2015 / 12
80. Extrinsic Calibration of 2D Lidars using Two Orthogonal Planes
Dong-Geol Choi, Yunsu Bok, Jun-sik Kim, In So Kweon
IEEE Transactions on Robotics (T-RO) 2016 / 02
Board Pagination Prev 1 2 3 4 5 6 7 Next
/ 7