Robotics and Computer Vision Lab

Publications

조회 수 538 댓글 0
Extra Form
저 자 Gyeongmin Choe, Jaesik Park, Yu-Wing Tai, In So Kweon
학 회 International Journal of Computer Vision (IJCV)
Notes This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (No. 2010-0028680).
논문일시(Year) 2016
논문일시(Month) 09
http://link.springer.com/article/10.1007/s11263-016-0937-y?wt_mc=Internal.Event.1.SEM.ArticleAuthorOnlineFirstWe propose a method to refine geometry of 3D meshes from a consumer level depth camera, e.g. Kinect, by exploiting shading cues captured from an infrared (IR) camera. A major benefit to using an IR camera instead of an RGB camera is that the IR images captured are narrow band images that filter out most undesired ambient light, which makes our system robust against natural indoor illumination. Moreover, for many natural objects with colorful textures in the visible spectrum, the subjects appear to have a uniform albedo in the IR spectrum. Based on our analyses on the IR projector light of the Kinect, we define a near light source IR shading model that describes the captured intensity as a function of surface normals, albedo, lighting direction, and distance between light source and surface points. To resolve the ambiguity in our model between the normals and distances, we utilize an initial 3D mesh from the Kinect fusion and multiview information to reliably estimate surface details that were not captured and reconstructed by the Kinect fusion. Our approach directly operates on the mesh model for geometry refinement. We ran experiments on our algorithm for geometries captured by both the Kinect I and Kinect II, as the depth acquisition in Kinect I is based on a structured-light technique and that of the Kinect II is based on a time-of-flight technology. The effectiveness of our approach is demonstrated through several challenging real-world examples. We have also performed a user study to evaluate the quality of the mesh models before and after our refinements.

List of Articles
565. Variational Prototyping-Encoder: One-Shot Learning with Prototypical Images
Junsik Kim, Tae-Hyun Oh, Seokju Lee, Fei Pan, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019 / 07
564. Learning Loss for Active Learning
Donggeun Yoo, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019 / 07
563. Gated Bidirectional Feature Pyramid Network for Accurate One Shot Detection
Sanghyun Woo, Soonmin Hwang, Ho-Deok Jang, In So Kweon
Machine Vision And Applications (MVA) 2019 / 1
562. High-Fidelity Depth Upsampling Using the Self-Learning Framework
Inwook Shim, Tae-Hyun Oh, In So Kweon
Sensors 2019 / 01
561. DPSNet: End-to-end Deep Plane Sweep Stereo
Sunghoon Im, Hae-Gon Jeon, Stephen Lin, In So Kweon
International Conference on Learning Representations (ICLR) 2019 / 05
560. Robust Depth Estimation using Auto-Exposure Bracketing
Sunghoon Im, Hae-Gon Jeon, In So Kweon
IEEE Transaction on Image Processing (TIP) 2018 / 12
559. Part-based Player Identification using Deep Convolutional Representation and Multi-scale Pooling
Arda Senocak, Tae-Hyun Oh, Junsik Kim, In So Kweon
Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) 2018 / 06
558. Discriminative Feature Learning for Unsupervised Video Summarization
Yunjae Jung, Donghyeon Cho, Dahun Kim, Sanghyun Woo, In So Kweon
Association for the Advancement of Artificial Intelligence (AAAI) 2019 / 01
557. Self-Supervised Video Representation Learning with Space-Time Cubic Puzzles
Dahun Kim, Donghyeon Cho, In So Kweon
Association for the Advancement of Artificial Intelligence (AAAI) 2019 / 01
556. Semi-calibrated Photometric Stereo
Donghyeon Cho, Yasuyuki Matsushita, Yu-Wing Tai, and In So Kweon
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) /
555. Deep Convolutional Neural Network for Natural Image Matting using Initial Alpha Mattes
Donghyeon Cho, Yu-Wing Tai, In So Kweon
IEEE Transactions on Image Processing (TIP), accepted /
554. LinkNet: Relational Embedding for Scene Graph
Sanghyun Woo, Dahun Kim, Donghyeon Cho, In So Kweon
Neural Information Processing Systems (NIPS) 2018 / 12
553. CBAM: Convolutional Block Attention Module
Jongchan Park, Sanghyun Woo, Joon-Young Lee, In So Kweon
European Conference on Computer Vision (ECCV) 2018 / 09
552. BAM: Bottleneck Attention Module
Jongchan Park, Sanghyun Woo, Joon-Young Lee, In So Kweon
British Machine Vision Conference (BMVC) 2018 / 09
551. Robust Low-rank Optimization with Priors
Tae-Hyun Oh
KAIST 2017 / 5
550. EPINET: A Fully-Convolutional Neural Network using Epipolar Geometry for Depth from Light Field Images
Changha Shin, Hae-Gon Jeon, Youngjin Yoon, In So Kweon, Seon Joo Kim
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018 / 06
549. Distort-and-Recover: Color Enhancement using Deep Reinforcement Learning
Jongchan Park, Joon-Young Lee, Donggeun Yoo, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018 / 06
548. Robust Depth Estimation from Auto Bracketed Images
Sunghoon Im, Hae-Gon Jeon, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018 / 06
547. Learning to Localize Sound Source in Visual Scenes
Arda Senocak, Tae-Hyun Oh, Junsik Kim, Ming-Hsuan Yang, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018 2018 / 06
546. Globally Optimal Inlier Set Maximization for Atlanta Frame Estimation
Kyungdon Joo, Tae-Hyun Oh, In So Kweon, Jean-Charles Bazin
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018 / 06
Board Pagination Prev 1 2 3 4 5 6 7 8 9 10 11 ... 35 Next
/ 35