Robotics and Computer Vision Lab

Publications

조회 수 538 댓글 0
Extra Form
저 자 Gyeongmin Choe, Jaesik Park, Yu-Wing Tai, In So Kweon
학 회 International Journal of Computer Vision (IJCV)
Notes This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (No. 2010-0028680).
논문일시(Year) 2016
논문일시(Month) 09
http://link.springer.com/article/10.1007/s11263-016-0937-y?wt_mc=Internal.Event.1.SEM.ArticleAuthorOnlineFirstWe propose a method to refine geometry of 3D meshes from a consumer level depth camera, e.g. Kinect, by exploiting shading cues captured from an infrared (IR) camera. A major benefit to using an IR camera instead of an RGB camera is that the IR images captured are narrow band images that filter out most undesired ambient light, which makes our system robust against natural indoor illumination. Moreover, for many natural objects with colorful textures in the visible spectrum, the subjects appear to have a uniform albedo in the IR spectrum. Based on our analyses on the IR projector light of the Kinect, we define a near light source IR shading model that describes the captured intensity as a function of surface normals, albedo, lighting direction, and distance between light source and surface points. To resolve the ambiguity in our model between the normals and distances, we utilize an initial 3D mesh from the Kinect fusion and multiview information to reliably estimate surface details that were not captured and reconstructed by the Kinect fusion. Our approach directly operates on the mesh model for geometry refinement. We ran experiments on our algorithm for geometries captured by both the Kinect I and Kinect II, as the depth acquisition in Kinect I is based on a structured-light technique and that of the Kinect II is based on a time-of-flight technology. The effectiveness of our approach is demonstrated through several challenging real-world examples. We have also performed a user study to evaluate the quality of the mesh models before and after our refinements.

List of Articles
645. Per-Clip Video Object Segmentation
Kwanyong Park, Sanghyun Woo, Seoung Wug Oh, In So Kweon, Joon-Young Lee
Computer Vision and Pattern Recognition, CVPR 2022 / 03
644. MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentation
Inkyu Shin, Yi-Hsuan Tsai, Samuel Schulter, Bingbing Zhuang, Buyu Liu, Sparsh Garg, In So Kweon, Kuk-Jin Yoon
Computer Vision and Pattern Recognition, CVPR 2022 / 03
643. Restoration of Video Frames from a Single Blurred Image with Motion Understanding
Dawit Mureja Argaw, Junsik Kim, Francois Rameau, Chaoning Zhang, In So Kweon
Computer Vision and Pattern Recognition Workshop, CVPRW 2022 / 03
642. Long-term Video Frame Interpolation via Feature Propagation
Dawit Mureja Argaw, In So Kweon
Computer Vision and Pattern Recognition, CVPR 2022 / 03
641. UDA-COPE: Unsupervised Domain Adaptation for Category-level Object Pose Estimation
Taeyeop Lee, Byeong-Uk Lee, Inkyu Shin, Jaesung Choe, Ukcheol Shin, In So Kweon, Kuk-Jin Yoon
Computer Vision and Pattern Recognition, CVPR 2022 / 03
640. Adaptive Cost Volume Fusion Network for Multi-Modal Depth Estimation in Changing Environments
Jinsun Park, Yongseop Jeong, Kyungdon Joo, Donghyeon Cho, and In So Kweon
IEEE Robotics and Automation Letters 2022 / 2
639. MC-Calib: A generic and robust calibration toolbox for multi-camera systems
Francois Rameau, Jinsun Park, Oleksandr Bailo, In So Kweon
Computer Vision and Image Understanding 2022 / 1
638. Real-Time Multi-Car Localization and See-Through System
Francois Rameau, Oleksandr Bailo, Jinsun Park, Kyungdon Joo, In So Kweon
International Journal of Computer Vision 2022 / 1
637. MCDAL: Maximum Classifier Discrepancy for Active Learning
Jae Won Cho*, Dong-Jin Kim*, Yunjae Jung, In So Kweon (*Equal Contribution)
IEEE Transactions on Neural Networks and Learning Systems (TNNLS) 2022 / 02
636. Learning Sound Localization Better from Semantically Similar Samples
Arda Senocak*, Hyeonggon Ryu*, Junsik Kim*, In So Kweon
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2022 / 5
635. PointRecon: Deep Point Cloud Reconstruction
Jaesung Choe*, Byeonin Joung*, Francois Rameau, Jaesik Park, and In So Kweon
International Conference on Learning Representations (ICLR) 2022/04 /
634. Single-Modal Entropy based Active Learning for Visual Question Answering
Dong-Jin Kim*, Jae Won Cho*, Jinsoo Choi, Yunjae Jung, In So Kweon (*Equal Contribution)
British Machine Vision Conference (BMVC) 2021 / 11
633. Lane Detection Aided Online Dead Reckoning for GNSS Denied Environments
Jinhwan Jeon, Yoonjin Hwang, Yongseop Jeong, Sangdon Park, In So Kweon and Seibum B. Choi
Sensors 2021 / 10
632. Less Can Be More: Sound Source Localization With a Classification Model
Arda Senocak*, Hyeonggon Ryu*, Junsik Kim*, In So Kweon
IEEE Winter Conference on Applications of Computer Vision (WACV) 2022 / 1
631. Batch Normalization Increases Adversarial Vulnerability and Decreases Adversarial Transferability: A Non-Robust Feature Perspective
Philipp Benz*, Chaoning Zhang*, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2021 / 10
630. Data-Free Universal Adversarial Perturbation and Black-Box Attack
Chaoning Zhang*, Philipp Benz*, Adil Karjauv*, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2021 / 10
629. Online Misalignment Estimation of Strapdown Navigation for Land Vehicle Under Dynamic Condition
Yoonjin Hwang, Yongseop Jeong, In So Kweon, Seibum Choi
International Journal of Automotive Technology 2021 / 12
628. Dense Relational Image Captioning via Multi-task Triple-Stream Networks
Dong-Jin Kim, Tae-Hyun Oh, Jinsoo Choi, and In So Kweon
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2021 / 09
627. ACP++: Action Co-occurrence Priors for Human-Object Interaction Detection
Dong-Jin Kim, Xiao Sun, Jinsoo Choi, Stephen Lin, and In So Kweon
IEEE Transactions on Image Processing (TIP) 2021 / 08
626. Category-Level Metric Scale Object Shape and Pose Estimation
Taeyeop Lee, Byeong-Uk Lee, Myungchul Kim, In So Kweon
IEEE Robotics and Automation Letters (RA-L) 2021 / 08
Board Pagination Prev 1 2 3 4 5 6 7 8 9 10 ... 35 Next
/ 35