Robotics and Computer Vision Lab

Publications

International Conference
2020.07.03 13:52

Non-Local Spatial Propagation Network for Depth Completion

조회 수 54 댓글 0
Extra Form
저 자 Jinsun Park, Kyungdon Joo, Zhe Hu, Chi-Kuei Liu, In So Kweon
학 회 European Conference on Computer Vision (ECCV)
논문일시(Year) 2020
논문일시(Month) 08

In this paper, we propose a robust and efficient end-to-end non-local spatial propagation network for depth completion. The proposed network takes RGB and sparse depth images as inputs and estimates non-local neighbors and their affinities of each pixel, as well as an initial depth map with pixel-wise confidences. The initial depth prediction is then iteratively refined by its confidence and non-local spatial propagation procedure based on the predicted non-local neighbors and corresponding affinities. Unlike previous algorithms that utilize fixed-local neighbors, the proposed algorithm effectively avoids irrelevant local neighbors and concentrates on relevant non-local neighbors during propagation. In addition, we introduce a learnable affinity normalization to better learn the affinity combinations compared to conventional methods. The proposed algorithm is inherently robust to the mixed-depth problem on depth boundaries, which is one of the major issues for existing depth estimation/completion algorithms. Experimental results on indoor and outdoor datasets demonstrate that the proposed algorithm is superior to conventional algorithms in terms of depth completion accuracy and robustness to the mixed-depth problem. Our implementation is publicly available on the project page.

 

Acknowledgement :

This work was partially supported by the National Information Society Agency for construction of training data for artificial intelligence (2100-2131-305-107-19).

 


List of Articles
240. Line Assisted Vision Applications in Structured Environments
Kyungdon Joo, Tae-Hyun Oh, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
239. Fused robot pose estimation using embedded and external camera
Kibaek Park, Hyowon Ha, Francois Rameau, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
238. Low-Cost Synchronization for Multispectral Cameras
Soonmin Hwang, Yukyung Choi, Namil Kim, Kibaek Park, Jae Shin Yoon, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
237. Geometrical Calibration of Multispectral Calibration
Namil Kim, Yukyung Choi, Soonmin Hwang, Kibaek Park, Jae Shin Yoon, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
236. An Approach for Local Feature Evaluation
Yukyung Choi, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
235. Depth Estimation from Light Field Cameras
Sunghoon Im, Hae-Gon Jeon, Hyowon Ha, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
234. Dense Depth and Albedo from a Single-shot Structured Light
Hyowon Ha, Jaesik Park, In So Kweon
International Conference on 3D Vision (3DV) 2015 / 10
233. A Multi-View Structured Light System for Highly Accurate 3D Modeling
Hyowon Ha, Tae-Hyun Oh, In So Kweon
International Conference on 3D Vision (3DV) 2015 / 10
232. Lenticular Lens Parameter Estimation using Single Image for Crosstalk Reduction of Three-dimensional Multi-view Display
Hyoseok Hwang, Juyong Park, Hyun Sung Chang, Young Ju Jeong, Dongkyung Nam, In So Kweon
SID Symposium Digest of Technical Paper (SID 2015) 2015 / 06
231. Depth from Accidental Motion using Geometry Prior
Sunghoon Im, Gyeongmin Choe, Hae-Gon Jeon, In So Kweon
IEEE International Conference on Image Processing (ICIP) 2015 / 09
230. Reflection Removal using Disparity and Gradient-Sparsity via Smoothing Algorithm
T. Sirinukulwattana, Gyeongmin Choe, In So Kweon
IEEE International Conference on Image Processing (ICIP) 2015 / 09
229. All-Day Visual Place Recognition: Benchmark Dataset and Baselines
Yukyung Choi, Namil Kim, Kibaek Park, Soonmin Hwang, Jae Shin Yoon, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW - VPRICE) 2015 / 06
228. Line Meets As-Projective-As-Possible Image Stitching with Moving DLT
Kyungdon Joo, Namil Kim, Tae-Hyun Oh, In So Kweon
IEEE International Conference on Image Processing (ICIP) 2015 / 09
227. ARTRIEVAL: Painting Retrieval Without Expert Knowledge
Namil Kim, Yukyung Choi, Soonmin Hwang, In So Kweon
International Conference on Image Processing (ICIP) 2015 / 09
226. Multi-scale Pyramid Pooling for Deep Convolutional Representation
Donggeun Yoo, Sunggyun Park, Joon-Young Lee, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshop - DeepVision) 2015 / 06
225. One-day outdoor photometric stereo via skylight estimation
Jiyoung Jung, Joon-Young Lee, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [oral] 2015 / 06
224. Accurate Depth Map Estimation from a Lenslet Light Field Camera
Hae-Gon Jeon, Jaesik Park, Gyeongmin Choe, Jinsun Park, Yunsu Bok, Yu-Wing Tai, In So Kweon
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2015 / 06
223. Fast Randomized Singular Value Thresholding for Nuclear Norm Minimization
Tae-Hyun Oh, Yasuyuki Matsushita, Yu-Wing Tai, In So Kweon
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2015 / 06
222. Multispectral Pedestrian Detection: Benchmark Dataset and Baselines
Soonmin Hwang, Jaesik Park, Namil Kim, Yukyung Choi, In So Kweon
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2015 / 06
221. Specular Reflection Separation Using Dark Channel Prior
Hyeongwoo Kim, Hailin Jin, Sunil Hadap, In So Kweon
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2013 / 06
Board Pagination Prev 1 2 3 4 5 6 7 8 9 10 ... 17 Next
/ 17