Robotics and Computer Vision Lab

Publications

조회 수 430 댓글 0
Extra Form
저 자 Tae-Hyun Oh, Kyungdon Joo, Neel Joshi, Baoyuan Wang, In So Kweon, Sing Bing Kang
학 회 IEEE International Conference on Computer Vision (ICCV)
논문일시(Year) 2017
논문일시(Month) 10
Cinemagraphs are a compelling way to convey dynamic aspects of a scene. In these media, dynamic and still elements are juxtaposed to create an artistic and narrative experience. Creating a high-quality, aesthetically pleasing cinemagraph requires isolating objects in a semantically meaningful way and then selecting good start times and looping periods for those objects to minimize visual artifacts (such a tearing). To achieve this, we present a new technique that uses object recognition and semantic segmentation as part of an optimization method to automatically create cinemagraphs from videos that are both visually appealing and semantically meaningful. Given a scene with multiple objects, there are many cinemagraphs one could create. Our method evaluates these multiple candidates and presents the best one, as determined by a model trained to predict human preferences in a collaborative way. We demonstrate the effectiveness of our approach with multiple results and a user study.



We would like to thank all the participants in our user study. We are also grateful to Jian Sun and Jinwoo Shin for the helpful discussions. This work was mostly done while the first author was an intern at Microsoft Research, Redmond. It was completed at KAIST with the support of the Technology Innovation Program (No. 10048320), which is funded by the Korean government (MOTIE).

** The first and second authors contributed equally to this work.

List of Articles
539. Efficient adaptive non-maximal suppression algorithms for homogeneous spatial keypoint distribution
Oleksandr Bailo , Francois Rameau , Kyungdon Joo , Jinsun Park , Oleksandr Bogdan , In So Kweon
Pattern Recognition Letters (PRL) 2018 / 02
538. Disjoint Multi-task Learning between Heterogeneous Human-centric Tasks
Dong-Jin Kim , Jinsoo Choi , Tae-Hyun Oh , Youngjin Yoon , In So Kweon
IEEE Winter Conf. on Applications of Computer Vision (WACV) 2018 / 03
537. Learning Image Representations by Completing Damaged Jigsaw Puzzles
Dahun Kim , Donghyeon Cho , Donggeun Yoo , In So Kweon
IEEE Winter Conf. on Applications of Computer Vision (WACV) 2018 / 05
536. StairNet: Top-Down Semantic Aggregation for Accurate One Shot Detection
Sanghyun Woo, Soonmin Hwang, In So Kweon
IEEE Winter Conf. on Applications of Computer Vision (WACV) 2018 / 03
535. Multispectral Transfer Network: Unsupervised Depth Estimation for All-day Vision
Namil Kim, Yukyung Choi, Soonmin Hwang, In So Kweon
Association for the Advancement of Artificial Intelligence (AAAI) 2018 / 02
534. Co-domain Embedding using Deep Quadruplet Network for Unseen Traffic Sign Recognition
Junsik Kim, Seokju Lee, Tae-Hyun Oh, In So Kweon
Association for the Advancement of Artificial Intelligence (AAAI) 2018 / 02
533. On-line Initialization and Extrinsic Calibration of an Inertial Navigation System with a Relative Preintegration Method on Manifold
Dongshin Kim, Seunghak Shin, In So Kweon
IEEE Transactions on Automation Science and Engineering (TASE) 2017 / 11
532. Robust and Globally Optimal Manhattan Frame Estimation in Near Real Time
Kyungdon Joo, Tae-Hyun Oh, Junsik Kim, In So Kweon
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2017 / 11
531. Geometry Guided 3D Propagation for Depth from Small Motion
Seunghak Shin, Sunghoon Im, Inwook Shim, Hae-Gon Jeon, In So Kweon
IEEE Signal Processing Letters 2017 / 12
530. Intelligent Assistant for People with Low Vision Abilities
Oleksandr Bogdan, Oleg Yurchenko, Oleksandr Bailo, Francois Rameau, Donggeun Yoo, In So Kweon
The 8th Pacific Rim Symposium on Image and Video Technology (PSIVT) 2017 / 11
529. Multi-Scale, Multi-Object and Real-Time Face Detection and Head Pose Estimation Using Deep Neural Networks
Byungtae Ahn, Dong-Geol Choi, In So Kweon
Journal of Korea Robotics Society 2017 / 09
528. VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition
Seokju Lee, Junsik Kim, Jae Shin Yoon, Seunghak Shin, Oleksandr Bailo, Namil Kim, Tae-Hee Lee, Hyun Seok Hong, Seung-Hoon Han, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2017 / 10
527. Two-Phase Learning for Weakly Supervised Object Localization
Dahun Kim, Donghyeon Cho, Donggeun Yoo, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2017 / 10
526. Weakly- and Self- Supervised Learning for Content-Aware Deep Image Retargeting
Donghyeon Cho, Jinsun Park, Tae-Hyun Oh, Yu-Wing Tai, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2017 / 10
525. Deltille Grids for Geometric Camera Calibration
Hyowon Ha, Michal Perdoch, Hatem Alismail, In So Kweon, Yaser Sheikh
IEEE International Conference on Computer Vision (ICCV) 2017 / 10
» Personalized Cinemagraphs using Semantic Understanding and Collaborative Learning
Tae-Hyun Oh, Kyungdon Joo, Neel Joshi, Baoyuan Wang, In So Kweon, Sing Bing Kang
IEEE International Conference on Computer Vision (ICCV) 2017 / 10
523. Noise Robust Depth From Focus Using a Ring Difference Filter
Jaeheung Surh, Hae-Gon Jeon, Yunwon Park, Sunghoon Im, Hyowon Ha, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017 / 07
522. Pixel-Level Matching for Video Object Segmentation using Convolutional Neural Networks
Jae Shin Yoon, Francois Rameau, Junsik Kim, Seokju Lee, Seunghak Shin, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2017 / 10
521. A Real-Time and Energy-Efficient Embedded System for Intelligent ADAS with RNN-Based Deep Risk Prediction using Stereo Camera
Kyuho Lee, Gyeongmin Choe, Kyeongryeol Bong, Changhyeon Kim, In So Kweon, Hoi-Jun Yoo
International Conference on Computer Vision Systems (ICVS) 2017 / 07
520. A Closed-Form Solution to Rotation Estimation for Structure from Small Motion
Hyowon Ha, Tae-Hyun Oh, In So Kweon
IEEE Signal Processing Letters 2017 / 05
Board Pagination Prev 1 2 3 4 5 6 7 8 9 10 ... 30 Next
/ 30