Robotics and Computer Vision Lab

Publications

International Conference
2016.03.04 23:57

Video-Story Composition via Plot Analysis

조회 수 1116 댓글 0
Extra Form
저 자 Jinsoo Choi, Tae-Hyun Oh, In So Kweon
학 회 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [Spotlight]
Notes Acknowledgements. This work was supported by the Technology Innovation Program (No. 10048320), funded by the Korea government (MOTIE).
논문일시(Year) 2016
논문일시(Month) 06
We address the problem of composing a story out of multiple short video clips taken by a person during an activity or experience. Inspired by plot analysis of written stories, our method generates a sequence of video clips ordered in such a way that it reflects plot dynamics and content coherency. That is, given a set of multiple video clips, our method composes a video which we call a video-story. We define metrics on scene dynamics and coherency by dense optical flow features and a patch matching algorithm. Using these metrics, we define an objective function for the video-story. To efficiently search for the best video-story, we introduce a novel Branch-and-Bound algorithm which guarantees the global optimum. We collect the dataset consisting of 23 video sets from the web, resulting in a total of 236 individual video clips. With the acquired dataset, we perform extensive user studies involving 30 human subjects by which the effectiveness of our approach is quantitatively and qualitatively verified.

[Spotlight Paper]

List of Articles
» Video-Story Composition via Plot Analysis
Jinsoo Choi, Tae-Hyun Oh, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [Spotlight] 2016 / 06
253. Automatic Content-Aware Color and Tone Stylization
Joon-Young Lee, Kalyan Sunkavalli, Zhe Lin, Xiaohui Shen, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [spotlight] 2016 / 06
252. Simultaneous Estimation of Near IR BRDF and Fine-Scale Surface Geometry
Gyeongmin Choe, Srinivasa G. Narasimhan, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [Spotlight] 2016 / 06
251. High-quality Depth from Uncalibrated Small Motion Clip
Hyowon Ha, Sunghoon Im, Jaesik Park, Hae-Gon Jeon, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [oral] 2016 / 06
250. Stereo Matching with Color and Monochrome Cameras in Low-light Conditions
Hae-Gon Jeon, Joon-Young Lee, Sunghoon Im, Hyowon Ha, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016 / 06
249. Human Action Recognition by Attention and Object Network
Bonggeun Sim, Youngjin Yoon, Donggeun Yoo, In So Kweon
22th Korea-Japan Joint Workshop on Frontiers of Computer Vision 2016 / 02
248. Combinatorial Approach for Lane Detection using Image and LIDAR Reflectance
Seunghak Shin, Inwook Shim, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
247. Learning a Deep Convolutional Network for Light-Field Image Super-Resolution
Youngjin Yoon, Hae-Gon Jeon, Donggeun Yoo, Joon-Young Lee, In So Kweon
IEEE International Conference on Computer Vision Workshops (ICCV Workshops -CPCV) 2015 / 12
246. 6-DOF Direct Homography Tracking with Extended Kalman Filter
Hyowon Ha, Francois Rameau, In So Kweon
The 7th Pacific Rim Symposium on Image and Video Technology (PSIVT) [oral] 2015 / 11
245. AttentionNet: Aggregating Weak Directions for Accurate Object Detection
Donggeun Yoo, Sunggyun Park, Joon-Young Lee, Anthony Paek, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2015 / 12
244. Complementary Sets of Shutter Sequences for Motion Deblurring
Hae-Gon Jeon, Joon-Young Lee, Yudeog Han, Seon Joo Kim, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2015 / 12
243. High Quality Structure from Small Motion for Rolling Shutter Cameras
Sunghoon Im, Hyowon Ha, Gyeongmin Choe, Hae-Gon Jeon, Kyungdon Joo, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2015 / 12
242. Accurate Camera Calibration Robust to Defocus using a Smartphone
Hyowon Ha, Yunsu Bok, Kyungdon Joo, Jiyoung Jung, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2015 / 12
241. Relative Attributes with Deep Convolutional Neural Network
Dong-Jin Kim, Donggeun Yoo, Sunghoon Im, Namil Kim, T. Sirinukulwattana, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
240. Line Assisted Vision Applications in Structured Environments
Kyungdon Joo, Tae-Hyun Oh, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
239. Fused robot pose estimation using embedded and external camera
Kibaek Park, Hyowon Ha, Francois Rameau, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
238. Low-Cost Synchronization for Multispectral Cameras
Soonmin Hwang, Yukyung Choi, Namil Kim, Kibaek Park, Jae Shin Yoon, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
237. Geometrical Calibration of Multispectral Calibration
Namil Kim, Yukyung Choi, Soonmin Hwang, Kibaek Park, Jae Shin Yoon, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
236. An Approach for Local Feature Evaluation
Yukyung Choi, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
235. Depth Estimation from Light Field Cameras
Sunghoon Im, Hae-Gon Jeon, Hyowon Ha, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
Board Pagination Prev 1 2 3 4 5 6 7 8 9 10 ... 17 Next
/ 17