Robotics and Computer Vision Lab

Publications

International Conference
2016.03.04 23:57

Video-Story Composition via Plot Analysis

조회 수 1123 댓글 0
Extra Form
저 자 Jinsoo Choi, Tae-Hyun Oh, In So Kweon
학 회 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [Spotlight]
Notes Acknowledgements. This work was supported by the Technology Innovation Program (No. 10048320), funded by the Korea government (MOTIE).
논문일시(Year) 2016
논문일시(Month) 06
We address the problem of composing a story out of multiple short video clips taken by a person during an activity or experience. Inspired by plot analysis of written stories, our method generates a sequence of video clips ordered in such a way that it reflects plot dynamics and content coherency. That is, given a set of multiple video clips, our method composes a video which we call a video-story. We define metrics on scene dynamics and coherency by dense optical flow features and a patch matching algorithm. Using these metrics, we define an objective function for the video-story. To efficiently search for the best video-story, we introduce a novel Branch-and-Bound algorithm which guarantees the global optimum. We collect the dataset consisting of 23 video sets from the web, resulting in a total of 236 individual video clips. With the acquired dataset, we perform extensive user studies involving 30 human subjects by which the effectiveness of our approach is quantitatively and qualitatively verified.

[Spotlight Paper]

List of Articles
260. Fast Multiple Objects Detection and Tracking Fusing Color Camera and 3D LIDAR for Intelligent Vehicles
Soonmin Hwang, Namil Kim, Yukyung Choi, Seokju Lee, In So Kweon
The International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2016 / 08
1
259. Thermal Image Enhancement using Convolution Neural Network
Yukyung Choi, Namil Kim, Soonmin Hwang, In So Kweon
The International Conference of Intelligent Robots and Systems (IROS) 2016 / 10
258. Thermal-Infrared based Drivable Region Detection
Jae Shin Yoon, Kibaek Park, Soonmin Hwang, Namil Kim, Yukyung Choi, Francois Rameau, In So Kweon
IEEE Intelligent Vehicles Symposium (IV) 2016 / 06
257. Vision system and depth processing for DRC-HUBO+
Inwook Shim, Seunghak Shin, Yunsu Bok, Kyungdon Joo, Dong-Geol Choi, Joon-Young Lee, Jaesik Park, Jun-Ho Oh, In So Kweon
IEEE International Conference on Robotics and Automation(ICRA) 2016 / 05
256. Efficient and Robust Color Consistency for Community Photo Collections
Jaesik Park, Yu-Wing Tai, Sudipta N. Sinha, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016 / 06
255. Globally Optimal Manhattan Frame Estimation in Real-time
Kyungdon Joo, Tae-Hyun Oh, Junsik Kim, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016 / 06
» Video-Story Composition via Plot Analysis
Jinsoo Choi, Tae-Hyun Oh, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [Spotlight] 2016 / 06
253. Automatic Content-Aware Color and Tone Stylization
Joon-Young Lee, Kalyan Sunkavalli, Zhe Lin, Xiaohui Shen, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [spotlight] 2016 / 06
252. Simultaneous Estimation of Near IR BRDF and Fine-Scale Surface Geometry
Gyeongmin Choe, Srinivasa G. Narasimhan, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [Spotlight] 2016 / 06
251. High-quality Depth from Uncalibrated Small Motion Clip
Hyowon Ha, Sunghoon Im, Jaesik Park, Hae-Gon Jeon, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [oral] 2016 / 06
250. Stereo Matching with Color and Monochrome Cameras in Low-light Conditions
Hae-Gon Jeon, Joon-Young Lee, Sunghoon Im, Hyowon Ha, In So Kweon
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016 / 06
249. Human Action Recognition by Attention and Object Network
Bonggeun Sim, Youngjin Yoon, Donggeun Yoo, In So Kweon
22th Korea-Japan Joint Workshop on Frontiers of Computer Vision 2016 / 02
248. Combinatorial Approach for Lane Detection using Image and LIDAR Reflectance
Seunghak Shin, Inwook Shim, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
247. Learning a Deep Convolutional Network for Light-Field Image Super-Resolution
Youngjin Yoon, Hae-Gon Jeon, Donggeun Yoo, Joon-Young Lee, In So Kweon
IEEE International Conference on Computer Vision Workshops (ICCV Workshops -CPCV) 2015 / 12
246. 6-DOF Direct Homography Tracking with Extended Kalman Filter
Hyowon Ha, Francois Rameau, In So Kweon
The 7th Pacific Rim Symposium on Image and Video Technology (PSIVT) [oral] 2015 / 11
245. AttentionNet: Aggregating Weak Directions for Accurate Object Detection
Donggeun Yoo, Sunggyun Park, Joon-Young Lee, Anthony Paek, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2015 / 12
244. Complementary Sets of Shutter Sequences for Motion Deblurring
Hae-Gon Jeon, Joon-Young Lee, Yudeog Han, Seon Joo Kim, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2015 / 12
243. High Quality Structure from Small Motion for Rolling Shutter Cameras
Sunghoon Im, Hyowon Ha, Gyeongmin Choe, Hae-Gon Jeon, Kyungdon Joo, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2015 / 12
242. Accurate Camera Calibration Robust to Defocus using a Smartphone
Hyowon Ha, Yunsu Bok, Kyungdon Joo, Jiyoung Jung, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2015 / 12
241. Relative Attributes with Deep Convolutional Neural Network
Dong-Jin Kim, Donggeun Yoo, Sunghoon Im, Namil Kim, T. Sirinukulwattana, In So Kweon
The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015 / 10
Board Pagination Prev 1 2 3 4 5 6 7 8 9 10 ... 17 Next
/ 17