Title:
Discontinuous Seam-Carving for Video Retargeting
Discontinuous Seam-Carving for Video Retargeting
Author(s)
Grundmann, Matthias
Kwatra, Vivek
Han, Mei
Essa, Irfan
Kwatra, Vivek
Han, Mei
Essa, Irfan
Advisor(s)
Editor(s)
Collections
Supplementary to
Permanent Link
Abstract
We introduce a new algorithm for video retargeting that
uses discontinuous seam-carving in both space and time
for resizing videos. Our algorithm relies on a novel
appearance-based temporal coherence formulation that allows
for frame-by-frame processing and results in temporally
discontinuous seams, as opposed to geometrically
smooth and continuous seams. This formulation optimizes
the difference in appearance of the resultant retargeted
frame to the optimal temporally coherent one, and allows
for carving around fast moving salient regions. Additionally,
we generalize the idea of appearance-based coherence
to the spatial domain by introducing piece-wise spatial
seams. Our spatial coherence measure minimizes the
change in gradients during retargeting, which preserves
spatial detail better than minimization of color difference
alone. We also show that per-frame saliency (gradient-based
or feature-based) does not always produce desirable
retargeting results and propose a novel automatically computed
measure of spatio-temporal saliency. As needed, a
user may also augment the saliency by interactive region-brushing.
Our retargeting algorithm processes the video sequentially,
making it conducive for streaming applications.
Sponsor
Date Issued
2010-06
Extent
Resource Type
Text
Resource Subtype
Post-print
Proceedings
Proceedings