Video magnification in presence of large motions

Mohamed A. Elgharib; Mohamed Hefeeda; Frédo Durand; William T. Freeman

doi:10.1109/CVPR.2015.7299039

Video magnification in presence of large motions

Mohamed A. Elgharib
, Mohamed Hefeeda
, Frédo Durand
, William T. Freeman

Qatar Computing Research Institute

Hamad bin Khalifa University
Massachusetts Institute of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Video magnification reveals subtle variations that would be otherwise invisible to the naked eye. Current techniques require all motion in the video to be very small, which is unfortunately not always the case. Tiny yet meaningful motions are often combined with larger motions, such as the small vibrations of a gate as it rotates, or the microsaccades in a moving eye. We present a layer-based video magnification approach that can amplify small motions within large ones. An examined region/layer is temporally aligned and subtle variations are magnified. Matting is used to magnify only region of interest while maintaining integrity of nearby sites. Results show handling larger motions, larger amplification factors and significant reduction in artifacts over state of the art.

Original language	English
Title of host publication	IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015
Publisher	IEEE Computer Society
Pages	4119-4127
Number of pages	9
ISBN (Electronic)	9781467369640
DOIs	https://doi.org/10.1109/CVPR.2015.7299039
Publication status	Published - 14 Oct 2015
Event	IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015 - Boston, United States Duration: 7 Jun 2015 → 12 Jun 2015

Publication series

Name	Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Volume	07-12-June-2015
ISSN (Print)	1063-6919

Conference

Conference	IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015
Country/Territory	United States
City	Boston
Period	7/06/15 → 12/06/15

Access to Document

10.1109/CVPR.2015.7299039

Cite this

Elgharib, M. A., Hefeeda, M., Durand, F., & Freeman, W. T. (2015). Video magnification in presence of large motions. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015 (pp. 4119-4127). Article 7299039 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 07-12-June-2015). IEEE Computer Society. https://doi.org/10.1109/CVPR.2015.7299039

@inproceedings{67f84e77095e444d9183f1b3dc8314dd,

title = "Video magnification in presence of large motions",

abstract = "Video magnification reveals subtle variations that would be otherwise invisible to the naked eye. Current techniques require all motion in the video to be very small, which is unfortunately not always the case. Tiny yet meaningful motions are often combined with larger motions, such as the small vibrations of a gate as it rotates, or the microsaccades in a moving eye. We present a layer-based video magnification approach that can amplify small motions within large ones. An examined region/layer is temporally aligned and subtle variations are magnified. Matting is used to magnify only region of interest while maintaining integrity of nearby sites. Results show handling larger motions, larger amplification factors and significant reduction in artifacts over state of the art.",

author = "Elgharib, \{Mohamed A.\} and Mohamed Hefeeda and Fr{\'e}do Durand and Freeman, \{William T.\}",

note = "Publisher Copyright: {\textcopyright} 2015 IEEE.; IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015 ; Conference date: 07-06-2015 Through 12-06-2015",

year = "2015",

month = oct,

day = "14",

doi = "10.1109/CVPR.2015.7299039",

language = "English",

series = "Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition",

publisher = "IEEE Computer Society",

pages = "4119--4127",

booktitle = "IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015",

address = "United States",

}

Elgharib, MA, Hefeeda, M, Durand, F & Freeman, WT 2015, Video magnification in presence of large motions. in IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015., 7299039, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 07-12-June-2015, IEEE Computer Society, pp. 4119-4127, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, United States, 7/06/15. https://doi.org/10.1109/CVPR.2015.7299039

Video magnification in presence of large motions. / Elgharib, Mohamed A.; Hefeeda, Mohamed; Durand, Frédo et al.
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society, 2015. p. 4119-4127 7299039 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 07-12-June-2015).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Video magnification in presence of large motions

AU - Elgharib, Mohamed A.

AU - Hefeeda, Mohamed

AU - Durand, Frédo

AU - Freeman, William T.

PY - 2015/10/14

Y1 - 2015/10/14

N2 - Video magnification reveals subtle variations that would be otherwise invisible to the naked eye. Current techniques require all motion in the video to be very small, which is unfortunately not always the case. Tiny yet meaningful motions are often combined with larger motions, such as the small vibrations of a gate as it rotates, or the microsaccades in a moving eye. We present a layer-based video magnification approach that can amplify small motions within large ones. An examined region/layer is temporally aligned and subtle variations are magnified. Matting is used to magnify only region of interest while maintaining integrity of nearby sites. Results show handling larger motions, larger amplification factors and significant reduction in artifacts over state of the art.

AB - Video magnification reveals subtle variations that would be otherwise invisible to the naked eye. Current techniques require all motion in the video to be very small, which is unfortunately not always the case. Tiny yet meaningful motions are often combined with larger motions, such as the small vibrations of a gate as it rotates, or the microsaccades in a moving eye. We present a layer-based video magnification approach that can amplify small motions within large ones. An examined region/layer is temporally aligned and subtle variations are magnified. Matting is used to magnify only region of interest while maintaining integrity of nearby sites. Results show handling larger motions, larger amplification factors and significant reduction in artifacts over state of the art.

UR - https://www.scopus.com/pages/publications/84959214453

U2 - 10.1109/CVPR.2015.7299039

DO - 10.1109/CVPR.2015.7299039

M3 - Conference contribution

AN - SCOPUS:84959214453

T3 - Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

SP - 4119

EP - 4127

BT - IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015

PB - IEEE Computer Society

T2 - IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015

Y2 - 7 June 2015 through 12 June 2015

ER -

Video magnification in presence of large motions

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this