Probabilistic video stabilization using Kalman filtering and mosaicing

Andrey Litvin; Janusz Konrad; William Clement Karl

doi:10.1117/12.476436

7 May 2003 Probabilistic video stabilization using Kalman filtering and mosaicing

Andrey Litvin, Janusz Konrad, William Clement Karl

Proceedings Volume 5022, Image and Video Communications and Processing 2003; (2003) https://doi.org/10.1117/12.476436
Event: Electronic Imaging 2003, 2003, Santa Clara, CA, United States

Abstract

The removal of unwanted, parasitic vibrations in a video sequence induced by camera motion is an essential part of video acquisition in industrial, military and consumer applications. In this paper, we present a new image processing method to remove such vibrations and reconstruct a video sequence void of sudden camera movements. Our approach to separating unwanted vibrations from intentional camera motion is based on a probabilistic estimation framework. We treat estimated parameters of interframe camera motion as noisy observations of the intentional camera motion parameters. We construct a physics-based state-space model of these interframe motion parameters and use recursive Kalman filtering to perform stabilized camera position estimation. A six-parameter affine model is used to describe the interframe transformation, allowing quite accurate description of typical scene changes due to camera motion. The model parameters are estimated using a p-norm-based multi-resolution approach. This approach is robust to model mismatch and to object motion within the scene (which are treated as outliers). We use mosaicking in order to reconstruct undefined areas that result from motion compensation applied to each video frame. Registration between distant frames is performed efficiently by cascading interframe affine transformation parameters. We compare our method's performance with that of a commercial product on real-life video sequences, and show a significant improvement in stabilization quality for our method.

Citation Download Citation

Andrey Litvin, Janusz Konrad, and William Clement Karl "Probabilistic video stabilization using Kalman filtering and mosaicing", Proc. SPIE 5022, Image and Video Communications and Processing 2003, (7 May 2003); https://doi.org/10.1117/12.476436

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available