Super-resolution-based enhancement for real-time ultra-low-bit-rate video coding

Wei-Jung Chien; Glen P. Abousleman; Lina J. Karam

doi:10.1117/12.720065

2 May 2007 Super-resolution-based enhancement for real-time ultra-low-bit-rate video coding

Wei-Jung Chien, Glen P. Abousleman, Lina J. Karam

Proceedings Volume 6579, Mobile Multimedia/Image Processing for Military and Security Applications 2007; 657904 (2007) https://doi.org/10.1117/12.720065
Event: Defense and Security Symposium, 2007, Orlando, Florida, United States

Abstract

This paper presents a software-only, real-time video coder/decoder (codec) with super-resolution-based enhancement for ultra-low-bit-rate compression. The codec incorporates a modified JPEG2000 core and interframe predictive coding, and can operate with network bandwidths as low as 500 bits/second. Highly compressed video exhibits severe coding artifacts that degrade visual quality. To lower the level of noise and retain the sharpness of the video frames, we build on our previous work in super-resolution-based video enhancement and propose a new version that is suitable for real-time video coding systems. The adopted super-resolution-based enhancement uses a constrained set of motion vectors that is computed from the original (uncompressed) video at the encoder. Artificial motion is also added to the difference frame to maximize the enhancement performance. The encoder can transmit either the full set of motion vectors or the constrained set of motion vectors depending upon the available bandwidth. At the decoder, each pixel of the decoded frame is assigned to a motion vector from the constrained motion vector set. L₂-norm minimization super-resolution is then applied to the decoded frame set (previous frame, current frame, and next frame). A selective motion estimation scheme is proposed to prevent ghosting, which otherwise would result from the super-resolution enhancement when the motion estimation fails to find appropriate motion vectors. Results using the proposed system demonstrate significant improvements in the quantitative and visual quality of the coded video sequences.

Citation Download Citation

Wei-Jung Chien, Glen P. Abousleman, and Lina J. Karam "Super-resolution-based enhancement for real-time ultra-low-bit-rate video coding", Proc. SPIE 6579, Mobile Multimedia/Image Processing for Military and Security Applications 2007, 657904 (2 May 2007); https://doi.org/10.1117/12.720065

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available