Temporally consistent 3D human motion estimation from a video

Zhaobing Zhang; Yuehu Liu; Shaorong Wang; Yuanfeng Yan

doi:10.1117/12.3029604

13 May 2024 Temporally consistent 3D human motion estimation from a video

Zhaobing Zhang, Yuehu Liu, Shaorong Wang, Yuanfeng Yan

Proceedings Volume 13158, Seventh International Conference on Computer Graphics and Virtuality (ICCGV 2024); 131580B (2024) https://doi.org/10.1117/12.3029604
Event: Seventh International Conference on Computer Graphics and Virtuality (ICCGV24), 2024, Hangzhou, China

Abstract

It is still difficult to accurately extract smooth and consistent 3D human motion from video footage over time. While some existing techniques have achieved favorable outcomes by utilizing the combined features of consecutive frames, many of them compromise accuracy in order to reduce jitter or do not have a complete understanding of the temporal nature of human movement. To this end, we model the natural smoothing properties in body motion by learning the long-range temporal relationship between the kinematic features of the human body in the video and the enhanced current frame features. First, we use the velocity and acceleration of key points to effectively capture temporal features as our temporal motion prior, and then we have created a module that uses a hierarchical attention mechanism to improve the representation of the current frame by selectively focusing on important temporal information from both past and future frames. This enhances the correlation between frames and improves the overall quality of the feature representation. Ultimately these two parts of features are aggregated together through a global motion aware network and linear fusion is performed to obtain the final accurate 3D human motion.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Zhaobing Zhang, Yuehu Liu, Shaorong Wang, and Yuanfeng Yan "Temporally consistent 3D human motion estimation from a video", Proc. SPIE 13158, Seventh International Conference on Computer Graphics and Virtuality (ICCGV 2024), 131580B (13 May 2024); https://doi.org/10.1117/12.3029604

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

3D modeling

Video

Motion models

Motion estimation

Kinematics

Education and training

Pose estimation

Show All Keywords

Keywords/Phrases

Search In:

Publication Years