Towards clinical translation of augmented orthopedic surgery: from pre-op CT to intra-op x-ray via RGBD sensing

Emerson Tucker; Javad Fotouhi; Mathias Unberath; Sing Chun Lee; Bernhard Fuerst; Alex Johnson; Mehran Armand; Greg M. Osgood; Nassir Navab

doi:10.1117/12.2293675

6 March 2018 Towards clinical translation of augmented orthopedic surgery: from pre-op CT to intra-op x-ray via RGBD sensing

Emerson Tucker, Javad Fotouhi, Mathias Unberath, Sing Chun Lee, Bernhard Fuerst, Alex Johnson, Mehran Armand, Greg M. Osgood, Nassir Navab

Author Affiliations +

Proceedings Volume 10579, Medical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications; 105790J (2018) https://doi.org/10.1117/12.2293675
Event: SPIE Medical Imaging, 2018, Houston, Texas, United States

Abstract

Pre-operative CT data is available for several orthopedic and trauma interventions, and is mainly used to identify injuries and plan the surgical procedure. In this work we propose an intuitive augmented reality environment allowing visualization of pre-operative data during the intervention, with an overlay of the optical information from the surgical site. The pre-operative CT volume is first registered to the patient by acquiring a single C-arm X-ray image and using 3D/2D intensity-based registration. Next, we use an RGBD sensor on the C-arm to fuse the optical information of the surgical site with patient pre-operative medical data and provide an augmented reality environment. The 3D/2D registration of the pre- and intra-operative data allows us to maintain a correct visualization each time the C-arm is repositioned or the patient moves. An overall mean target registration error (mTRE) and standard deviation of 5.24 ± 3.09 mm was measured averaged over 19 C-arm poses. The proposed solution enables the surgeon to visualize pre-operative data overlaid with information from the surgical site (e.g. surgeon’s hands, surgical tools, etc.) for any C-arm pose, and negates issues of line-of-sight and long setup times, which are present in commercially available systems.

Conference Presentation

Citation Download Citation

Emerson Tucker, Javad Fotouhi, Mathias Unberath, Sing Chun Lee, Bernhard Fuerst, Alex Johnson, Mehran Armand, Greg M. Osgood, and Nassir Navab "Towards clinical translation of augmented orthopedic surgery: from pre-op CT to intra-op x-ray via RGBD sensing", Proc. SPIE 10579, Medical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications, 105790J (6 March 2018); https://doi.org/10.1117/12.2293675

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available