Distributed edge computing for cooperative augmented reality: enhancing mobile sensing capabilities

Cheng-Yu Cheng; Qi Zhao; Cheng-Ying Wu; Yuchen Yang; Muhammad A. Qureshi; Hang Liu; Genshe Chen

doi:10.1117/12.3021841

6 June 2024 Distributed edge computing for cooperative augmented reality: enhancing mobile sensing capabilities

Cheng-Yu Cheng, Qi Zhao, Cheng-Ying Wu, Yuchen Yang, Muhammad A. Qureshi, Hang Liu, Genshe Chen

Proceedings Volume 13062, Sensors and Systems for Space Applications XVII; 130620O (2024) https://doi.org/10.1117/12.3021841
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

Cooperative Augmented Reality (AR) can provide real-time, immersive, and context-aware situational awareness while enhancing mobile sensing capabilities and benefiting various applications. Distributed edge computing has emerged as an essential paradigm to facilitate cooperative AR. We designed and implemented a distributed system to enable fast, reliable, and scalable cooperative AR. In this paper, we present a novel approach and architecture that integrates advanced sensing, communications, and processing techniques to create such a cooperative AR system and demonstrate its capability with HoloLens and edge servers connected over a wireless network. Our research addresses the challenges of implementing a distributed cooperative AR system capable of capturing data from a multitude of sensors on HoloLens, performing fusion and accurate object recognition, and seamlessly projecting the reconstructed 3D model into the wearer’s field of view. The paper delves into the intricate architecture of the proposed cooperative AR system, detailing its distributed sensing and edge computing components, and the Apache Storm-integrated platform. The implementation encompasses data collection, aggregation, analysis, object recognition, and rendering of 3D models on the HoloLens, all in real-time. The proposed system enhances the AR experience while showcasing the vast potential of distributed edge computing. Our findings illustrate the feasibility and advantages of merging distributed cooperative sensing and edge computing to offer dynamic, immersive AR experiences, paving the way for new applications.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Cheng-Yu Cheng, Qi Zhao, Cheng-Ying Wu, Yuchen Yang, Muhammad A. Qureshi, Hang Liu, and Genshe Chen "Distributed edge computing for cooperative augmented reality: enhancing mobile sensing capabilities", Proc. SPIE 13062, Sensors and Systems for Space Applications XVII, 130620O (6 June 2024); https://doi.org/10.1117/12.3021841

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available