3D vision in a virtual reality robotics environment

Christian L. Schutz; Emerico Natonek; Charles Baur; Heinz Hugli

doi:10.1117/12.263003

17 December 1996 3D vision in a virtual reality robotics environment

Christian L. Schutz, Emerico Natonek, Charles Baur, Heinz Hugli

Proceedings Volume 2901, Telemanipulator and Telepresence Technologies III; (1996) https://doi.org/10.1117/12.263003
Event: Photonics East '96, 1996, Boston, MA, United States

Abstract

Virtual reality robotics (VRR) needs sensing feedback from the real environment. To show how advanced 3D vision provides new perspectives to fulfill these needs, this paper presents an architecture and system that integrates hybrid 3D vision and VRR and reports about experiments and results. The first section discusses the advantages of virtual reality in robotics, the potential of a 3D vision system in VRR and the contribution of a knowledge database, robust control and the combination of intensity and range imaging to build such a system. Section two presents the different modules of a hybrid 3D vision architecture based on hypothesis generation and verification. Section three addresses the problem of the recognition of complex, free- form 3D objects and shows how and why the newer approaches based on geometric matching solve the problem. This free- form matching can be efficiently integrated in a VRR system as a hypothesis generation knowledge-based 3D vision system. In the fourth part, we introduce the hypothesis verification based on intensity images which checks object pose and texture. Finally, we show how this system has been implemented and operates in a practical VRR environment used for an assembly task.

Citation Download Citation

Christian L. Schutz, Emerico Natonek, Charles Baur, and Heinz Hugli "3D vision in a virtual reality robotics environment", Proc. SPIE 2901, Telemanipulator and Telepresence Technologies III, (17 December 1996); https://doi.org/10.1117/12.263003

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available