Wearable Human Computer Interface for control within immersive VAMR gaming environments using data glove and hand gestures

Abstract

The continuous advances in the state-of-the-art in the Virtual, Augmented, and Mixed Reality (V AMR) technology are important in many application spaces, including gaming, entertainment, and media technologies. V AMR is part of the broader Human-Computer Interface (HCI) area focused on providing an unprecedentedly immersive way of interacting with computers. These new ways of interacting with computers can leverage the emerging user input devices. In this paper, we present a demonstrator system that shows how our wearable Virtual Reality (VR) Glove can be used with an off-the-shelf head-mounted VR device, the RealWear HMT-1™. We show how the smart data capture glove can be used as an effective input device to the HMT-1™ to control various devices, such as virtual controls, simply using hand gesture recognition algorithms. We describe our fully functional proof-of-concept prototype, along with the complete system architecture and its ability to scale by incorporating other devices.