Home // AMBIENT 2011, The First International Conference on Ambient Computing, Applications, Services and Technologies // View article

Context-Aware 3D Gesture Interaction Based on Multiple Kinects

Authors:
Maurizio Caon
Yong Yue
Julien Tscherrig
Elena Mugellini
Omar Abou Khaled

Keywords: Ambient Intelligence; Smart Environment; Gesture Interaction; Posture Recognition; Depth Cameras

Abstract:
This paper presents a novel context-aware system for deictic gestures interaction with smart environments. The system tracks multiple users; moreover, it recognizes inhabitants’ postures and gestures in real-time. This information, enriched with smart objects coordinates, is reconstructed in a 3D model to allow the recognition process. Finally the system executes the programmed tasks to support the users’ activity. Two Microsoft Kinect depth cameras have been used to acquire the data and a framework for the communication with the smart objects has been adopted. A first prototype has been developed and an evaluation test with 13 users has been conducted in order to assess the usability of the system. Results show that this interaction experience has been really appreciated by the users.

Pages: 7 to 12

Copyright: Copyright (c) IARIA, 2011

Publication date: October 23, 2011

Published in: conference

ISSN: 2326-9324

ISBN: 978-1-61208-170-0

Location: Barcelona, Spain

Dates: from October 23, 2011 to October 29, 2011