Home // ACHI 2013, The Sixth International Conference on Advances in Computer-Human Interactions // View article

Gesture Recognition for Humanoid Assisted Interactive Sign Language Tutoring

Authors:
Bekir Sıtkı Ertuğrul
Cemal Gurpinar
Hasan Kıvrak
Ajla Kulaglic
Hatice Kose

Keywords: Human-robot interaction; autism; imitation games; sign language

Abstract:
This work is part of an ongoing work for sign language tutoring with imitation based turn-taking and interaction games (iSign) with humanoid robots and children with communication impairments. The paper focuses on the extension of the game, mainly for children with autism. Autism Spectrum Disorder (ASD) involves communication impairments, limited social interaction, and limited imagination. Many such children show interest in robots and find them engaging. Robots can facilitate social interaction between the child and teacher. In this work, a Nao H25 Humanoid robot assisted the human teacher to teach some signs and basic upper torso actions which were observed and imitated by the participants. Kinect camera based system was used to recognize the signs and other actions, and the robot gave visual and audial feedback to the participants based on the performance.

Pages: 135 to 140

Copyright: Copyright (c) IARIA, 2013

Publication date: February 24, 2013

Published in: conference

ISSN: 2308-4138

ISBN: 978-1-61208-250-9

Location: Nice, France

Dates: from February 24, 2013 to March 1, 2013