Home // ACHI 2024, The Seventeenth International Conference on Advances in Computer-Human Interactions // View article


One-Handed Signs: Standardization for Vehicle Interfaces and Groundwork for Automated Sign Language Recognition

Authors:
Akihisa Shitara
Taiga Kasama
Fumio Yoneyama
Yuhki Shiraishi

Keywords: Deaf and hard of hearing; Sign language; Camera; Sensor glove; Recognition.

Abstract:
In scenes where d/Deaf and hard of hearing (d/Dhh) individuals drive vehicles, they may face issues reliant on not only environmental sounds but also auditory information through communication. Therefore, we investigated the needs in scenarios where drivers drive in a car and proposed an in-car sign recognition standard using one-handed signs to improve communication issues d/Dhh drivers face. Specifically, we focused on one-handed signs in sign language conversations among d/Dhh individuals and selected sign language expressions based on one-handed signs assuming sign language recognition.We selected one-handed signs used in assumed context scenarios driving car situations where the one-handed sign was likely to occur. Additionally, we conducted surveys with d/Dhh individuals involved to assess whether they found these signs natural and acceptable. We also discussed the annotation rules for annotation labels in datasets intended for sign language recognition.

Pages: 174 to 181

Copyright: Copyright (c) IARIA, 2024

Publication date: May 26, 2024

Published in: conference

ISSN: 2308-4138

ISBN: 978-1-68558-163-3

Location: Barcelona, Spain

Dates: from May 26, 2024 to May 30, 2024