Home // SEMAPRO 2019, The Thirteenth International Conference on Advances in Semantic Processing // View article

Static and Dynamic Haptograms to Communicate Semantic Content

Authors:
Sándor Darányi
Nasrine Olson
Marina Riga
Efstratios Kontopoulos
Ioannis Kompatsiaris

Keywords: deafblind communication; conceptual hapto-grams; word and sentence semantics; ontology

Abstract:
Based on the ontology developed in the ongoing SUITCEYES EU-funded project to bridge visual analytics for situational awareness and navigation with semantic labelling of environ-mental cues, we designed a set of static and dynamic hapto-grams to represent concepts for two-way communication be-tween deafblind and non-deafblind users. A haptogram corresponds to a tactile symbol drawn over a touchscreen, its dynamic nature referring to the act of writing or drawing, where the touchscreen can take several forms, including a smart tex-tile screen designated for specific areas on the body. In its cur-rent version, our haptogram set is generated over a 4 x 4 matrix of cells and is displayed on the back of the user, tested for robustness at the receiving end. The concepts and concept sequences simulating simple questions and answers represented by haptograms are focused on ontology content for now but can be scaled up.

Pages: 16 to 20

Copyright: Copyright (c) IARIA, 2019

Publication date: September 22, 2019

Published in: conference

ISSN: 2308-4510

ISBN: 978-1-61208-738-2

Location: Porto, Portugal

Dates: from September 22, 2019 to September 26, 2019