Home // ACHI 2019, The Twelfth International Conference on Advances in Computer-Human Interactions // View article


When Bigger is Simply Better After All: Natural and Multi-Modal Interaction with Large Displays Using a Smartwatch

Authors:
Franca-Alexandra Rupprecht
Carol Naranjo-Valero
Joseph Olakumni
Achim Ebert
Bernd Hamann

Keywords: smartwatch; human-computer interaction; multi- modal interaction; large display device; speech input.

Abstract:
Smartwatches as latest technology of smart devices offer great opportunities for intuitive and natural interaction techniques. The inbuilt sensors of the smartwatches enable consistent user interaction and hands-free, heads-up operations. The utilization and usability of wrist gestures and in-air non touch gestures has been demonstrated in several studies. In combination with Large Display Devices (LDD), smartwatches can be used as control devices in a natural and intuitive way. The most common way to interact with large display devices has been through the keyboard/mouse interaction model, which gives the user wide interaction capabilities but limits the user in his physical space. However, providing more physical space for the user in order to walk around and explore the application projected limits the number of interaction modality. Often the only interaction modality performed with LDDs that do not limit the user to a steady device are pointing gestures. Using smartwatches as control interfaces for LDDs unfetters users from a steady control technology, as already demonstrated with, e.g., the Microsoft⃝R PowerPoint smartwatch enhancement. Users are able to start presentations and switch to the next or previous slide by a simple button touch. But smartwatches offer a much higher potential as control devices of LDDs. More recently, there has been an increasing adoption of natural communication means, such as speech, touch or non-touch gestures (in-air gestures) for interacting with digital devices. Thus, in this paper we describe the design and utilization of a multi-modal interaction interface based on a smartwatch combining the input modalities: (1) touch gestures, (2) non-touch gestures, and (3) speech. In a user study, we employed the interface to different fields of application and discuss critically the suitability of the technology. It can be said, bigger is simply better after all.

Pages: 57 to 65

Copyright: Copyright (c) IARIA, 2019

Publication date: February 24, 2019

Published in: conference

ISSN: 2308-4138

ISBN: 978-1-61208-686-6

Location: Athens, Greece

Dates: from February 24, 2019 to February 28, 2019