Home // eTELEMED 2018, The Tenth International Conference on eHealth, Telemedicine, and Social Medicine // View article

Automated Assessment of Nonverbal Behavior of the Patient during Conversation with the Healthcare Worker Using a Remote Camera

Authors:
Takashi Imabuchi
Oky Dicky Ardiansyah Prima
Hisayoshi Ito

Keywords: Nonverbal communication, Eye tracking, Facial expression, Pose estimation

Abstract:
The importance of nonverbal behavior between the healthcare worker and the patient has led many studies to focus on quantitatively evaluating this behavior. Those existing studies utilize the Kinect 3D sensor to visualize the nonverbal behaviors for a range of healthcare applications. In this study, we propose a framework to automatically assess the nonverbal behavior of the patient during conversation with the healthcare worker. Instead of using the Kinect, we detect the skeleton information of the targeted body from a single camera using an advanced computer vision approach. The proposed framework collects data consisting of facial expression, eye movement, and head nodding and analyzes this data to assess the quality of the nonverbal communication.

Pages: 21 to 26

Copyright: Copyright (c) IARIA, 2018

Publication date: March 25, 2018

Published in: conference

ISSN: 2308-4359

ISBN: 978-1-61208-618-7

Location: Rome, Italy

Dates: from March 25, 2018 to March 29, 2018