Home // ICDS 2014, The Eighth International Conference on Digital Society // View article

Towards Temporal Saliency Detection: Better Video Understanding for Richer TV Experiences

Authors:
Joël Dumoulin
Elena Mugellini
Omar Abou Khaled
Marco Bertini
Alberto Del Bimbo

Keywords: Digital Analysis and Processing; Temporal Saliency; Affective Content Analysis; Arousal Modelling; Emotions

Abstract:
More and more popular, Smart TVs and set-top boxes open new ways for richer experiences in our living rooms. But to offer richer and novel functionalities, a better understanding of the multimedia content is crucial. If many works try to automatically annotate videos at object level, or classify them, we think that investigating the emotions through the use of digital analysis and processing techniques will allow great TV experience improvements. With our work, we propose a temporal saliency detection approach capable of defining the most exciting parts of a video that will be of the most interest to the users. To identify the most interesting events, without performing their classification (in order to be independent from the video domain), we compute a time series of arousal (excitement level of the content), based on audio-visual features. Our goal is to merge this preliminary work with user emotions analysis, in order to create a multi-modal system, allowing to bridge the gap between users' needs and multimedia contents.

Pages: 199 to 202

Copyright: Copyright (c) IARIA, 2014

Publication date: March 23, 2014

Published in: conference

ISSN: 2308-3956

ISBN: 978-1-61208-324-7

Location: Barcelona, Spain

Dates: from March 23, 2014 to March 27, 2014