Home // ALLDATA 2015, The First International Conference on Big Data, Small Data, Linked Data and Open Data // View article

Applying Semantic Reasoning in Image Retrieval

Authors:
Maaike Heintje Trijntje de Boer
Laura Daniele
Paul Brandt
Maya Sappelli

Keywords: semantics; natural language queries; semantic reasoning; image retrieval; ranking

Abstract:
With the growth of open sensor networks, multiple applications in different domains make use of a large amount of sensor data, resulting in an emerging need to search semantically over heterogeneous datasets. In semantic search, an important challenge consists of bridging the semantic gap between the high-level natural language query posed by the users and the low-level sensor data. In this paper, we show that state-of-the-art techniques in Semantic Modelling, Computer Vision and Human Media Interaction can be combined to apply semantic reasoning in the field of image retrieval. We propose a system, GOOSE, which is a general-purpose search engine that allows users to pose natural language queries to retrieve corresponding images. User queries are interpreted using the Stanford Parser, semantic rules and the Linked Open Data source ConceptNet. Interpreted queries are presented to the user as an intuitive and insightful graph in order to collect feedback that is used for further reasoning and system learning. A smart results ranking and retrieval algorithm allows for fast and effective retrieval of images.

Pages: 69 to 74

Copyright: Copyright (c) IARIA, 2015

Publication date: April 19, 2015

Published in: conference

ISSN: 2519-8386

ISBN: 978-1-61208-445-9

Location: Barcelona, Spain

Dates: from April 19, 2015 to April 24, 2016