Home // UBICOMM 2017, The Eleventh International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies // View article

Using Image Recognition for Testing Hand-drawn Graphic User Interfaces

Authors:
Maxim Mozgovoy
Evgeny Pyshkin

Keywords: software testing; GUI; image recognition; similarity; mobile game

Abstract:
This paper discusses the use of image recognition for constructing automated GUI tests for the applications with hand-drawn user interface components, such as mobile games. Specifically, this contribution addresses the use of OpenCV pattern matching algorithms and the choice of most appropriate combinations of methods for GUI testing of the upcoming Unity-based mobile game "World of Tennis: Roaring 20's". Our idea is to classify UI elements (including buttons, game control elements, static and movable objects) with respect to their appearance in different type of scenes present in the game, as well as to find pattern recognition methods providing the best similarity values to increase UI element recognition quality.

Pages: 25 to 28

Copyright: Copyright (c) IARIA, 2017

Publication date: November 12, 2017

Published in: conference

ISSN: 2308-4278

ISBN: 978-1-61208-598-2

Location: Barcelona, Spain

Dates: from November 12, 2017 to November 16, 2017