Home // International Journal On Advances in Software, volume 11, numbers 3 and 4, 2018 // View article

Pragmatic Approach to Automated Testing of Mobile Applications with Non-Native Graphic User Interface

Authors:
Maxim Mozgovoy
Evgeny Pyshkin

Keywords: software testing; GUI; image recognition; pattern matching; similarity; mobile game; continuous integration

Abstract:
This article addresses the problem of automated smoke testing for mobile applications with hand-drawn non-native graphic user interface (GUI) within the context of continuous integration pipeline. In such applications the traditional approach to define and test situations triggered by appearance of certain GUI elements accessed programmatically does not work, so we need to apply image recognition and pattern matching algorithms to testing both the application interface and its major functional features. We introduce one example, which is a Unity-based mobile game "World of Tennis: Roaring '20s". Our idea is to classify GUI elements (including buttons, game control elements, static and movable objects) with respect to their appearance in different type of game scenes, as well as to find pattern recognition methods providing the best similarity values to increase GUI element recognition quality and, therefore, to suggest a reliable support for test script writers.

Pages: 239 to 246

Copyright: Copyright (c) to authors, 2018. Used with permission.

Publication date: December 30, 2018

Published in: journal

ISSN: 1942-2628