Home // ICAS 2022, The Eighteenth International Conference on Autonomic and Autonomous Systems // View article
Authors:
Abdellatif Bey Temsamani
Anil Kumar Chavali
Ward Vervoort
Tinne Tuytelaars
Gorjan Radevski
Hugo Van Hamme
Kevin Mets
Matthias Hutsebaut-Buysse
Tom De Schepper
Steven Latré
Keywords: AI based autonomous systems; Multimodal AI; Natural language processing (NLP); deep learning; neural networks; reinforcement learning
Abstract:
In current production shop floors, a fleet of production machines and AGVs form a full manufacturing system with a high degree of automation. These current manufacturing systems need to deal with high variability of products and production tasks. Every task, however, requires a proper reconfiguration & control that is often done manually requiring complex settings and long configuration time. With AI techniques the reconfiguration of these systems to deal with a new task can be made more intuitive. In this paper we present the upgrade of an autonomous system, used for manufacturing assets handling and transportation, with AI features that make it easy to reconfigure in order to deal with high variability of assets and missions. Visual and spoken information is used to instruct and guide the autonomous vehicle using an AI multimodal framework where first, spoken language, with different local dialects, is translated to digital instructions, that can be associated to visual information to form control instructions to the autonomous vehicle. Different AI models, respectively for spoken language understanding, visual perception, vision based navigation are associated through a multimodal AI framework to intuitively control the AGV to perform a specific task. Beside the challenges related to the integration of these models in the AGV platform, other challenges related to dealing with variabilities of dialects, objects, surroundings and ambient conditions are partly tackled in this research.
Pages: 31 to 39
Copyright: Copyright (c) IARIA, 2022
Publication date: May 22, 2022
Published in: conference
ISSN: 2308-3913
ISBN: 978-1-61208-966-9
Location: Venice, Italy
Dates: from May 22, 2022 to May 26, 2022