Exploring interaction with remote autonomous systems using conversational agents

Published in Proceedings of the 2019 ACM Designing Interactive Systems Conference, 2019

Recommended citation: Robb, D. A., Lopes, J., Padilla, S., Laskov, A., Chiyah Garcia, F. J., Liu, X., Willners, J. S., Valeyrie, N., Lohan, K., Lane, D., Patron, P., Petillot, Y., Chantler, M. J., & Hastie, H. (2019). Exploring interaction with remote autonomous systems using conversational agents. DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference, 1543–1556. https://doi.org/10.1145/3322276.3322318 https://dl.acm.org/doi/10.1145/3322276.3322318

Autonomous vehicles and robots are increasingly being deployed to remote, dangerous environments in the energy sector, search and rescue and the military. As a result, there is a need for humans to interact with these robots to monitor their tasks, such as inspecting and repairing offshore wind-turbines. Conversational Agents can improve situation awareness and transparency, while being a hands-free medium to communicate key information quickly and succinctly. As part of our user-centered design of such systems, we conducted an in-depth immersive qualitative study of twelve marine research scientists and engineers, interacting with a prototype Conversational Agent. Our results expose insights into the appropriate content and style for the natural language interaction and, from this study, we derive nine design recommendations to inform future Conversational Agent design for remote autonomous systems.

Download paper here