AeroVox: a web app developed for voice controlled drone operations with 3D spatial constraints

Abstract

This project presents the development of a web-based application designed to enable voice-controlled drone operation, while incorporating 3D spatial constraints to ensure safe and controlled flights. Traditional drone control systems predominantly rely on manual inputs through controllers, which can be cumbersome and limit the operator's ability to react swiftly in dynamic or high-pressure environments. By implementing voice recognition technology, this system allows users to operate drones hands-free, offering greater flexibility and ease of use, particularly for those with less technical expertise. In addition to voice control, the integration of 3D geofencing ensures that drones operate within predefined areas, significantly enhancing operational safety by preventing unintended zone breaches. The motivation for this project stemmed from the need to improve both user accessibility and safety in drone operations. It was carried out within the context of the Drone Engineering Ecosystem (DEE) at the Escola d'Enginyeria de Telecomunicació i Aeroespacial de Castelldefels (EETAC). Initially, the project was intended to build upon existing applications within the DEE, but challenges with the original codebase and programming language led to a shift toward developing a new web application from scratch. This application was built using Vue.js for the front-end interface, combined with the MQTT communication protocol to facilitate real-time messaging between the drone and control system. Extensive testing was conducted through both simulation and real-world flight trials to evaluate system performance. The results confirmed the system's ability to accurately interpret and execute voice commands in real-time, while maintaining drone flight within the designated spatial boundaries. These tests demonstrated the effectiveness of the voice control system, providing intuitive command capabilities without compromising safety. While future improvements could focus on increasing the accuracy of voice recognition and expanding the complexity of 3D geofencing, this project provides a strong foundation for further innovation in human-drone interaction and paves the way for safer, more accessible drone control solutions.