Ir al contenido (pulsa Retorno)

Universitat Politècnica de Catalunya

    • Català
    • Castellano
    • English
    • LoginRegisterLog in (no UPC users)
  • mailContact Us
  • world English 
    • Català
    • Castellano
    • English
  • userLogin   
      LoginRegisterLog in (no UPC users)

UPCommons. Global access to UPC knowledge

Banner header
69.092 UPC E-Prints
You are here:
View Item 
  •   DSpace Home
  • E-prints
  • Grups de recerca
  • ICARUS - Intelligent Communications and Avionics for Robust Unmanned Aerial Systems
  • Ponències/Comunicacions de congressos
  • View Item
  •   DSpace Home
  • E-prints
  • Grups de recerca
  • ICARUS - Intelligent Communications and Avionics for Robust Unmanned Aerial Systems
  • Ponències/Comunicacions de congressos
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Explainability of deep reinforcement learning method with drones

Thumbnail
View/Open
3152.pdf (3,562Mb)
 
10.1109/DASC58513.2023.10311156
 
  View UPCommons Usage Statistics
  LA Referencia / Recolecta stats
Includes usage data since 2022
Cita com:
hdl:2117/399125

Show full item record
Çetin, EnderMés informacióMés informació
Barrado Muxí, CristinaMés informacióMés informacióMés informació
Pastor Llorens, EnricMés informacióMés informacióMés informació
Document typeConference report
Defense date2023
Rights accessOpen Access
All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder
ProjectSUPERVISION DE FLOTA DE DRONES Y OPTIMIZACION DE LOS PLANES DE VUELO DE OPERACIONES COMERCIALES (AEI-PID2020-116377RB-C21)
Abstract
Recent advances in artificial intelligence (AI) technology demonstrated that AI algorithms are very powerful as AI models become more complex. As a result, the users and also the engineers who developed the AI algorithms have a hard time explaining how the AI model gives the specific result. This phenomenon is known as "black box" and affects end-users’ confidence in these AI systems. In this research, explainability of deep reinforcement learning is investigated for counter-drone systems. To counter a drone, a deep reinforcement learning method such as double deep Q-network with dueling architecture and prioritized experience replay is proposed. In counter-drone systems, catching the target as soon as possible is expected. Otherwise, the target can be gone in a short time. To understand how the agent performs more quickly and accurately, figures representing rewards, drone locations, crash positions, and the distribution of actions are analyzed and compared. For example, the positions of the drones in a successful episode during training can be analyzed by the actions the agent performed and the rewards in this episode. In addition, the actions agent took in episodes are compared with action frequencies during training and it is seen that at the end of the training, the agent selects the dominant actions throughout the training. However, at the beginning of the training, the distribution of actions is not correlated with the actions selected at the end. The results showed that the agent uses different flight paths by using different actions to catch the target drone in different episodes and different models. Finally, the generation of a saliency map is investigated to identify the critical regions in an input image which influences the predictions made by the DQN agent by evaluating the gradients of the model’s output with respect to both the image and scalar inputs.
CitationCetin, E.; Barrado, C.; Pastor, E. Explainability of deep reinforcement learning method with drones. A: IEEE/AIAA Digital Avionics Systems Conference. "DASC 42nd Digital Avionics Systems Conference: Barcelona, Spain, October 1-5, 2023: conference proceedings". 2023. ISBN 979-8-3503-3357-2. DOI 10.1109/DASC58513.2023.10311156. 
URIhttp://hdl.handle.net/2117/399125
DOI10.1109/DASC58513.2023.10311156
ISBN979-8-3503-3357-2
Publisher versionhttps://ieeexplore.ieee.org/document/10311156
Collections
  • ICARUS - Intelligent Communications and Avionics for Robust Unmanned Aerial Systems - Ponències/Comunicacions de congressos [175]
  • Departament d'Arquitectura de Computadors - Ponències/Comunicacions de congressos [2.052]
  View UPCommons Usage Statistics

Show full item record

FilesDescriptionSizeFormatView
3152.pdf3,562MbPDFView/Open

Browse

This CollectionBy Issue DateAuthorsOther contributionsTitlesSubjectsThis repositoryCommunities & CollectionsBy Issue DateAuthorsOther contributionsTitlesSubjects

© UPC Obrir en finestra nova . Servei de Biblioteques, Publicacions i Arxius

info.biblioteques@upc.edu

  • About This Repository
  • Metadata under:Metadata under CC0
  • Contact Us
  • Send Feedback
  • Privacy Settings
  • Inici de la pàgina