Skip to main navigation Skip to search Skip to main content

Meta Reinforcement Learning for Strategic IoT Deployments Coverage in Disaster-Response UAV Swarms

  • Marwan Dhuheir*
  • , Aiman Erbad*
  • , Ala Al-Fuqaha*
  • *Corresponding author for this work
    • Hamad bin Khalifa University

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    Abstract

    In the past decade, Unmanned Aerial Vehicles (UAVs) have grabbed the attention of researchers in academia and industry for their potential use in critical emergency applications, such as providing wireless services to ground users and collecting data from areas affected by disasters, due to their advantages in terms of maneuverability and movement flexibility. The UAVs' limited resources, energy budget, and strict mission completion time have posed challenges in adopting UAVs for these applications. Our system model considers a UAV swarm that navigates an area collecting data from ground IoT devices focusing on providing better service for strategic locations and allowing UAVs to join and leave the swarm (e.g., for recharging) in a dynamic way. In this work, we introduce an optimization model with the aim of minimizing the total energy consumption and provide the optimal path planning of UAVs under the constraints of minimum completion time and transmit power. The formulated optimization is NP-hard making it not applicable for real-time decision making. Therefore, we introduce a light-weight meta-reinforcement learning solution that can also cope with sudden changes in the environment through fast convergence. We conduct extensive simulations and compare our approach to three state-of-the-art learning models. Our simulation results prove that our introduced approach is better than the three state-of-the-art algorithms in providing coverage to strategic locations with fast convergence.

    Original languageEnglish
    Title of host publicationGLOBECOM 2023 - 2023 IEEE Global Communications Conference
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages6159-6164
    Number of pages6
    ISBN (Electronic)9798350310900
    DOIs
    Publication statusPublished - 2023
    Event2023 IEEE Global Communications Conference, GLOBECOM 2023 - Kuala Lumpur, Malaysia
    Duration: 4 Dec 20238 Dec 2023

    Publication series

    NameProceedings - IEEE Global Communications Conference, GLOBECOM
    ISSN (Print)2334-0983
    ISSN (Electronic)2576-6813

    Conference

    Conference2023 IEEE Global Communications Conference, GLOBECOM 2023
    Country/TerritoryMalaysia
    CityKuala Lumpur
    Period4/12/238/12/23

    Keywords

    • Optimization
    • QoS
    • UAVs
    • UAVs positions
    • energy consumption
    • meta-reinforcement learning
    • reinforcement learning
    • strategic locations

    Fingerprint

    Dive into the research topics of 'Meta Reinforcement Learning for Strategic IoT Deployments Coverage in Disaster-Response UAV Swarms'. Together they form a unique fingerprint.

    Cite this