Dissertação de Mestrado
Task Offloading Optimization for UAV based Edge Computing using Reinforcement Learning
— 2025
Informações chave
Autores:
Orientadores:
Publicado em
17 de novembro de 2025
Resumo
The integration of Unmanned Aerial Vehicle (UAV)s as mobile Mobile Edge Computing (MEC) servers presents a promising solution to the latency and bandwidth challenges of modern Internet of Things (IoT) applications. However, optimizing their dynamic trajectories, limited resources, and connectivity in real- world scenarios remains a significant challenge. This research addresses these gaps by proposing a Deep Reinforcement Learning (DRL) solution within a custom, partially observable simulation environ- ment. We develop two distinct Proximal Policy Optimization (PPO) agents: a Heuristic-Assisted agent, which receives a state vector presorted by task urgency, and a Permutation-Invariant agent, which must learn to identify Ground Devices (GD) features from an unordered state. The simulation environment in- troduces a realistic wireless communication model and a novel staleness penalty to enforce exploration. Our results demonstrate that the Heuristic-Assisted agent successfully learns a sophisticated and robust ”patrol” policy, balancing exploration with exploitation to achieve a high Task Completion Ratio (TCR). Conversely, the more ambitious Permutation-Invariant agent fails to converge, adopting a suboptimal policy that prioritizes staleness minimization above all else. This failure highlights the critical difficulty of autonomous feature extraction and reward balancing in such a complex state space. We conclude that while the partially observable model and reward components are effective, future work should focus on recurrent architectures, such as Long Short-Term Memory (LSTM)s, and integrating connection choice into the agent’s action space to overcome these limitations.
Detalhes da publicação
Autores da comunidade :
Vítor Daniel de Rebelo Maçãs
ist193200
Orientadores desta instituição:
Domínio Científico (FOS)
electrical-engineering-electronic-engineering-information-engineering - Engenharia Eletrotécnica, Eletrónica e Informática
Idioma da publicação (código ISO)
eng - Inglês
Acesso à publicação:
Embargo levantado
Data do fim do embargo:
22 de outubro de 2026
Nome da instituição
Instituto Superior Técnico