Computer Science > Machine Learning
arXiv:2511.11703 (cs)
Abstract:Reinforcement learning (RL) in 3D environments with high-dimensional sensory input poses two major challenges: (1) the high memory consumption induced by memory buffers required to stabilise learning, and (2) the complexity of learning in partially observable Markov Decision Processes (POMDPs). This project addresses these challenges by proposing two novel input representations: SS-only and RGB+SS, both employing semantic segmentation on RGB colour images. Experiments were conducted in deathmatches of ViZDoom, utilizing perfect segmentation results for controlled evaluation. Our results showed that SS-only was able to reduce the memory consumption of m…
Computer Science > Machine Learning
arXiv:2511.11703 (cs)
Abstract:Reinforcement learning (RL) in 3D environments with high-dimensional sensory input poses two major challenges: (1) the high memory consumption induced by memory buffers required to stabilise learning, and (2) the complexity of learning in partially observable Markov Decision Processes (POMDPs). This project addresses these challenges by proposing two novel input representations: SS-only and RGB+SS, both employing semantic segmentation on RGB colour images. Experiments were conducted in deathmatches of ViZDoom, utilizing perfect segmentation results for controlled evaluation. Our results showed that SS-only was able to reduce the memory consumption of memory buffers by at least 66.6%, and up to 98.6% when a vectorisable lossless compression technique with minimal overhead such as run-length encoding is applied. Meanwhile, RGB+SS significantly enhances RL agents’ performance with the additional semantic information provided. Furthermore, we explored density-based heatmapping as a tool to visualise RL agents’ movement patterns and evaluate their suitability for data collection. A brief comparison with a previous approach highlights how our method overcame common pitfalls in applying semantic segmentation in 3D environments like ViZDoom.
| Comments: | Master’s Thesis at the University of Edinburgh (2024) |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Robotics (cs.RO) |
| ACM classes: | I.2.10; I.2.9 |
| Cite as: | arXiv:2511.11703 [cs.LG] |
| (or arXiv:2511.11703v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2511.11703 arXiv-issued DOI via DataCite |
Submission history
From: Jin Huang [view email] [v1] Wed, 12 Nov 2025 14:28:46 UTC (7,386 KB)
Current browse context:
cs.LG
Change to browse by:
export BibTeX citation