Towards Using Reinforcement Learning for Autonomous Docking of Unmanned Surface Vehicles
MetadataShow full item record
Providing full autonomy to Unmanned Surface Vehicles (USV) is a challenging goal to achieve. Autonomous docking is a subtask that is particularly difficult. The vessel has to distinguish between obstacles and the dock, and the obstacles can be either static or moving. This paper developed a simulator using Reinforcement Learning (RL) to approach the problem. We studied several scenarios for the task of docking a USV in a simulator environment. The scenarios were defined with different sensor inputs and start-stop procedures but a simple shared reward function. The results show that the system solved the task when the IMU (Inertial Measurement Unit) and GNSS (Global Navigation Satellite System) sensors were used to estimate the state, despite the simplicity of the reward function.
Holen, Martin; Ruud, Else-Line Malene; Warakagoda, Narada Dilp; Granmo, Ole-Christoffer; Engelstad, Paal E.; Knausgård, Kristian Muri. Towards Using Reinforcement Learning for Autonomous Docking of Unmanned Surface Vehicles. I: Engineering Applications of Neural Networks. EANN 2022. Communications in Computer and Information Science. Springer Nature 2022 ISBN 978-3-031-08223-8