Design of deep Q-networks for transfer time prediction of spacecraft orbit-raising
dc.contributor.author | Mughal, Ali Hassaan | |
dc.date.accessioned | 2022-04-05T14:08:51Z | |
dc.date.available | 2022-04-05T14:08:51Z | |
dc.date.graduationmonth | May | |
dc.date.issued | 2022 | |
dc.description.abstract | Recently, there has been a surge in use of electric propulsion to transfer satellites to the geostationary Earth orbit (GEO). Traditionally, the transfer times to reach GEO using all electric propulsion are obtained by solving challenging trajectory optimization problems, whose solution rely on numerical schemes that are not only computationally intensive, but also lack automated implementation capabilities. This naturally creates a hindrance to their incorporation within Deep Reinforcement Learning (DRL) framework, which combines Reinforcement Learning (RL) and Deep Learning to solve trajectory planning problems in near real-time. The operation of DRL, as typically used in trajectory planning, relies on a Q-value. In the electric orbit-raising problem under consideration in this thesis, this Q-Value requires computation of transfer time in near real-time to have practical DRL training times. In our work, this Q-value is predicted by a set of deep neural networks (DNNs) instead of solving traditional optimization problems. This thesis aims at designing a set of DNNs that can serve as a Q-value (transfer time) predictor for different orbit-raising mission scenarios. To this end, we investigate different architectures for DNNs to determine the optimal DNN configuration that can predict the transfer time for each of the mission scenarios. Experimental results indicate that our designed DNNs can predict the transfer time for different scenarios with an accuracy of over 99%. We also compare the results from our designed DNNs with the contemporary Machine Learning (ML) algorithms, such as Support Vector Machine (SVM), Random Forest (RF), Decision Tree (DT) for regression. Experimental results indicate that our best-performing DNNs can provide an improvement in mean error of transfer time prediction of up to 14.05× for non-planar transfers and up to 254× for planar transfers. | |
dc.description.advisor | Arslan Munir | |
dc.description.degree | Master of Science | |
dc.description.department | Department of Computer Science | |
dc.description.level | Masters | |
dc.description.sponsorship | This work was supported in part by the National Aeronautics and Space Administration (NASA), through the grant NASA-20-2020EPSCoR-0017. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the NASA. | |
dc.identifier.uri | https://hdl.handle.net/2097/42061 | |
dc.language.iso | en_US | |
dc.publisher | Kansas State University | |
dc.rights.uri | © the author. This Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). | |
dc.rights.uri | http://rightsstatements.org/vocab/InC/1.0/ | |
dc.subject | Machine learning | |
dc.subject | Spacecraft orbit raising | |
dc.subject | Classical machine learning | |
dc.title | Design of deep Q-networks for transfer time prediction of spacecraft orbit-raising | |
dc.type | Thesis |