Design of deep Q-networks for transfer time prediction of spacecraft orbit-raising

dc.contributor.authorMughal, Ali Hassaan
dc.date.accessioned2022-04-05T14:08:51Z
dc.date.available2022-04-05T14:08:51Z
dc.date.graduationmonthMay
dc.date.issued2022
dc.description.abstractRecently, there has been a surge in use of electric propulsion to transfer satellites to the geostationary Earth orbit (GEO). Traditionally, the transfer times to reach GEO using all electric propulsion are obtained by solving challenging trajectory optimization problems, whose solution rely on numerical schemes that are not only computationally intensive, but also lack automated implementation capabilities. This naturally creates a hindrance to their incorporation within Deep Reinforcement Learning (DRL) framework, which combines Reinforcement Learning (RL) and Deep Learning to solve trajectory planning problems in near real-time. The operation of DRL, as typically used in trajectory planning, relies on a Q-value. In the electric orbit-raising problem under consideration in this thesis, this Q-Value requires computation of transfer time in near real-time to have practical DRL training times. In our work, this Q-value is predicted by a set of deep neural networks (DNNs) instead of solving traditional optimization problems. This thesis aims at designing a set of DNNs that can serve as a Q-value (transfer time) predictor for different orbit-raising mission scenarios. To this end, we investigate different architectures for DNNs to determine the optimal DNN configuration that can predict the transfer time for each of the mission scenarios. Experimental results indicate that our designed DNNs can predict the transfer time for different scenarios with an accuracy of over 99%. We also compare the results from our designed DNNs with the contemporary Machine Learning (ML) algorithms, such as Support Vector Machine (SVM), Random Forest (RF), Decision Tree (DT) for regression. Experimental results indicate that our best-performing DNNs can provide an improvement in mean error of transfer time prediction of up to 14.05× for non-planar transfers and up to 254× for planar transfers.
dc.description.advisorArslan Munir
dc.description.degreeMaster of Science
dc.description.departmentDepartment of Computer Science
dc.description.levelMasters
dc.description.sponsorshipThis work was supported in part by the National Aeronautics and Space Administration (NASA), through the grant NASA-20-2020EPSCoR-0017. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the NASA.
dc.identifier.urihttps://hdl.handle.net/2097/42061
dc.language.isoen_US
dc.publisherKansas State University
dc.rights.uri© the author. This Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s).
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/
dc.subjectMachine learning
dc.subjectSpacecraft orbit raising
dc.subjectClassical machine learning
dc.titleDesign of deep Q-networks for transfer time prediction of spacecraft orbit-raising
dc.typeThesis

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
AliHassaanMughal2022.pdf
Size:
1.02 MB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.62 KB
Format:
Item-specific license agreed upon to submission
Description: