APBench and benchmarking large language model performance in fundamental astrodynamics problems for space engineering.

ABSTRACT: The problem-solving abilities of Large Language Models (LLMs) have become a major focus of research across various STEM fields, including mathematics and physics. Substantial progress has been made in both measuring and enhancing these abilities. Among the multitude of ways to advance space engineering research, one promising direction is the application of LLMs and foundational models in aiding in solving Ph.D. level research problems. To understand the full potential of LLMs in astrodynamics, we have developed the first Astrodynamics Problems Benchmark (APBench) to evaluate the capabilities of LLMs in this field. We crafted for the first time a collection of questions and answers that range a wide variety of subfields in astrodynamics, astronautics, and space engineering. On top of this

SUBMITTER: Wu D 

PROVIDER: S-EPMC11885820 | biostudies-literature | 2025 Mar

REPOSITORIES: biostudies-literature