Math problem solving is a fundamental part of the modern era, and artificial intelligence (AI) driven mathematical reasoning has become an essential part of data work. In this literature review, we explore the diverse array of datasets intended to improve AI models’ capacity to solve mathematical word problems. These datasets not only provided diverse problem sets but also served as benchmarks for evaluating the performance of various deep learning models, including recurrent neural networks (RNNs) and graph-based models. The datasets, particularly GSM8K, posed challenges that even the most sophisticated transformer models struggled to overcome, setting a new standard for the study of AI systems in math problem solving. This literature review aims to provide a comprehensive overview of the evolving landscape of mathematical problem solving, paving the way for future advances in AI-driven mathematical reasoning.