ChatGPT’s performance in university admissions tests in mathematics
Angel Udias 1 2 * , Antonio Alonso-Ayuso 1 , César Alfaro 1 , María Jesús Algar 1 , Marina Cuesta 1 , Alberto Fernández-Isabel 1 , Javier Gómez 1 , Carmen Lancho 1 , Emilio L. Cano 1 , Isaac Martín de Diego 1 , Felipe Ortega 1
More Detail
1 DSLAB Research group, Universidad Rey Juan Carlos, Móstoles, Madrid, SPAIN2 European Commission, Joint Research Center, Ispra (VA), ITALY* Corresponding Author

Abstract

This study comprehensively analyses the performance of the artificial intelligence (AI)-based language model, ChatGPT 4.0, in solving Spanish university admission tests in applied mathematics in social sciences. Using exams taken at public universities in Madrid, we have analysed ChatGPT’s answers and concluded that its performance varies significantly across different areas of mathematics, excelling in probability and statistics exercises, but performing significantly worse in algebra and calculus. When compared with students, ChatGPT clearly outperforms them in all areas except algebra. Despite the model’s limitations in interpreting complex mathematical ideas, in some cases its responses are positively surprising, indicating its potential as a valuable tool in certain mathematical problem-solving scenarios. Our results suggest significant potential for the introduction of these AI-based systems into the classroom. Despite the progress made, much remains to be explored regarding the efficient integration of chatbots into course development and the subsequent impact on education.

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Article Type: Research Article

INT ELECT J MATH ED, Volume 19, Issue 4, November 2024, Article No: em0795

https://doi.org/10.29333/iejme/15517

Publication date: 24 Oct 2024

Article Views: 846

Article Downloads: 846

Open Access References How to cite this article