Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Advertisement

Scientific Reports
  • View all journals
  • Search
  • My Account Login
  • Content Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • RSS feed
  1. nature
  2. scientific reports
  3. articles
  4. article
Enhancing educational assessment through automated question classification using a RoBERTa-based ensemble model
Download PDF
Download PDF
  • Article
  • Open access
  • Published: 23 March 2026

Enhancing educational assessment through automated question classification using a RoBERTa-based ensemble model

  • Muhammad Hamid1,
  • Saadia Malik2,
  • Muhammad Saleem3,
  • Ammar T. Zahary4 &
  • …
  • Ines Hilali Jaghdam5 

Scientific Reports , Article number:  (2026) Cite this article

  • 505 Accesses

  • Metrics details

We are providing an unedited version of this manuscript to give early access to its findings. Before final publication, the manuscript will undergo further editing. Please note there may be errors present which affect the content, and all legal disclaimers apply.

Subjects

  • Computational biology and bioinformatics
  • Engineering
  • Mathematics and computing

Abstract

Classifying exam questions using Bloom’s Taxonomy is a critical task in education. However, performing this classification manually is often inefficient, prone to subjective errors and demands significant time from educators. To address this challenge, this study proposes and evaluates a robust system using state-of-the-art Deep Learning (DL) techniques. This system uses the pre-trained language model RoBERTa to understand the meaning of text and turn it into useful features. These features are then used by three different types of models to classify the text: a Gated Recurrent Unit (GRU), a Long Short-Term Memory (LSTM) and a Convolutional Neural Network (CNN). To further enhance performance, a Weighted Ensemble model is implemented, which intelligently combines the predictions of the three models. The models were trained and evaluated using a publically available dataset. Experimental results show that all models demonstrate an outstanding efficacy and the weighted ensemble model outperforms all individual models. The ensemble model established a new standard of performance at 92.37% accuracy, macro F1-Score of 0.923 and an Area Under the Curve (AUC) of 0.992. Crucially, the marginal gain over the best single model was confirmed to be statistically significant via McNemar’s Test (P = 0.048). This paper presents a scalable system that will enable the automatic assessment of the objects in real-time with high accuracy that could ensure the objects in the assessment are not biased, would significantly reduce efforts put in by teachers and enhance the overall quality of educational practices.

Similar content being viewed by others

Speech emotion recognition with light weight deep neural ensemble model using hand crafted features

Article Open access 07 April 2025

The usage of artificial Intelligence-empowered text analysis model with convolutional neural network in english reading

Article Open access 28 November 2025

Revolutionising English language education:empowering teachers with BERT-LSTM-driven pedagogical tools

Article Open access 14 August 2025

Data availability

The datasets generated and/or analyzed during the current study are available in the KAGGLE repository, [ [https://www.kaggle.com/datasets/vijaydevane/blooms-taxonomy-dataset](https:/www.kaggle.com/datasets/vijaydevane/blooms-taxonomy-dataset) ].

References

  1. Ebrahimi, M., Momen, A. & Hassan, A. M. Importance and Implications of Theory of Bloom’s Taxonomy in Different Fields of Education, in ICETIS 2022, LNNS 573, 515–525, (2023).

  2. Nurmatova, S. & Altun, M. A Comprehensive Review of Bloom’s Taxonomy Integration to Enhancing Novice EFL Educators’ Pedagogical Impact. Arab. World Engl. J. 14 (3), 380–388 (2023).

    Google Scholar 

  3. Banujan, K., Kumara, S., Prasanth, S. & Ravikumar, N. Revolutionising Educational Assessment: Automated Question Classification using Bloom’s Taxonomy and Deep Learning Techniques – A Case Study on Undergraduate Examination Questions. Int. J. Educ. Dev. using Inform. Communication Technol. (IJEDICT). 19 (3), 259–278 (2023).

    Google Scholar 

  4. Pallipuram, V., Mammadov, G., Ho, B., Dhulipala, M. & Dziallas, S. Camelot: A Council of Machine Learning Strategies to Enhance Teaching. In Machine Learning in Educational Sciences (ed. Khine, M. S.) 47–84 (Springer Nature, 2024).

    Google Scholar 

  5. Chanaa, A. & El Faddouli, N. A cognitive level evaluation method based on machine learning approach and Bloom of taxonomy for online assessments. J. Educ. Learn. (EduLearn). 18 (2), 553–560 (May 2024).

  6. Asthana, P., Mishra, S. & Hazela, B. Text Identification for Questions Generation According to Bloom’s Taxonomy Using Natural Language Processing, in Machine Learning in Educational Sciences, M. S. Khine, Ed. Singapore: Springer Nature, ch. 16. (2024).

  7. Laddha, M. D., Lokare, V. T., Kiwelekar, A. W. & Netak, L. D. Classifications of the Summative Assessment for Revised Bloom’s Taxonomy by using Deep Learning. Int. J. Eng. Trends Technol. 69 (3), 211–218 (2021).

    Google Scholar 

  8. Mudkanna, A. K., Gavhane, S. & Pagare, R. A Novel Approach using RGB Architecture for Bloom’s Taxonomy Classification, in AI and IoT for Sustainable Development in the 4th Industrial Revolution, (eds Shandilya, S. K., Nayak, S. K., Tripathy, S. K. & Shaw, A. K.) CRC, 461–471 (2024).

  9. Singh, S., Bhatt, M. & Kumar, B. A GNN-Based Approach for Automatic Classification of Exam Questions Using Revised Bloom’s Taxonomy, in International Conference on Intelligent Systems for Communication, IoT and Security (ICISCoIS), 2025., (2025).

  10. Gonsalves, C. Generative AI’s Impact on Critical Thinking: Revisiting Bloom’s Taxonomy. J. Mark. Educ. https://doi.org/10.1177/02734753241305980 (2024).

    Google Scholar 

  11. Al-Kasasbeh, M., Khair, M., Al-Dari, A. & Al-Zyoud, A. Enhancing Intrusion Detection Systems Using a Hybrid Deep Learning Model with Advanced Feature Engineering. IEEE Access. 11, 107567–107581. https://doi.org/10.1109/ACCESS.2023.3320641 (2023).

    Google Scholar 

  12. Goodfellow, I. & Bengio, Y. Aaron Courville, and Yoshua Bengio. In Deep learning Vol. 1 (MIT Press, 2016), pp. 1-800.

    Google Scholar 

Download references

Funding

Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2026R845), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Author information

Authors and Affiliations

  1. Department of Computer Science, Government College Women University, Sialkot, Pakistan

    Muhammad Hamid

  2. Faculty of Computing and Information Technology Rabigh, King Abdulaziz University, Jeddah, Saudi Arabia

    Saadia Malik

  3. Faculty of Engineering, King Abdulaziz University, Rabigh, Jeddah, Saudi Arabia

    Muhammad Saleem

  4. Department of IT, Sana’a University, Sana’a, YE, Yemen

    Ammar T. Zahary

  5. Department of Computer Science and Information Technology, Applied College, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh, 11671, Saudi Arabia

    Ines Hilali Jaghdam

Authors
  1. Muhammad Hamid
    View author publications

    Search author on:PubMed Google Scholar

  2. Saadia Malik
    View author publications

    Search author on:PubMed Google Scholar

  3. Muhammad Saleem
    View author publications

    Search author on:PubMed Google Scholar

  4. Ammar T. Zahary
    View author publications

    Search author on:PubMed Google Scholar

  5. Ines Hilali Jaghdam
    View author publications

    Search author on:PubMed Google Scholar

Contributions

Muhammad Hamid conceived the study, designed the methodology, performed data preprocessing, model development and experimental analysis, and drafted the main manuscript. Saadia Malik contributed to data curation, validation and interpretation of results. Muhammad Saleem assisted in deep learning architecture design, result analysis and critical review of the manuscript. Ammar T. Zahary supervised the research, contributed to conceptualization and methodological refinement, reviewed. Ines Hilali Jaghdam helped refine the methodology and results, proofread the manuscript, and assisted in addressing the reviewers’ comments. All authors reviewed and approved the final manuscript.

Corresponding authors

Correspondence to Muhammad Hamid or Ammar T. Zahary.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hamid, M., Malik, S., Saleem, M. et al. Enhancing educational assessment through automated question classification using a RoBERTa-based ensemble model. Sci Rep (2026). https://doi.org/10.1038/s41598-026-45486-1

Download citation

  • Received: 19 December 2025

  • Accepted: 19 March 2026

  • Published: 23 March 2026

  • DOI: https://doi.org/10.1038/s41598-026-45486-1

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Keywords

  • Automated Question Classification
  • Bloom’s Taxonomy
  • Educational Assessment
  • RoBERTa
  • Ensemble Learning
Download PDF

Advertisement

Explore content

  • Research articles
  • News & Comment
  • Collections
  • Subjects
  • Follow us on Facebook
  • Follow us on X
  • Sign up for alerts
  • RSS feed

About the journal

  • About Scientific Reports
  • Contact
  • Journal policies
  • Guide to referees
  • Calls for Papers
  • Editor's Choice
  • Journal highlights
  • Open Access Fees and Funding

Publish with us

  • For authors
  • Language editing services
  • Open access funding
  • Submit manuscript

Search

Advanced search

Quick links

  • Explore articles by subject
  • Find a job
  • Guide to authors
  • Editorial policies

Scientific Reports (Sci Rep)

ISSN 2045-2322 (online)

nature.com footer links

About Nature Portfolio

  • About us
  • Press releases
  • Press office
  • Contact us

Discover content

  • Journals A-Z
  • Articles by subject
  • protocols.io
  • Nature Index

Publishing policies

  • Nature portfolio policies
  • Open access

Author & Researcher services

  • Reprints & permissions
  • Research data
  • Language editing
  • Scientific editing
  • Nature Masterclasses
  • Research Solutions

Libraries & institutions

  • Librarian service & tools
  • Librarian portal
  • Open research
  • Recommend to library

Advertising & partnerships

  • Advertising
  • Partnerships & Services
  • Media kits
  • Branded content

Professional development

  • Nature Awards
  • Nature Careers
  • Nature Conferences

Regional websites

  • Nature Africa
  • Nature China
  • Nature India
  • Nature Japan
  • Nature Middle East
  • Privacy Policy
  • Use of cookies
  • Legal notice
  • Accessibility statement
  • Terms & Conditions
  • Your US state privacy rights
Springer Nature

© 2026 Springer Nature Limited

Nature Briefing AI and Robotics

Sign up for the Nature Briefing: AI and Robotics newsletter — what matters in AI and robotics research, free to your inbox weekly.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing: AI and Robotics