کنفرانس بین المللی محاسبات نرم

صفحه اصلی / ششمین کنفرانس بین المللی محاسبات نرم

Persian Scientific Question Answering: A Transformer-based Approach with a Domain-Specific Dataset

نویسندگان :

Hediyeh Mosafer¹ Seyyed Abdorreza Hesam Mohseni²

1- دانشگاه گیلان - دانشکده فنی و مهندسی شرق گیلان 2- دانشگاه گیلان - دانشکده فنی و مهندسی شرق گیلان

کلمات کلیدی :

Persian QA،Transformers،Extractive QA،ParsBERT،Question Answering،NLP

چکیده :

The rapid increase in Persian scientific publications has created a growing need for intelligent systems capable of retrieving precise information from academic texts. This study presents a transformer-based Question Answering (QA) model specifically designed for Persian scientific articles. The proposed system constructs a SQuAD-style extractive QA dataset and fine-tunes the HooshvareLab bert-fa-base-uncased model for Persian QA tasks. The model is trained on an existing general-purpose Persian QA dataset and evaluated on a custom domain-specific test set of 100 QA pairs derived from peer-reviewed Persian scientific abstracts. The workflow includes dataset preprocessing, tokenization, model fine-tuning, and evaluation using standard metrics such as EM and F1 score. Experimental results demonstrate that the fine-tuned model achieves a validation F1 of 48.45% and EM of 29.30%, while attaining an F1 of 40.75% and EM of 20.00% on unseen domain-specific test data. These results highlight the model’s ability to capture contextual and semantic relationships in Persian scientific texts, despite challenges such as limited annotated data and morphological complexity. The findings suggest that domain-specific evaluation, combined with appropriate fine-tuning, can significantly enhance the performance of Persian QA systems. This work provides a foundational step toward developing advanced Persian-language QA systems for academic and research applications.