Automatic Quiz Generation Mechanism for Multiple Choices Question by Applying Ontological Data

Authors

  • ศศิธร หนูทอง College of Computing, Prince of Songkla University, Phuket Campus
  • สุนทร วิทูสุรพจน์ Department of Computer Engineering, Faculty of Engineering, Prince of Songkla University
  • เบญจพร หนูทอง Regional Medical Sciences Center 11/1 Phuket, Department of Medical Sciences

Keywords:

Automatic quiz generation, Multiple choices question, Ontology, Semantic similarity, Semantic relatedness

Abstract

       Quiz generation system is a very important system in education. This helps to assess students' understanding of the lesson, and also allows users to easily and quickly create the test. However, the existing system of creating quizzes has limitation to the ability for creating a question, which is also entered by the user themself. As a result, it takes time to create a test for a long time. Therefore, this research aims to provide a mechanism for the creation of automatic quiz generation mechanism for multiple choices question by applying ontological information to assess the difficulty level of the questions. The hybrid similarity was measured using a combination of semantic similarity, semantic relatedness, and property values to determine the difficulty level of the question. Then, the proposed mechanism was implemented using the RDFaCE tool and PHP program to create an interface for user input and displaying results in the creation of quiz based on user-defined data. In addition, the proposed mechanism was validated to confirm the accuracy of the mechanism’s performance. By comparison, the difficulty score derived from the proposed mechanism and the item response theory. The evaluation results were consistent with 80 %. Therefore, the proposed automatic quiz generation mechanism can be applied as a tool to quickly and easily create quizzes and reduce the time of the work, including the creation of an increasing number of multiple choices question which are diverse. This method can also determine the difficulty level of the questions as required.

References

[1] Fattoh IE, Aboutabl AE, Haggag MH. Semantic Attributes Model for Automatic Generation of Multiple Choice Questions. Int J Comput Appl 2014; 103(1):18–24.

[2] Lin C, Liu D, Pang W, et al. Automatically Predicting Quiz Difficulty Level Using Similarity Measures. K-CAP 2015. The 8th International Conference on Knowledge Capture; 2015 Oct 7-10; Palisades, NY, USA. New York: ACM; 2015. P. 1:1–1:8.

[3] Rey GÁ, Celino I, Alexopoulos P, et al. Semi-Automatic Generation of Quizzes and Learning Artifacts from Linked Data. The 2nd International Workshop on Learning and Education with the Web of Data at the World Wide Web Conference 2012 (WWW2012); 2012 Apr 17; Lyon, France. New York: ACM; 2012. P. 1-3.

[4] งามนิจ อาจอินทร์. เทคโนโลยีเว็บแบบสื่อความหมาย(Semantic Web Technologies). พิมพ์ครั้งที่ 3. ขอนแก่น: คลังนานาวิทยา; 2557.

[5] Elavarasi S, Akilandeswari J, Menaga K. A Survey on Semantic Similarity Measure. Int J Res in Advent Technol. 2014; 2:389–98.

[6] Abdelrahman AMB, Kayed A. A Survey on Semantic Similarity Measures between Concepts in Health Domain. Am J Comput Math. 2015; 5(2):204-14.

[7] Gan M, Dou X, Jiang R. From Ontology to Semantic Similarity: Calculation of Ontology-Based Semantic Similarity. Sci World J. 2013; 2013:1-11.

[8] Meng L, Huang R, Gu J. A Review of Semantic Similarity Measures in WordNet. Int J Hybrid Inf Technol. 2013; 6(1):1–12.

[9] Agile Knowledge Engineering and Semantic Web (AKSW). [Internet]. Germany: RDFaCE; 2018 [cited 2018 Aug 26]; [about 3 screens]. Available from: https://aksw.org/Projects/RDFaCE .html

[10] Nuthong S, Witosurapot S. Enabling Fine Granularity of Difficulty Ranking Measure for Automatic Quiz Generation. The 9th International Conference on Information Technology and Electrical Engineering (ICITEE 2017); 2017 Oct 12-13; Centara Grand Beach Resort Phuket. Bangkok: The University; 2017. P. 227-32.

[11] ศศิธร หนูทอง, สุนทร วิทูสุรพจน์. การปรับปรุงกลไกทำงานแบบชาญฉลาด สำหรับการสร้างแบบคำถามโดยอัตโนมัติ. การประชุมทางวิชาการระดับชาติด้านเทคโนโลยีคอมพิวเตอร์และระบบสารสนเทศประยุกต์ ครั้งที่ 12; 19-21 ก.ค. 2560; มหาวิทยาลัยเทคโนโลยีราชมงคลกรุงเทพ. กรุงเทพฯ: มหาวิทยาลัย; 2560. น. 190-4.

[12] World Wide Web Consortium (W3C). [Internet]. Beihang: SPARQL Query Language for RDF; 2013 [cited 2018 Aug 26]; [about 87 screens]. Available from: https://www.w3.org/TR/rdf-sparql-query

[13] php.net [Internet]: The PHP Group; 2018 [cited 2018 Aug 26]. Available from: https://www.php.net

[14] Kaur J, Gupta V. Effective Question Answering Techniques and their Evaluation Metrics. Int J Comput Appl. 2013; 65(12):30-7.

[15] สังวรณ์ งัดกระโทก. ทฤษฎีการตอบข้อสอบ Item Response Theory [อินเทอร์เน็ต]. กรุงเทพฯ: สำนักงานคณะกรรมการวิจัยแห่งชาติ; 2556 [เข้าถึงเมื่อ 26 ส.ค. 2561]. จาก: https://www.priv.nrct.go.th/ewt_dl.php ?nid=1057

Downloads

Published

2019-06-25

How to Cite

[1]
หนูทอง ศ., วิทูสุรพจน์ ส., and หนูทอง เ., “Automatic Quiz Generation Mechanism for Multiple Choices Question by Applying Ontological Data”, UTK RESEARCH JOURNAL, vol. 13, no. 1, pp. 156–166, Jun. 2019.

Issue

Section

Research Articles