Quiz aftercare with moodle's facility and discrimination indexes
Goetz T.
2020
Proceedings of the European Conference on e-Learning, ECEL
0
10.34190/EEL.20.086
An English language program at a small private liberal arts university in Northern Japan made a commitment to blended learning and discovered the advantage of moving course content online. Of the many Learning Management System platforms available, Moodle was used. Within the Moodle environment, announcements were made, attendance was tracked, forums were employed, assignments distributed, and quizzes given both in tracking learning and for formal assessment situations. Advantages: Teachers no longer had to hand correct tests and assignments. Materials were always available. Disadvantages: It was noticed that with the advent of tablets and smartphones, keyboard skills appeared to decline among the students. Within a Moodle environment, quiz feedback comes instantly. With the amount of time invested in creating and readying quizzes, how much is given when it comes to evaluating quiz effectiveness as a whole, and the questions that constitute them? Survey results show the importance of quiz aftercare. To assume that once a quiz is created, then it is fine until retirement is naive. Regarding quizzes as static accouterments within a larger syllabus will likely fall short of learner needs over time. Quizzes are dynamic and need to be maintained. There are valuable lessons to be learned from user data with regard to how well quiz items serve the whole. Such can indicate how an item measures learner accomplishment of the subject matter and how that same item functions in relation to the other items on the quiz. Once an author decides to evaluate item effectiveness, what options are there? What tools does Moodle provide? Within Moodle's Quiz Module is a Statistics platform that provides two valuable tools for item analysis: The Facility Index and the Discrimination Index. Questions from various quizzes were used to show how applying both indexes can impact quiz effectiveness and overall quality. © 2020 Academic Conferences Limited. All rights reserved.
Blended learning; Discrimination index; Facility index; Moodle; Statistics; User interface
Baldwin R., The 12 Cellphones That Changed Our World Forever, Wired, (2013); Blanco M., Ginovart M., MOODLE QUIZZES FOR ASSESSING STATISTICAL TOPICS IN ENGINERING STUDIES, (2010); Butcher P., Quiz report statistics - MoodleDocs, (2010); Cohen D., Sasson I., Online quizzes in a virtual learning environment as a tool for formative assessment, JOTSE. OmniaScience, 6, 3, pp. 188-208, (2016); Cook B. R., Babon A., Active learning through online quizzes: better learning and less (busy) work, Journal of Geography in Higher Education. Routledge, 41, 1, pp. 24-38, (2017); Fales-Williams A., Et al., A Quiz Becomes a Multidirectional Dialogue with Web-Based Instructional Tools for an Anatomical Pathology Rotation, Journal of Veterinary Medical Education, 32, 1, pp. 144-149, (2005); Gamage S. H. P. W., Et al., Optimising Moodle quizzes for online assessments, International Journal of STEM Education, 6, 1, (2019); Goetz T., How Students do online work, Google Docs, unpublished, (2019); Goetz T., Moodle Quiz Management, Google Docs, (2020); Gomez-Soberon J. M., Et al., Calibrating Questionnaires by Psychometric Analysis to Evaluate Knowledge, SAGE Open, 3, 3, (2013); History of mobile phones | What was the first mobile phone?, uSwitch Mobile Phone Deals, (2019); Assessment/Quality Test Construction/Teacher Tools/Item Analysis | Special Connections, (2000); Maarek J.-M. I., Benefits of Active Learning Embedded in Online Content Material Supporting a Flipped Classroom, 2018 ASEE Annual Conference & Exposition, (2018); Wikipedia, (2020); Silver S., The story of the original iPhone, that nobody thought was possible, AppleInsider, (2018); Stangroom J., Online Kruskal-Wallis Test Calculator, (2018); Mann-Whitney U test, (2020); Zook C., Formative vs. Summative Assessments: What's the Difference?, (2017)
Academic Conferences and Publishing International Limited
Conference paper
Scopus