Reflection for Recovery: Exam Wrappers in an Object-Oriented Software Development Course Help Struggling Students Improve Future Exam Scores
Yoder J.A.; Chenoweth S.
2020
2020 IEEE 32nd Conference on Software Engineering Education and Training, CSEE and T 2020
3
10.1109/CSEET49119.2020.9206181
Can student reflection play a beneficial role in pursuit of a career in software development? In this paper, we report on a study of the effectiveness of one reflective tool, 'exam wrappers,' for teaching a software engineering (SE) and computer science (CS) fundamentals course focused on object-oriented design and programming. In general, reflection is an area of growing interest in SE. We see it, for example, in the use of retrospectives in Scrum. Reflection is increasingly being used in the science and engineering college courses, after a long history in liberal arts. We collected exam scores for nearly a thousand (957) students who took the course. This relatively large sample of exam scores allows us to perform statistical analysis to measure effects otherwise challenging to detect. Because exam wrappers are used toward a specific, measurable end, this is one case where statistics can be used to judge the effectiveness of a type of reflection. Having a way to measure the results of this effort contributes to the science of education. We compare student performance on assessments in several ways, focusing our analysis mainly on comparisons between the terms (quarters) where these wrappers were used, and prior years when they were not used. In terms when an exam wrapper was present, our results show a greater relative improvement from the first exam to the final exam for low-scoring students than in terms when the exam wrapper was absent. This result is statistically significant and lends support to the hypothesis that exam wrappers can improve student outcomes. We discuss potential confounding factors and also the implications of this work for SE and CS course development. © 2020 IEEE.
exam wrapper; helping low-scoring students; longitudinal study; motivation; object-oriented design and programming course; reflection; statistical comparison
Humphrey W., The personal software process (PSP), Cmu Software Engineering Institute, (2000); The Role of Evidence in Teaching and Learning Teacher: Evidence + Insight + Action; Chen J., Effective and adoptable metacognitive tools, Asee, (2016); Culatta R., Zone of Proximal Development Innovative Learning Group; Silver N., Reflective pedagogies and the metacognitive turn in college teaching, Using Reflection and Metacognition to Improve Student Learning, pp. 1-17; Kegan R., Lahey L., Immunity to Change: How to Overcome It and Unlock the Potential in Yourself and Your Organization, (2009); Pintrich P., The role of metacognitive knowledge in learning, teaching, and assessing, Theory into Practice, 41, 4, pp. 219-225, (2002); Livingston J., Effects of Metacognitive Instruction on Strategy Use in College Students; Schon D., Educating the Reflective Practitioner: Toward a New Design for Teaching and Learning in the Professions, (1987); Flavell J., Wellman H., Metamemory Perspectives on the Development of Memory and Cognition, pp. 3-33, (1977); Lovett M., Make exams worth more than the grade, Using Reflection and Metacognition to Improve Student Learning: Across the Disciplines, across the Academy, 2, 1892, pp. 68-73, (2013); Stephenson B., Craig M., Zingaro D., Horton D., Heap D., Huynh E., Exam wrappers: Not a silver bullet, Acm Sigcse Technical Symposium, (2017); Badir A., Liao J., Papkov G., Oneill R., Exam wrappers, reflection and student performance in engineering mechanics-part II, Asee 2019: 2019 Asee Annual Conference & Exposition, Mechanics Division Technical Section 6; Chew K., Chen H., Ricken B., Turpin A., Sheppard S., Improving students? learning in statics skills: Using homework and exam wrappers to strengthen self-regulated learning, Asee, (2016); Bettinger E., Baker R., The Effects of Student Coaching in College: Evaluation of a Randomized Experiment in Student Mentoring, (2011); Wright G., Student-centered learning in higher education, International Journal of Teaching and Learning in Higher Education, 23, 3, pp. 92-97, (2011); McCollough M., Gremler D., Guaranteeing student satisfaction: An exercise in treating students as customers, Journal of Marketing Education, 21, 2, pp. 118-130, (1999); Eagle L., Brennan R., Are students customers? TQM and marketing perspectives, Quality Assurance in Education, 15, 1, pp. 44-60, (2007); Wass R., Harland T., Mercer A., Scaffolding critical thinking in the zone of proximal development, Higher Education Research & Development, 30, 3, pp. 317-328, (2011); Oberer B., Erkollar A., Exam wrappers: Reflecting on the study skills of freshmen in MIS, 1st International Scientific Conference: Teaching Methods for Economics and Business Scientists, pp. 62-75, (2017); Decades of Scientific Research That Started a Growth Mindset Revolution MindsetWorks; Badir A., Liao J., Kunberger T., Papkov G., Nguyen L., Exam werappers, reflection and student performance in engineering mechanics, Asee 2018: 2018 Asee Annual Conference & Exposition; Tawde M., Boccio D., Kolack K., Resolving misconceptions through student reflections, International Conference on Education and New Learning Technologies, (2016); Ridall A., Rethinking Metacognitive Intervention: A Scaffolded Exam Wrapper Strategy; Stephan A., Whisler L., Stephan E., Trogden B., Using exam wrappers in a self-directed first-year learning strategies course, Asee 2019: Asee 126th Annual Conference and Exposition
Institute of Electrical and Electronics Engineers Inc.
Conference paper
Scopus