Concurrent validity of standards-based assessments of teacher candidate readiness for licensure
Waggoner J.; Carroll J.B.
2014
SAGE Open
2
10.1177/2158244014560545
This study examined the concurrent validity of assessments based on a prescribed set of preparation standards of teacher candidate competency. Participants were 94 candidates from a small, comprehensive liberal arts university in the northwest. Teacher candidate performance measures included a Summary Student Teaching Evaluation, an evaluation of a Teacher Work Sample (TWS), learning gain scores from P-12 students during a unit of instruction completed as part of the TWS, and State licensure content area tests. Measures of student teaching showed strong correlations internally and moderate correlations with the TWS evaluation. Measures of the TWS showed moderate correlations internally. Learning gain scores and content area test scores were weakly correlated with all other measures of candidate performance. The absence of moderate or strong correlations among different assessments suggests they are measuring different constructs supporting the use of a comprehensive set of standards-based assessments to determine candidates’ readiness for licensure. © The Author(s) 2014.
Assessment validity; Candidate assessment; Program improvement
Amrein-Beardsley A., Methodological concerns about the education value-added assessment system, Educational Researcher, 37, pp. 65-75, (2008); Ayers J.B., Another look at the concurrent and predictive validity of the National Teacher Examinations, The Journal of Educational Research, 81, pp. 133-137, (1988); Barrett J., Evaluation of student teachers, (1986); Bill and Melinda Gates Foundation, Learning about teaching: Initial findings from the measures of effective teaching project, (2010); Carroll J.B., Waggoner J., A national perspective on teacher education clinical experience design, Paper presented at the annual conference of the American Association of Colleges of Teacher Education, (2010); Carroll J.B., Waggoner J., The relationship of candidate subject-matter knowledge and clinical experience assessments, Paper presented at the annual conference of the American Educational Research Association, (2011); Caskey M.M., Peterson K.D., Temple J.B., Complex admission selection procedures for a graduate preservice teacher education program, Teacher Education Quarterly, 28, 4, pp. 7-21, (2001); Cohen J., Cohen P., Applied multiple regression/correlation analysis for the behavioral sciences, (1983); Council for the Accreditation of Educator Preparation, CAEP accreditation standards and evidence: Aspirations for educator preparation, (2013); Council for the Accreditation of Educator Preparation, CAEP evidence guide version 1.0, (2014); Council of Chief State School Officers, InTASC model core teaching standards, (2011); D'Agostino J.V., Powers S.J., Predicting teacher performance with test scores and grade point average: A metaanalysis, American Educational Research Journal, 46, pp. 146-182, (2009); Danielson C., Enhancing professional practice: A framework for teaching, (2007); Darling-Hammond L., Reforming teacher preparation and licensing: Debating the evidence, The Teachers College Record, 102, 1, pp. 28-56, (2000); Darling-Hammond L., Recognizing and enhancing teacher effectiveness, The International Journal of Educational and Psychological Assessment, 3, 1, pp. 1-24, (2009); Darling-Hammond L., Evaluating teacher effectiveness: How teacher performance assessments can measure and improve teaching, (2010); Denner P.R., Norman A.D., Salzman S.A., Pankratz R.S., Connecting teaching performance to student achievement: A generalizability and validity study of the renaissance teacher work sample assessment, (2003); Denner P.R., Norman A.D., Salzman S.A., Pankratz R.S., Evans S., The renaissance partnership teacher work sample: Evidence supporting score generalizability, validity, and quality of student learning assessment, ATE Yearbook, 12, pp. 23-56, (2004); Fallon D., The buffalo upon the chimneypiece: The value of evidence, Journal of Teacher Education, 57, pp. 139-154, (2006); Goe L., Bell C., Little O., Approaches to evaluating teacher effectiveness: A research synthesis, (2008); Greenberg J., Walsh K., McKee A., 2014 teacher prep review, (2014); Hill H.C., Kapitula L., Umland K., A validity approach to evaluating teacher value-added scores, American Educational Research Journal, 48, pp. 794-831, (2011); Kane T.J., Staiger D.O., Gathering feedback for teaching: Combining high quality observations with student surveys and achievement gains, (2012); Keselman H.J., Cribbie R., Holland B., Controlling the rate of Type I error over a large set of statistical tests, British Journal of Mathematical and Statistical Psychology, 55, pp. 27-39, (2002); Kline P., Handbook of psychological testing, (2013); Kraft N.P., Standards in teacher education: A critical analysis of NCATE, INTASC, and NBPTS, (2001); McCaffrey D.F., Lockwood J.R., Koretz D., Louis T.A., Hamilton L., Models for value-added modeling of teacher effects, Journal of Educational and Behavioral Statistics, 29, 1, pp. 67-101, (2004); Naizer G.L., Validity and reliability issues of performanceportfolio assessment, Action in Teacher Education, 18, 4, pp. 1-9, (1997); National Council for the Accreditation of Teacher Education, It’s all about student learning: Assessing teacher candidates’ ability to impact P-12 students, (2008); National Council for the Accreditation of Teacher Education, Unit standard I, (2008); No Child Left Behind Act of 2001, 20, (2008); Nweke W.C., Hall T.R., Evaluating cut-scores on two certification tests: How well do decisions based on cut-scores match teacher-and principal-reported ratings of competence in the classroom?, Paper presented at the annual conference of the American Educational Research Association, (1999); Oregon Administrative Rules, Teacher Standards and Practices Commission, Standards for Program Approval, Evidence of Effectiveness, (2012); Oregon Administrative Rules, Teacher Standards and Practices Commission, Standards for Program Approval, Objectives for Initial Teacher Licensure, (2012); Pearson Publishing, Education teacher performance assessment (edTPA), (2013); Pecheone R.L., Chung R.R., Evidence in teacher education: The Performance Assessment for California Teachers (PACT), Journal of Teacher Education, 57, pp. 22-36, (2006); Stacy B., Guarino C., Review of gathering feedback for teaching: Combining high-quality observation with student surveys and achievement gains, (2012); Stobaugh R.R., Tassell J.L., Norman A.D., Improving preservice teacher preparation through the teacher work sample: Exploring assessment and analysis of student learning, Action in Teacher Education, 32, pp. 39-53, (2010); Waggoner J., Carroll J.B., Merk H., Weitzel B.N., Teacher candidates’ impact on student learning: 18,000 P-12 students over five years, (2014); Warner R.M., Applied statistics: From bivariate through multivariate techniques, (2013); Wineburg M.S., Evidence in teacher preparation: Establishing a framework for accountability, Journal of Teacher Education, 57, pp. 51-64, (2006); Wise A.E., Leibbrand J.A., Standards in the new millennium: Where we are, where we’re headed, Journal of Teacher Education, 52, pp. 244-255, (2001); Youngs P., Using teacher evaluation reform and professional development to support common core assessments, (2013)
SAGE Publications Inc.
Article
All Open Access; Gold Open Access
Scopus