Scoring Second Language Spoken and Written Performance - Issues, Options and Directions - Ute Knoch

Scoring Second Language Spoken and Written Performance - Issues, Options and Directions - Ute Knoch

Measuring Rating Quality

Scoring Second Language Spoken and Written Performance - Issues, Options and Directions - Ute Knoch

Ute Knoch [+-]
University of Melbourne
Ute Knoch is the Director of the Language Testing Research Centre at the University of Melbourne. Her research interests are in the area of writing assessment, rating processes, assessing languages for academic and professional purposes, and placement testing. She was the Co-president of the Association for Language Testing and Assessment of Australian and New Zealand (ALTAANZ) between 2015-2016 and currently serves on the Executive Board of the International Language Testing Association (ILTA). In 2014, Dr Knoch was awarded the TOEFL Outstanding Young Scholar Award by the Educational Testing Service (Princeton, US), recognizing her contribution to language assessment.
Judith Fairbairn [+-]
British Council
Judith Fairbairn leads on assessment development projects for the British Council’s Global Assessments team, which includes project management, assessment design, item writing, rating scale development, test quality assurance and developing bespoke assessment solutions for clients. Areas of expertise include research into rating speaking and writing tests, online rater training, rating scale development, and equality, diversity and inclusion in testing. Judith has an MA in Language Testing (Lancaster University) and is studying a PhD at University College London, Institute of Education focusing on rater decision making processes when marking speaking tests.
Yan Jin [+-]
Shanghai Jiao Tong University, China
Dr. Yan Jin is a professor of linguistics and applied linguistics at the School of Foreign Languages, Shanghai Jiao Tong University, China. Her research interests include the development and validation of large-scale, high-stakes language assessments. She is currently chair of the National College English Testing Committee of China and co-president of the Asian Association for Language Assessment. She is co-editor-in-chief of the Springer open-access journal Language Testing in Asia and is also on the editorial boards of Language Testing, Language Assessment Quarterly, International Journal of Computer-Assisted Language Learning, and a number of academic journals published in China.

Description

Chapter 2 focusses on measuring rater quality. We provide a detailed framework for classifying measures of rating quality and discuss the most commonly used indices and measurement techniques in more detail. The chapter concludes with a summary of what detailed information each rater index can provide about the rater effects described in Chapter 1.

Notify A Colleague

Citation

Knoch, Ute; Fairbairn, Judith; Jin, Yan. Measuring Rating Quality. Scoring Second Language Spoken and Written Performance - Issues, Options and Directions. Equinox eBooks Publishing, United Kingdom. p. 29-49 Mar 2021. ISBN 9781781799529. https://www.equinoxpub.com/home/view-chapter/?id=40862. Date accessed: 28 Mar 2024 doi: 10.1558/equinox.40862. Mar 2021

Dublin Core Metadata