Piloting the Internet-based Test
Norbert Schmitt [+]
Norbert Schmitt is Professor of Applied Linguistics at the University of Nottingham. He is interested in all aspects of second language vocabulary description, acquisition, use, pedagogy, and measurement. He has published over 100 articles and chapters on lexical issues, as well as four books: Vocabulary: Description, Acquisition, and Pedagogy (with Michael McCarthy, 1997, CUP), Vocabulary in Language Teaching (2000, CUP), Formulaic Sequences (2004, John Benjamins), and Researching Vocabulary: A Vocabulary Research Manual (2010, Palgrave). He has also published several other books on applied linguistics: A Handbook of Applied Linguistics (2010, Hodder), Why is English Like That? Historical Answers to Hard ELT Questions (2006, University of Michigan Press). His student textbook (with Diane Schmitt) Focus on Vocabulary: The Academic Word List (2000, 2013 2nd ed., Pearson Longman) has sold over 100,000 copies and this has been followed up with Focus on Vocabulary: Bridging Vocabulary. Norbert has an h-index of 58 and has 26,000 citations as of March 13, 2020. He regularly presents at major conferences and consults globally on lexical issues.
Karen Dunn [+]
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.
Barry O'Sullivan [+]
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.
Laurence Anthony [+]
Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
Benjamin Kremmel [+]
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.
This chapter discusses development of the Internet-based vocabulary test, based on the paper-and-pencil piloting described in Chapter 3. We needed to make sure the test worked as well on computers and mobile phones as it did on paper.