.


  • Equinox
    • Equinox Publishing Home
    • About Equinox
    • People at Equinox
    • Terms and Conditions
    • Privacy Statement
    • FAQ’s
  • Subjects
    • Archaeology & History
    • Linguistics & Communication
    • Popular Music
    • Religion & Philosophy
  • Journals
    • Journals Home Page
      • Archaeology and History Journals
      • Linguistics Journals
      • Popular Music Journals
      • Religious Studies Journals
    • Publishing For Societies
    • Librarians & Subscription Agents
    • Electronic Journal Packages
    • For Contributors
    • Open Access and Copyright Policy
    • Personal Subscriptions
    • Article Downloads
    • Back Issues
    • Pricelist
  • Books
    • Book Home Page
    • Forthcoming Books
    • Published Books
    • Series
      • Advances in CALL Research and Practice
      • Advances in Optimality Theory
      • Advances in the Cognitive Science of Religion
      • Allan Bennett, Bhikkhu Ananda Metteyya: Biography and Collected Writings
      • Applied Phonology and Pronunciation Teaching
      • British Council Monographs on Modern Language Testing
      • Collected Works of Christian M.I.M. Matthiessen
      • Collected Works of Ruqaiya Hasan
      • Communication Disorders & Clinical Linguistics
      • Comparative Research on Iconic and Performative Texts
      • Comparative Islamic Studies
      • Contemporary and Historical Paganism
      • Culture on the Edge
      • Discourses in Ancient Near Eastern and Biblical Studies
      • Discussions in Functional Approaches to Language
      • Eastern Buddhist Voices
      • Equinox English Linguistics and ELT
      • Equinox Textbooks and Surveys in Linguistics
      • Frameworks for Writing
      • Functional Linguistics
      • Genre, Music and Sound
      • Global Philosophy
      • Icons of Pop Music
      • J.R. Collis Publications
      • Key Concepts in Systemic Functional Linguistics
      • Middle Way Philosophy
      • Monographs in Arabic and Islamic Studies
      • Monographs in Islamic Archaeology
      • Monographs in Mediterranean Archaeology
      • Music Industry Studies
      • NAASR Working Papers
      • New Directions in Anthropological Archaeology
      • Oxford Centre for Buddhist Studies Monographs
      • Popular Music History
      • Pragmatic Interfaces
      • Reflective Practice in Language Education
      • Religion and the Senses
      • Religion in 5 Minutes
      • Southover Press
      • Studies in Ancient Religion and Culture
      • Studies in Applied Linguistics
      • Studies in Communication in Organisations and Professions
      • Studies in Egyptology and the Ancient Near East
      • Studies in Phonetics and Phonology
      • Studies in Popular Music
      • Studies in the Archaeology of Medieval Europe
      • Text and Social Context
      • The Early Settlement of Northern Europe
      • The Study of Religion in a Global Context
      • Themes in Qur’anic Studies
      • Transcultural Music Studies
      • Working with Culture on the Edge
      • Worlds of the Ancient Near East and Mediterranean
    • For Authors
    • E-Books
    • Textbooks
    • Book Trade
  • Resources
    • Events
    • Rights & Permissions
    • Advertisers & Media
  • Search
  • eBooks
Equinox Publishing
Books and Journals in Humanities, Social Science and Performing Arts
RSSTwitterFacebookLinkedInGoogle+

Knowledge-based Vocabulary Lists

Norbert Schmitt [+–]
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
Karen Dunn [+–]
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

Barry O’Sullivan [+–]
British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Laurence Anthony [+–]
Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
Benjamin Kremmel [+–]
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

In teaching second language (L2) vocabulary, it is useful to have a way of prioritizing words to teach from among the multitude available. Word frequency, i.e. how often various words appear in written and spoken discourse, has typically been used to inform the emphasis taken. This volume explores the need for word lists based on direct tests of learner knowledge to inform L2 pedagogy. The Knowledge-based Vocabulary Lists (KVL) are introduced, and a description of the theoretical and practical basis for their
development is given, highlighting pedagogical and assessment situations in which it is beneficial to know whether learners are likely to be able produce and correctly spell the words they know. A focus on L2 learners of English from Chinese, German, and Spanish L1 backgrounds resulted in three ranked lists of English-language word knowledge. The comparative probability of learners from these language backgrounds knowing each word are presented, and the correspondence with existing information about word frequency, word acquisition sequence, and word difficulty is explored. The value of the KVL is discussed in terms of providing one of the few evidence-based descriptions of L2 form-recall vocabulary knowledge available to teachers and researchers.

Series: British Council Monographs on Modern Language Testing

Table of Contents

Prelims

List of Figures vii-x
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

List of Tables xi-xiv
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Acknowledgements xv-xvi
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

About the Authors xvii
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Chapter 1

The Need for Knowledge-based Vocabulary Lists (KVL) [+–] 1-12
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Chapter 1 outlines the need for, and rationale behind, the development of the Knowledge-based Vocabulary Lists (KVL). A brief history of the usefulness of word lists in second language pedagogy is followed by a discussion of the merits and shortcomings of frequency-based lists in predicting English language learners’ word knowledge. Empirically derived lists based on actual learner knowledge are contended to provide additional valuable insight for pedagogical purposes.

Chapter 2

Creating a List of Lemmas to Test [+–] 13-32
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Chapter 2 describes how the initial candidate list of lemmas to be presented to the participants were compiled in the KVL study, alongside key initial decisions, such as the scope of the knowledge-based word list(s), choosing the counting unit (e.g. lemma, or word family), choosing the reference corpora, and which L1 speakers to test.

Chapter 3

Developing the Vocabulary Test [+–] 33-47
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Chapter 3 discusses the development of the vocabulary tests used in the KVL study and the associated decisions. Various item format options are briefly discussed, plus their advantages and disadvantages in this context. This is followed by information about the development of the item-writing process and the test instructions. Finally, the initial (offline) piloting process with Spanish and Chinese participants is reported.

Chapter 4

Piloting the Online Test [+–] 48-55
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Chapter 4 describes the development of the online vocabulary test, the Vocabulary Challenge, based on the paper-and-pencil piloting described in Chapter 3. The description includes practical and functional aspects of the test development, such as ensuring it worked well across all digital platforms, considerations of how to motivate participants to take part, and ways to encourage prolonged engagement with the questions.

Chapter 5

Writing and Revising the Test Items, Developing the Online Test, and Main Data Collection [+–] 56-67
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Chapter 5 addresses the process of item writing and approval. The selected 7,762 lemmas were translated into Spanish, Chinese, and German, along with associated prompts in each language. These were then embedded into the Vocabulary Challenge website backend database, which included a mechanism for allocating items to participants and collecting response data. Also described are the promotional channels employed to ensure good reach across relevant regions. Item response numbers for each language are summarised.

Chapter 6

Analysis and Ranking of Lemmas [+–] 68-85
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Chapter 6 describes the final datasets employed for the creation of the finalised KVL. Participant numbers are summarised by four background variables. A descriptive overview of item response numbers and estimated difficulties is given, plus an account of the analytic process for a non-technical audience. Additionally, the rank orders to emerge from the groups of participants from the three different language backgrounds are compared, followed by justification for the compilation of a customized KVL for each L1 group.

Chapter 7

Comparison of the KVL with Frequency Lists [+–] 86-135
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

In chapter 7, various statistical explorations of the data compare KVL results with existing frequency lists. A specific examination is made of individual lemmas that intuitively appeared mis-ranked. Findings demonstrate why the KVL add unique value for pedagogical purposes. Comparisons drawn across the three language groups suggest that the L1 and/or the L1 context play an influential role as to whether a learner is likely to know certain words.

Chapter 8

Effects of Cognateness on KVL Rankings [+–] 136-151
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Chapter 8 is dedicated to investigating cognates in the Spanish and German KVL, and their role in explaining word knowledge amongst participants from these L1 backgrounds. Evidence indicates that cognateness facilitates knowledge beyond the predictions derived from frequency rankings, though not always consistently. Consideration of loanwords in Chinese suggests the impact to be minimal.

Chapter 9

Comparison of the KVL with Alternative Lists [+–] 152-182
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Chapter 9 provides statistical insight into the degree of correspondence between the three KVL and other published lists of vocabulary acquisition sequence and difficulty. Correlation analysis indicates that none of these alternative lists predicts the KVL knowledge rankings to any great degree. The value of the KVL are discussed in terms of providing one of the few evidence-based descriptions of L2 form-recall knowledge available to teachers and researchers.

Chapter 10

Assessing and Using the KVL [+–] 183-186
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Chapter 10 presents information about accessing and using the KVL. The information included will be of particular interest to researchers and vocabulary specialists who wish to understand the technical details underpinning the lists. The chapter serves as a companion to the online User Manual that is created for practitioners and written in simpler, more accessible language, without academic referencing.

Chapter 11

Further Research Directions [+–] 187-192
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Chapter 11 describes opportunities for further research that can enhance the usefulness of the KVL increasing their potential as a valuable resource for ESL practitioners. Interested researchers are invited to pursue the ideas suggested, or other directions that they think would be beneficial or interesting.

Appendices

Appendix 1: Instructions to the Item Writers 193-199
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 2: List of Offensive Words Removed 200
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 3: Screenshots from the Vocabulary Challenge Website 201-205
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 4: Technical Explanation of the General Linear Mixed Modeling (GLMM) Rankings 206-208
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 5: Technical Explanation of the Precision of the GLMM Rankings 209-214
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 6: Patterns of Incorrect/Missing Spanish Responses to Higher Frequency Lemmas and Comparison with German and Chinese Responses to the Same Lemmas 215-222
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 7: Patterns of Incorrect/Missing German Responses to Higher Frequency Target Lemmas 223-230
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 8: Patterns of Incorrect/Missing Chinese Responses to Higher Frequency Target Lemmas 231-234
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 9: Lemmas for which the Spanish Test Prompt was Exactly the Same as the English Test Answer (Cognate) 235-238
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 10: Lemmas for which the German Test Prompt was Exactly the Same as the English Test Answer (Cognate) 239-248
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 11: Comparison of the 114 Words Known by All Respondents in Brysbaert et al. (2020) with KVL Results 249-252
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 12: Best-known 30 Lemmas on the Spanish-KVL 253-254
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 13: Best-known 30 Lemmas on the German-KVL 255-256
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 14: Best-known 30 Lemmas on the Chinese-KVL 257-258
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Appendix 15: Sample of the KVL-Spanish-Technical Spreadsheet 259-262
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

End Matter

References 263-272
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

Index 273-283
Norbert Schmitt,Karen Dunn,Barry O’Sullivan,Laurence Anthony,Benjamin Kremmel
Nottingham University
Norbert Schmitt is Emeritus Professor of Applied Linguistics at the University of Nottingham, specializing in second language vocabulary issues. He directed the project from a lexical perspective, and carried out the main data analysis.
British Council
Dr. Karen Dunn is a Senior Researcher in measurement and evaluation at the British Council. She holds a PhD in Applied Social Statistics and Masters in Language Studies. The focus of Karen’s PhD research was on using Explanatory Item Response Theory to investigate word difficulty for L2 learners of English. In additional to operational test concerns, her current research interests include scoring validity of reading reordering tasks, assessing language test dimensionality, and linking motivational profiles to proficiency outcomes.

British Council
Barry O’Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.

Waseda University, Japan
Laurence Anthony is a Professor in the Faculty of Science and Engineering at Waseda University, Japan. He is a former director of the Center for English Language Education (CELESE) and is the coordinator of the CELESE technical English program. He received the M.A. degree in TESL/TEFL, and the Ph.D. in Applied Linguistics from the University of Birmingham, UK, and the B.Sc. degree in mathematical physics from the University of Manchester, UK. His research interests include corpus linguistics, educational technology, natural language processing (NLP), and genre analysis. His main research interests are in educational technology, corpus linguistics, and natural language processing. Continuing from his Masters work in genre analysis, he developed software to automatically analyze texts at the sentence and discourse level for his PhD. Since then, he has been developing educational software for use by researchers, teachers, and learners in corpus linguistics, including AntConc, a freeware concordancer, AntWordProfiler, a freeware vocabulary profiler, and more recently web-based monolingual and parallel concordancers.
University of Innsbruck
Benjamin Kremmel is Head of the Language Testing Research Group Innsbruck (LTRGI) at the University of Innsbruck. He is currently a lecturer and researcher at the Department for Subject-specific Education at the Faculty of Teacher Education and has been involved in multiple language test development projects, such as the exam reform of the Austrian school leaving exam and the development of a new national language exam for diagnosis and educational monitoring. His PhD at the University of Nottingham, UK, was on the development and validation of vocabulary assessments. His research interests include vocabulary assessment, L2 reading assessment, diagnostic language testing, language assessment literacy, and SLA. His work has been published in Language Testing, Language Assessment Quarterly, Applied Linguistics, Language Teaching, PlosOne and TESOL Quarterly.

ISBN-13 (Hardback)
9781800504134
Price (Hardback)
£75.00 / $100.00
ISBN-13 (Paperback)
9781800504141
Price (Paperback)
£24.95 / $32.00
ISBN (eBook)
9781800504158
Price (eBook)
Individual
£24.95 / $32.00
Institutional
£75.00 / $100.00
Publication
15/01/2024
Pages
302
Size
234 x 156mm
Readership
ELT teachers, scholars
Illustration
58 figures

Related Journal

Related Interest

  • Search Equinox

  • Subjects

    • Archaeology & History
      • Food History
      • Journals
    • Linguistics & Communication
      • Spanish & Arabic
      • Writing & Composition
      • Journals
    • Popular Music
      • Jazz
      • Journals
    • Religion & Philosophy
      • Buddhist Studies
      • Islamic Studies
      • Journals
  • Tweets by @EQUINOXPUB
We may use cookies to collect information about your computer, including where available your IP address, operating system and browser type, for system administration and to report aggregate information for our internal use. Find out more.