Take-home exam (THE) use has been reported in various disciplines, but research on THE use in language modules in higher education appears to be scarce. The current study employed surveys and interviews to examine how the shift to written THE, in place of the traditional in-class exam (ICE) during the pandemic, impacted language learning and…

Dr. Tracey Burns is a Senior Analyst in the OECD's Centre for Educational Research and Innovation. She heads a portfolio of projects including Innovative Teaching for Effective Learning, 21st Century Children and Trends Shaping Education. Until recently she was also responsible for the OECD work on Governing Complex Education systems. Previous to…

It has been argued in the literature on (language) testing that any act of testing/assessment can impact: (1) educators' curriculum design; (2) teachers' teaching practices; and (3) students' learning behaviors. This quality of any given testing situation or act of assessment has been called washback, or backwash if you will. Washback falls into…

The "Raven's 2 Progressive Matrices Clinical Edition" (Raven's 2; Raven, Rust, Chan, & Zhou, 2018), published by NCS Pearson, is an individually administered nonverbal assessment of general cognitive ability developed to measure "educative abilities," defined as the ability to think clearly and solve complex problems in…

When tests are low stakes for examinees, meaning there are little to no personal consequences associated with test results, some examinees put little effort into their performance. To understand the causes and consequences of diminished effort, researchers correlate test-taking effort with other variables, such as test-taking emotions and test…

Language test developers have a responsibility to ensure that their tests are accessible to test takers of various backgrounds and characteristics and also that they have the opportunity to perform to the best of their ability. This principle is widely recognised by educational and language testing associations in guidelines for the production and…

International large-scale assessments (ILSAs) are one of the most important tools policymakers and other educational stakeholders have to inform evidence based decision making for educational reform. Despite this, and the widespread use of ILSA data, results are sometimes misunderstood or misinterpreted. Here, we offer a brief guide to ILSAs and…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the development of the 2020 Grades 3-8 Mathematics Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2020 Grades 6-8…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the development of the 2020 Grades 3-8 Mathematics Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2020 Grades 3-5…

This study aims to identify teachers' selection/adoption of valuing pedagogy (VP) to implement an affect-focused mathematics teaching design with technological support. Valuing pedagogy is defined as teaching methods to address educational values and operationally defined as perceived, implemented, and received curricula, manifested by teacher…

Scientific modeling is a vital educational practice that helps students apply scientific knowledge to real-world phenomena. Despite advances in AI, challenges in accurately assessing such models persist, primarily due to the complexity of cognitive constructs and data imbalances in educational settings. This study addresses these challenges by…

The purpose of this article is to provide an overview of how students with disabilities, including students with significant cognitive disabilities and English learners with disabilities, can be included in local assessments used for instructional and programmatic decision making--that is, for formative purposes. This article focuses on formative…

In today's digital age, tests are increasingly being delivered on computers. Many of these computer-based tests (CBTs) have been adapted from paper-based tests (PBTs). However, this change in mode of test administration has the potential to introduce construct-irrelevant variance, affecting the validity of score interpretations. Because of this,…

Research on multi-attempt online assessments is sparse and inconclusive and lacks the voice of students. To help bridge the gap, this paper analyzes student survey data across multiple supply chain management classes. The results show that students prefer three attempts on quantitative assessments. The preferences do not depend on age, gender or…

In line with the journal volume's theme, this essay considers lessons from the past and visions for the future of test validity. In the first part of the essay, a description of historical trends in test validity since the early 1900s leads to the natural question of whether the discipline has progressed in its definition and description of test…