Educational researchers often need to construct precise and reliable measurement scales of complex and varied representations such as participants' written work, videoed lesson segments and policy documents. Developing such scales using can be resource-intensive and time-consuming, and the outcomes are not always reliable. Here we present…

Introduction: Item response theory (IRT) has received much attention in validation of assessment instrument because it allows the estimation of students' ability from any set of the items. Item response theory allows the difficulty and discrimination levels of each item on the test to be estimated. In the framework of IRT, item characteristics are…

This article aims to clarify the fundamental aspects of aggregating fuzzy scores of conditions with multiple attributes in fuzzy set qualitative comparative analysis (fsQCA). Fuzzy multiple attribute conditions (FMACs) are conditions that are built using different types of concepts. FMACs are flexible conditions that express the ontological nature…

Source code plagiarism is a common occurrence in undergraduate computer science education. Many source code plagiarism detection tools have been proposed to address this problem. However, most of these tools only measure the similarity between assignment submissions, and do not actually identify which are suspicious of plagiarism. This work…

While score comparability across test forms typically relies on common (or randomly equivalent) examinees or items, innovations in item formats, test delivery, and efforts to extend the range of score interpretation may require a special data collection before examinees or items can be used in this way--or may be incompatible with common examinee…

As a result of the COVID-19 pandemic, at-home testing has become a popular delivery mode in many testing programs. When programs offer at-home testing to expand their service, the score comparability between test takers testing remotely and those testing in a test center is critical. This article summarizes statistical procedures that could be…

This article compares metalinguistic awareness among emerging bilingual and multilingual learners of English in Norwegian primary school. Participants were 120 students in grades 5-7 (aged 10-13) attending mainstream English classes in Norway and were divided into three groups based on a linguistic background questionnaire: an L1 Norwegian group,…

The aim of this paper is to approach the teaching of the Poisson distribution in a friendly and amusing way. It constitutes a common practice to adopt the main probability distributions in order to predict results of sport events and to estimate the win return of betting activities (Chalikias 2009). In particular, by using the Poisson…

The introduction of the CEFR was welcomed by researchers and practitioners in language education, given its potential for increasing transparency of test results and the meaningfulness of test scores. In this paper, I reflect on Glenn Fulcher's (2004, 2016) critical take on the use of the CEFR in the context of mapping (linking or aligning) test…

Data reproducibility is becoming increasingly important in the social sciences, but it has yet to be incorporated into many undergraduate sociology programs. This note describes a service-learning activity that can be added to an introductory statistics course. Students partner with a nonprofit and analyze quantitative data to answer questions…

The TOEFL iBT test was introduced in 2005 to better reflect the language demands of real-life academic tasks than did previous versions of the test. The task-based design of the test was intended to support the interpretation of its scores as a trustworthy measure of international students' ability to use English in an academic environment. Until…

The relationship between diversity and creativity can be seen as paradoxical. A diversity of perspectives should be advantageous for collaborative creativity, yet its benefits are often offset by adverse social processes. One suggestion for overcoming these negative effects is perspective taking. We compared four dyads with low scores on trait…

The articles presented in this Special Issue provide evidence for many statistically significant relationships among error scores obtained from the Kaufman Test of Educational Achievement, Third Edition (KTEA)-3 between various groups of students with and without disabilities. The data reinforce the importance of examiners looking beyond the…

The purpose of this document is to provide information and advice to support states in meeting USED Peer Review Requirements related to demonstrating the comparability of test scores across various devices used for technology-based testing. The document is divided into four main sections. In the first section, we discuss and define the…

This Study Snapshot highlights key findings from a study that examines full-day kindergarten (FDK) implementation in Oregon. The evidence base on FDK is generally positive for short-term effects and unclear for longer-term effects, with some prior research associating FDK with gains in student outcomes such as grade 3 math and reading standardized…