In many high-stakes testing situations, test-takers are not allowed to draw on external writing resources while writing, a practice observed more frequently in classroom settings. This may pose problems with the representativeness of test tasks and score interpretations. This study investigates the domain definition of one particular test known as…

Unidimensionality is an important assumption of measurement but it is violated very often. Most of the time, tests are deliberately constructed to be multidimensional to cover all aspects of the intended construct. In such situations, the application of unidimensional item response theory (IRT) models is not justifieddue to poor model fit and…

Elicited Imitation Tests (EITs) are commonly used in second language acquisition (SLA)/bilingualism research contexts to assess the general oral proficiency of study participants. While previous studies have provided valuable EIT construct-related validity evidence, some key gaps remain. This study uses an integrative data analysis to further…

This paper presents the findings of a study that intended to seek the content validity (CV) evidence of an instrument to measure the reading ability of university students in Sri Lanka. The reading passages and items were adapted from CEFR aligned Learning Resource Network (LRN) materials. The items were designed based on the cognitive processing…

This qualitative descriptive analysis aims to interpret the complexity of the science items that are integrated with environmental sustainability content. This research was conducted on science test items in the 2013 Curriculum student science textbooks released by the Ministry of Education and Culture of the Republic of Indonesia. This study…

Scores from computer-based tests are increasingly used to inform a variety of school- and student-level decisions. An underlying assumption is that the associated scores represent effortful responding by each student with respect to the tasks presented. An innovative method for examining evidence for this assumption involves an examination of item…

This study explored possible reasons why IELTS candidates usually score low in writing by investigating the effects of two different test designs and scoring criteria on Iranian IELTS candidates' obtained grades in IELTS and World Englishes (WEs) essay writing tests. To this end, first, a WEs essay writing test was preliminarily designed. Then, 17…

The high-stakes College English Test (CET), developed, administered, and reformed over the last 20 years, has received great attention in the aspect of washback on teaching and learning from previous research. Very few studies explored its consequences in the workplace domain--being used as a screening lever. This research aimed to 1) compare…

This study employs an exploratory descriptive quantitative statistics design. District-level results in the State of Texas Assessments of Academic Readiness (STAAR) are explored to describe the achievement gaps that exist in districts implementing Transitional Bilingual Education (TBE) programs and districts implementing Dual Language (DL)…

Control of variables strategy (CVS) is a core scientific reasoning skill related to domain-general experimentation for evaluating an experimental system and deducing valid conclusions. This study aims to develop, validate, and explore latent factors predicting item difficulty in the test, measuring CVS in physics for high school students. The…

Despite the often-negative discussion about testing in schools, assessments are a necessary and useful tool in the teaching and learning process. This is especially true when it comes to diagnostic and formative assessments, which give teachers real-time direction for what students need to learn to master course content. It is this space where the…

The certainty of response index (CRI) measures respondents' confidence level when answering an item. In conjunction with the answers to the items, previous studies have used descriptive statistics and arbitrary thresholds to identify student knowledge profiles with the CRIs. Whereas this approach overlooked the measurement error of the observed…

The present study aimed to adapt the Teacher Self-Efficacy Scale (TSES) developed by Schwarzer et al. (1999) into Italian and to test its validity and reliability. In a group of teachers (N = 683; 83% female), the factor structure (Confirmatory Factor Analyses), construct validity (latent relations with burnout variables), measurement invariance…

This study aims to develop a valid and reliable assessment tool for the assessment of safety skills of individuals with intellectual disabilities, examine the effectiveness of the Safety Skills Instruction Program (SSIP) in teaching safety skills to these individuals, determine the preservation of skills after instruction by observation, and…

Low cost, non-invasive instruments for the identification of high academic potential in early childhood education and care are scarce, and the complexity of cognitive development indicates that combinations of screening instruments are needed. This study investigates the reliability and validity of three instruments (individually and in…