Ensuring that test-score use brings about socially positive consequences for test-takers is an important aspect of test validation. While many studies use an inductive approach to evaluate test consequences, few studies have implemented Appraisal analysis. To that end, this case study investigated the test consequences of an English reading…

In recent ACT mode comparability studies, students testing on laptop or desktop computers earned slightly higher scores on average than students who tested on paper, especially on the ACT® reading and English tests (Li et al., 2017). Equating procedures adjust for such "mode effects" to make ACT scores comparable regardless of testing…

Purpose: Globally, serious doubts are now expressed about the quality of accounting education, and employers are concerned about the lack of employability among graduates. There is a lack of a validated tool to measure employability in the Saudi Arabia context. Such a tool is required to assess the level of employability so that required…

Practitioner surveys suggest that despite well-intentioned efforts, undergraduate business programs could better equip students with "soft skills." This research study focuses on the soft skills associated with cross-functional integration (CFI), where skill gaps are believed to exist but have not been confirmed. As the first study to…

This article investigates the concern that assessment of metacognitive resolution (or relative accuracy--often evaluated by gamma correlations or signal detection theoretic measures such as d[subscript a]) is vulnerable to an artifact due to guessing that differentially impacts low as compared to high performers on tasks that involve…

Testing English writing skills could be multi-dimensional; thus, the study aimed to compare students' writing scores calculated according to Classical Test Theory (CTT) and Multi-Facet Rasch Model (MFRM). The research was carried out in 2019 with 100 university students studying at a foreign language preparatory class and four experienced…

A significant challenge in studying formative assessment is the lack of suitable instruments for assessing teachers' formative assessment practices. This paper reports the development of the Teacher Formative Assessment Practice Scale (TFAPS) and its psychometric properties based on two samples of primary and secondary school teachers: one from…

Providing evidence that can inform awarding is an important application of Comparative Judgement (CJ) methods in high-stakes qualifications. The process of marking scripts is not changed, but CJ methods can assist in the maintenance of standards from one series to another by informing decisions about where to place grade boundaries or cut scores.…

In Comparative Judgement (CJ) exercises, examiners are asked to look at a selection of candidate scripts (with marks removed) and order them in terms of which they believe display the best quality. By including scripts from different examination sessions, the results of these exercises can be used to help with maintaining standards. Results from…

Students exhibit many behaviors when responding to items on a computer-based test, but only some of these behaviors are relevant to estimating their proficiencies. In this study, we analyzed data from computer-based math achievement tests administered to elementary school students in grades 3 (ages 8-9) and 4 (ages 9-10). We investigated students'…

Reading, writing, and mathematics are widely regarded as foundational academic skills upon which many other academic skills depend. Consequently, each receives a considerable allocation of resources for instruction, assessment, and intervention in K-12 education (Hooper, 2002). An additional indicator of the importance of these skills is the…

Purpose: This study aims to describe the development and validation of a student survey instrument to assess academic advising services. The instrument was based on the SERVQUAL scale, a well-known instrument for service quality. Design/methodology/approach: A quantitative methodology was used. Data were collected through a structured…

I detail findings from an ethnographic study of a high school remedial reading class, with a particular focus on students' perceptions of what it means to be literate and how their mandatory enrollment in the course impacted their identities. Compounding students' experiences was the existence of a high-stakes reading examination that all students…

The multiple response structure can underlie several different technology-enhanced item types. With the increased use of computer-based testing, multiple response items are becoming more common. This response type holds the potential for being scored polytomously for partial credit. However, there are several possible methods for computing raw…

Three-year-old children are seldom the focus in studies about supplemental early literacy instructional support. This study examines 3-year-old children's potential need for additional early literacy support, extending and replicating a previous investigation that identified prekindergarten children (i.e., 4-year-olds) in Head Start classrooms for…