The community of inquiry (COI) model identifies elements which are fundamental to a successful online learning experience, namely, teaching presence, cognitive presence, and social presence. The model has received empirical support as a useful framework for understanding the online learning experience. A limitation of the model is its…

The modern web-based technology greatly popularizes computer-administered testing, also known as online testing. When these online tests are administered continuously within a certain "testing window," many items are likely to be exposed and compromised, posing a type of test security concern. In addition, if the testing time is limited,…

Emotion regulation (ER) is an integral aspect of emerging adults' mental health, yet little is known about interpersonal factors that influence ER in during this period. This investigation examines emerging adults' desire to emulate parental ER skills in the relation between perceived parental ER and emerging adults' emotion dysregulation. A…

Cognitive diagnosis models (CDMs) allow for the extraction of fine-grained, multidimensional diagnostic information from appropriately designed tests. In recent years, interest in such models has grown as formative assessment grows in popularity. Many dichotomous as well as several polytomous CDMs have been proposed in the last two decades, but…

This study examines the relationship between log data of student activity in learning management systems and self-reported student engagement survey scores. Log data has the potential to serve as a meaningful proxy for survey scores. Should this be the case, log data could be used as a minimally disruptive and scalable approach to quickly identify…

There is a growing use of noncognitive assessments around the world, and recent research has posited an ideal point response process underlying such measures. A critical issue is whether the typical use of dominance approaches (e.g., average scores, factor analysis, and the Samejima's graded response model) in scoring such measures is adequate.…

The purpose of this study is to assess the impact of aberrant responses on the estimation accuracy in forced-choice format assessments. To that end, a wide range of aberrant response behaviors (e.g., fake, random, or mechanical responses) affecting upward of 20%--30% of the responses was manipulated under the multi-unidimensional pairwise…

This methodological paper examines current conceptions of reliability in chemistry education research (CER) and provides recommendations for moving beyond the current reliance on reporting coefficient alpha (a) as reliability evidence without regard to its appropriateness for the research context. To help foster a better understanding of…

We examined the influence of accountability on the consistency of peer ratings and quality of peer feedback by comparing three conditions: only rating accountability, only feedback accountability, or both rating and feedback accountability. From a large undergraduate course, 287 students' peer ratings and peer feedback were coded for rating…

In using the Rasch model to improve the quality of an instrument, analysis purports to determine if the sample collaborates well with the items in the instrument such that the results are measuring a single underlying variable. The relevant properties of Rasch analysis are reliability and validity which are key indicators of the quality of a…

In the lead up to the 2016 election, fake news often "outperformed" actual news in users' social media feeds. This paper attempts to analyze the process in which fake news proliferates social networking sites and presents a method of understanding and articulating ways in which personalized feeds are shaped by algorithm-based user…

Purpose: This study aimed to examine the impact of differential item functioning in anchor items on the group invariance in test equating for different sample sizes. Within this scope, the factors chosen to investigate the group invariance in test equating were sample size, frequency of sample size of subgroups, differential form of differential…

In this study purposes to indicate the effect of the number of DIF items and the distribution of DIF items in these forms, which be equalized on equating error. Mean-mean, mean-standard deviation, Haebara and Stocking-Lord Methods used in common item design equal groups as equalization methods. The study included six different simulation…

With the upcoming review of the National Certificates of Educational Achievement (NCEA) and the removal of National Standards, it is time to reconsider how we approach assessment. In this edition of Assessment News I argue that it is time to put assessment for learning (AfL) and the assessment-capable teacher and student "front and…

The effect of the response scale direction on response behavior is a well-known phenomenon in survey research. While there are several approaches to explaining how such response order effects occur, the literature reports mixed evidence. Furthermore, different question formats seem to vary in their susceptibility to these effects. We therefore…