This study incorporates a random forest (RF) approach to probe complex interactions and nonlinearity among predictors into an item response model with the goal of using a hybrid approach to outperform either an RF or explanatory item response model (EIRM) only in explaining item responses. In the specified model, called EIRM-RF, predicted values…

This quantitative study examined seventh-grade reading scores to determine the extent to which certain demographic variables (race/ethnicity, gender, socioeconomic status) explain and MAP reading scores predict reading scores on the State of Texas Assessment of Academic Readiness (STAAR) in a selected northeast Texas public school. Standardized…

Online higher education institutions are presented with the concern of how to obtain valid results when administering student learning outcomes (SLO) assessments remotely. Traditionally, there has been a great reliance on unproctored Internet test administration (UIT) due to increased flexibility and reduced costs; however, a number of validity…

The present study investigated the implications of computer-adaptive testing (operationalized by way of multistage adaptive testing; MAT) and "conventional" fixed order computer testing for various test-relevant outcomes in numeracy, including achievement, test-relevant motivation and engagement, and subjective test experience. It did so…

We explored the feasibility of using automated scoring to assess upper-elementary students' reading ability through analysis of transcripts of students' small-group discussions about texts. Participants included 35 fourth-grade students across two classrooms that engaged in a literacy intervention called Quality Talk. During the course of one…

We explored the feasibility of using automated scoring to assess upper-elementary students' reading ability through analysis of transcripts of students' small-group discussions about texts. Participants included 35 fourth-grade students across two classrooms that engaged in a literacy intervention called Quality Talk. During the course of one…

The purpose of the present study is to assess second language (L2) spoken English using automated scoring techniques. Automated scoring aims to classify a large set of learners' oral performance data into a small number of discrete oral proficiency levels. In automated scoring, objectively measurable features such as the frequencies of lexical and…

Problem: Practitioners working with multiple-choice tests have long utilized Item Response Theory (IRT) models to evaluate the performance of test items for quality assurance. The use of similar applications for performance tests, however, is often encumbered due to the challenges encountered in working with complicated data sets in which local…

Language test preparation has often been studied within the consequential validity framework in relation to ethics, equity, fairness, and washback of assessment. The use of independent and integrated speaking tasks in the "TOEFL iBT"® test represents a significant development and innovation in assessing speaking ability in academic…

Standardized testing and assessment packages have been implemented by nursing program directors to predict and improve pass rates on the National Council Licensure Examination (NCLEX). The methods of implementation vary from program to program, and as a result, the outcomes in the programs vary. The purpose of this quantitative study was to…

This inquiry had 2 components: (1) the first was substantive and focused on the comparability of paper-based and computer-based test forms and (2) the second was a within-study comparison wherein a quasi-experimental method, propensity score matching, was compared with a credible benchmark method, a within-subjects design. The tests used in the…

We share results from a quasi-experimental study in which we compared achievement between traditional lecture-based and computer-based sections of college algebra on a common multiple choice exam as well as performance on problem solving items. Students in the computer-based group performed better on the final exam and were also more likely to…

The purpose of this quantitative study was to determine if a relationship existed between success in elementary algebra and a set of predictor variables including COMPASS score and high school GPA. Relationships for intermediate algebra and college credit accumulation over three semesters were also examined with COMPASS score and high school GPA…

Graduates of associate degree (AD) nursing programs form the largest segment of first-time National Council Licensure Examination for Registered Nurses (NCLEX-RN®) test takers, yet also experience the highest rate of NCLEX-RN® failures. NCLEX-RN® failure delays entry into the profession, adding an emotional and financial toll to the unsuccessful…

Literature in the United States provides many examples of no difference in student achievement when measured against the mode of test administration i.e., paper-pencil and online versions of the test. However, most of these researches centre on "regular" students who do not require differential teaching methods or different evaluation…