One of the central considerations in the validity argument for the TOEFL iBT is the relationship between the language on the exam and the language required for university courses. Corpus linguistics has recently been shown to be an effective way to explore this relationship, which can also be considered as an aspect of authenticity. Applying…

The purpose of this sequential mixed method study was to determine if there were differences between central office administrators', school administrators', and bilingual and English as a second language (ESL) teachers' overall and levels of action, self-regulation, and means efficacies, when controlling for years of experience with bilingual and…

Valid and reliable standardized assessment of nursing competencies is needed to monitor the quality of vocational education and training (VET) in nursing and evaluate learning outcomes for care work trainees with increasingly heterogeneous learning backgrounds. To date, however, the modeling of professional competencies has not yet evolved into…

There is a lack of knowledge in whether there is a difference in results for students on paper and pencil high stakes assessments and computer-based high stakes assessments when considering race and/or free and reduced lunch status. The purpose of this study was to add new knowledge to this field of study by determining whether there is a…

Practical examinations in anatomy are usually conducted on specimens in the anatomy laboratory (referred to here as the "traditional" method). Recently, we have started to administer similar examinations online using the quiz facility in Moodle[TM]. In this study, we compare student scores between two assessment environments viz. online and…

Lower than expected high-stakes examination scores were being observed in a first-year general psychology class. This research sought an alternate approach that would assist students in preparing for high-stakes examinations. The purpose of this study was to measure the effectiveness of an alternate teaching approach based on the testing effect to…

Two professors co-taught critical and civic thinking in the same first-semester course for four years. For the first year, they used computerized argument mapping and critical-thinking-for-civic-thinking (CT)[superscript 2] exercises based on open-ended scenarios framed within a civic context. The instructors assessed student skill levels using…

The Progress in International Reading Literacy Study (PIRLS) is an international assessment of student performance in reading literacy at the fourth grade. PIRLS measures students in the fourth year of formal schooling because this is typically when students' learning transitions from a focus on "learning to read" to a focus on…

This article examines the effectiveness of a software that supports formative assessment in real-time of learners' vocabulary knowledge through an interactive highlighting method. Students in a classroom are given a passage on their computer screen and asked to highlight the words they do not understand. This information is summarized on the…

Simulation or game-based assessments produce outcome data and process data. In this article, some statistical models that can potentially be used to analyze data from simulation or game-based assessments are introduced. Specifically, cognitive diagnostic models that can be used to estimate latent skills from outcome data so as to scale these…

The current study examined the effects of text-based relational (i.e., cohesion), propositional-specific (i.e., lexical), and syntactic features in a source text on subsequent integration of the source text in spoken responses. It further investigated the effects of word integration on human ratings of speaking performance while taking into…

A variety of computerized interactive learning platforms exist. Most include instructional supports in the form of problem sets. Feedback to users ranges from a single word like "Correct!" to offers of hints and partially to fully worked examples. Behind-the-scenes design of such systems varies as well --from static dictionaries of…

The role of time on task (TOT) for students' attainment in a low-stakes assessment of cross-curricular skills was examined using the log data collected in the computer-based assessment (CBA). Two structural equation models were compared: Model 1, in which students' test scores were explained by grade point average (GPA) together with mastery and…

Executive function is best measured in loosely structured, multi-component tasks that reflect real-life demands. These tasks require participants to develop a strategy, keep a plan in mind and monitor time. Errors include ignoring stated goals ("goal neglect"), over-allocation of time to one task and violating rules. Teasing apart such…

Narrowly defined personality facet scores are commonly reported and used for making decisions in clinical and organizational settings. Although these facets are typically related, scoring is usually carried out for a single facet at a time. This method can be ineffective and time consuming when personality tests contain many highly correlated…