The development of Rasch-based "comparative engagement scenarios" based on Guttman's facet theory and sentence mapping procedures is described. The scenario scales measuring engagement in work, caregiving, informal helping, and volunteering illuminate the lived experiences of role involvement among older adults and offer multiple…

We investigated if instruction on a Table of Specifications (TOS) would influence the quality of classroom test construction. Results should prove informative for educational researchers, teacher educators, and practising teachers interested in evidenced-based strategies that may improve assessment-related practices. Fifty-three college…

The 2013-2014 academic year marks the rollout of the redesigned advanced placement (AP) chemistry course and exam. There have been many questions as to why the course was redesigned and how the new examination will differ from its legacy version. In this article we give a brief overview of the legacy course and examine why a redesign occurred in…

The focus of this paper is on the design, administration, and scoring of a dynamically administered elicited imitation test of L2 English morphology. Drawing on Vygotskian sociocultural psychology, particularly the concepts of zone of proximal development and dynamic assessment, we argue that support provided during the elicited imitation test…

This article reports the development of the Test Takers' Metacognitive Awareness Reading Questionnaire (TMARQ) which measures test takers' metacognition in reading comprehension tests. The TMARQ comprises seven subscales: planning strategies, evaluating strategies, monitoring strategies, strategies for identifying important information,…

The aim of this study was to determine whether large variations in the pass rates of different versions of the Taiwanese tour guides' English test were due to inherent differences in the difficulty of the tests. Rasch analysis software was used to measure the difficulty of all items on the 2009 and 2013 versions. It was found that the ability…

Purpose: The aim of this study is to develop a psychometrically sound self-report scale of organizational memory. The scale is planned for use in future research to test the relationship between what employees know and their attitudes to passing on their knowledge. Design/methodology/approach: A total of 72 organizational memory scale items…

A design and application of adaptive online exam system are carried out in this paper. Adaptive exam systems determine different question sets automatically and interactively for each student and measure their competence on a certain area of discipline instead of comparing their gains with each other. Through an adaptive exam technique, a…

Although combining methods is nothing new, more contributions about why and how to mix methods for validation purposes are needed. This article presents a case of validating the inferences drawn from the Participatory Evaluation Measurement Instrument, an instrument that purports to measure stakeholder participation in evaluation. Although the…

Purpose: This study had five objectives: explain the initial steps that led to the construction of the Ethical Leadership Questionnaire (ELQ); analyze the items and verify the ELQ reliability using item response theory (IRT); examine its factorial structure with a confirmatory factor analysis (CFA) and an exploratory structural equation modeling…

This case study describes a program of research that developed a new measure--the Adaptability Scale--and then tested this new measure through a set of substantive research questions and publications. Three phases of this research program are detailed: a measurement phase, a modeling phase, and a mediation phase. The aim of this case study is to…

I am currently conducting research for a PhD Public Health. As a result of my previous experience researching my Master's degree thesis, and what I have learned so far about designing and validating a risk-perception instrument, I have gained some insight related to know-how and possible pitfalls that can occur when undertaking research. These…

The primary measure used to determine relative effectiveness of in-class activities has been student performance on pre/posttests. However, in today's active-learning classrooms, learning is a social activity, requiring students to interact and learn from their peers. To develop effective active-learning exercises that engage students, it is…

The purpose of this study was to develop a Chorus Motivation Scale (CMS) that is tested in terms of reliability and construct validity by determining the student perceptions of effective motivation strategies in Chorus training in Turkish Music Teacher Training Model. In order to develop a Chorus Motivation Scale, Questionnaire-Effective…

Intimate partner violence (IPV) classifications have treatment implications for couples. This study tested the psychometrics of the Continuum of Conflict and Control Relationship Scale (CCC-RS) and examined differences between violence severity and CCC-RS scales. A sample of 575 low-income, ethnically diverse participants contributed data. Results…