We investigated three different approaches for quantifying individual change and reporting it back to persons: (a) the common change score, which is obtained by first computing scale scores from two consecutive measurements and then subtract these scores from one another, (b) the ad-hoc approach, which is similar to the former approach but uses…

We first review existing literature on cumulative logit models along with various ways to test the parallel lines assumption. Building on the traditional frequentist framework, we introduce a method of Bayesian assessment of null values to provide an alternative way to examine the parallel lines assumption using highest density intervals and…

In this research report, we present an empirical argument for the use of a contributory scoring approach for the 2-essay writing assessment of the analytical writing section of the "GRE"® test in which human and machine scores are combined for score creation at the task and section levels. The approach was designed to replace a currently…

A problem faced by many instructors is that of designing exams that accurately assess the abilities of the students. Typically, these exams are prepared several days in advance, and generic question scores are used based on rough approximation of the question difficulty and length. For example, for a recent class taught by the author, there were…

This paper introduces an empirical study testing three kinds of bias in higher education student assessment. All of them are connected to the repetitive use of the same test questions which may facilitate academic cheating. The "same tests effect" may appear if two or more groups of students are writing the same test one after the other…

This paper examines the impact of the informational value of feedback choices on students' performance, their choice to revise, and the time they spend designing posters and reading feedback in an assessment game. Choices to seek confirmatory or critical feedback and to revise posters in a poster design task were collected from a hundred and six…

Low health literacy is associated with poor health outcomes. Research is needed to understand the mechanisms and pathways of its effects. Computer-based assessment tools may improve efficiency and cost-effectiveness of health literacy research. The objective of this preliminary study was to assess if administration of the Short Test of Functional…

This review examines published secondary analyses of National Longitudinal Transition Study 2 (NLTS2) data, with a primary focus upon statistical objectives, paradigms, inferences, and methods. Its primary purpose was to determine which statistical techniques have been common in secondary analyses of NLTS2 data. The review begins with an…

Purpose: The purpose of this paper is to test the hypothesis that there are correlations between campus sustainability initiatives and environmental performance, as measured by resource consumption and waste generation performance metrics. Institutions of higher education would like to imply that their campus sustainability initiatives are good…

The current study explores the nature and relationships among test takers' performance appraisals, appraisal calibration, and reported cognitive and metacognitive strategy use in a language test situation. Performance appraisals are executive processes of strategic competence for judging test performance (e.g., evaluating the correctness or…

This study investigated the responses of 531 preservice teachers to a "Beliefs About Assessment" questionnaire in China. The questionnaire focused on understanding the purposes, practices and principles of assessment for and of learning. Using factor analysis, an inter-correlated two-order model fitted well to the responses. This model…

How should a wide variety of educational activities be sequenced to maximize student learning? Although some experimental studies have addressed this question, educational data mining methods may be able to evaluate a wider range of possibilities and better handle many simultaneous sequencing constraints. We introduce Sequencing Constraint…

The authors examined students' effort and performance using online versus traditional classroom testing procedures. The instructor and instructional methodology were the same in different sections of an introductory finance class. Only the procedure in which students were tested--online versus in the classroom--differed. The authors measured…

The purpose of this manuscript is, first and foremost, to present new research in the Information Systems realm that will support future research into perceptions of Visual Appeal in an online environment. In furtherance of these goals, the research draws on Composition Theory to articulate a two-essay research agenda. Composition Theory states…

Classroom observation is an important component of teacher evaluation systems. Most states are implementing systems that assign a composite score to each teacher based on weights assigned to several different measures. Policy discussions often address this weighting, with many states adopting formulas with high weights for the summative scores…