Rubric-referenced calibration and the interaction between writing achievement and calibration, a measure of the relationship between one's performance and the accuracy of one's judgments, were investigated. Undergraduate students (N = 596) were assigned to one of three calibration conditions: (a) global, (b) global and general criteria, or (c)…

In this article, Hartley notes the difficulties of using questionnaires to assess the efficiency of new instructional methods and highlights nine issues that researchers must consider. Hartley continues the discussion about the use of questionnaires and suggests that psychology teachers can help improve the teaching of psychology by drawing…

This research investigated the statistical predictive power of organisational commitments for academics' teaching approaches. Participants were 268 academics working in six elite universities in Beijing, mainland China. Results showed that academics' organisational commitments as measured by the Organisational Commitment Inventory significantly…

This study examined the psychometric properties of the school engagement measure (SEM) in Singapore. The sample consisted of 1,027 students from a multi-ethnic Singapore adolescent community. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) confirmed that the two-factor solution, namely, (a) Emotional and (b) Cognitive…

The first aim of this study was to explore the reliability and validity of the Turkish version of the Theoretical Orientation Profile Scale-Revised, and the second aim was to understand the relative influence of personal and professional variables on the choice of a guiding theoretical orientation among Turkish counselor trainees. Results showed…

This study proposes a structured constructs model (SCM) to examine measurement in the context of a multidimensional learning progression (LP). The LP is assumed to have features that go beyond a typical multidimentional IRT model, in that there are hypothesized to be certain cross-dimensional linkages that correspond to requirements between the…

This article discusses talk and gesture as neglected sources of process data (Maddox, 2015, Maddox and Zumbo, 2017). The significance of the article is the growing use of various sources of process data in computer-based testing (Ercikan and Pellegrino, (Eds.) 2017; Zumbo and Hubley, (Eds.) 2017). The use of process data on talk and gesture…

Given family-school engagement is correlated with student academic achievement, educational researchers have long been interested in the construct. However, measuring parental engagement is deceptively challenging. The concept includes school-based engagement, home-based learning support, and family-school communication. In this article we focus…

The "ETS"® Proficiency Profile (EPP), a college-level assessment, has been widely used to evaluate general education student learning outcomes (SLOs) in college. The purpose of this study was to investigate validity evidence for the EPP by evaluating the relationship with outcomes such as student retention, cumulative grade point average…

Predicting and analyzing multimodal dialog user experience (UX) metrics, such as overall call experience, caller engagement, and latency, among other metrics, in an ongoing manner is important for evaluating such systems. We investigate automated prediction of multiple such metrics collected from crowdsourced interactions with an open-source,…

While proof is central to mathematics, difficulties in the teaching and learning of proof are well-recognised internationally. Within the research literature, a number of theoretical frameworks relating to the teaching of different aspects of proof and proving are evident. In our work, we are focusing on secondary school students learning the…

Surveys are frequently used to inform consequential decisions about teachers, policies, and programs. Consequently, it is important to understand the validity of these instruments. This study assesses the validity of measures of instruction captured by an annual survey by comparing survey data with those of a validated daily log. The two…

This article presents the results of a systematic review of methods that have been used to measure or assess metacognition in children aged 4-16 years over a 20-year period (1992-2012). It includes an overview of the types of tool and methods used linked with the ages of the participants targeted and how metacognition and associated concepts are…

Prediction accuracy of academic achievement for admission purposes requires adequate "sensitivity" and "specificity" of admission tools, yet the available information on the validity and predictive power of admission tools is largely based on studies using correlational and regression statistics. The goal of this study was to…

This paper deals with the competence of Cultural (epistemological, historical and anthropological) Analysis of the Content (CAC), which is important for teachers' awareness and autonomy when dealing with educational choices in a changing cultural and institutional context. We report on an 18-hour intervention in a teacher education course at the…