In this paper, the author aims to provide novice researchers with an understanding of the general problem of validity in social science research and to acquaint them with approaches to developing strong support for the validity of their research. She provides insight into these two important concepts, namely (1) validity; and (2) reliability, and…

Teaching values in modern schools is a new phenomenon. Malaysian national curriculum at both primary and secondary school levels ensures that students develop desirable attitudes and behaviors based on human, religious, and spiritual values. The inculcation of the values is made possible through various subjects and non-academic subjects and…

The purpose of this study was to develop and validate a scale of teacher beliefs related to mathematics, namely, beliefs about the nature of mathematics, mathematics teaching, and assessment in mathematics learning. A scale development study was used to achieve it. The draft scale consisted of 54 items in which 16 items related to beliefs about…

Validity and reliability are among the most crucial characteristics of a test. One of the steps to make sure that a test is valid and reliable is to examine the bias in test items. The purpose of this study was to examine the bias in 2012 Placement Test items in terms of gender variable using Rasch Model in Turkey. The sample of this study was…

This study investigated the psychometrics of a recently developed global rating measure of videotaped parent-infant interaction, the "Manchester Assessment of Caregiver-Infant Interaction" (MACI), in a normative sample. Inter-rater reliability, stability over time, and convergent and discriminant validity were tested. Six-minute play…

Rubric-referenced calibration and the interaction between writing achievement and calibration, a measure of the relationship between one's performance and the accuracy of one's judgments, were investigated. Undergraduate students (N = 596) were assigned to one of three calibration conditions: (a) global, (b) global and general criteria, or (c)…

In this article, Hartley notes the difficulties of using questionnaires to assess the efficiency of new instructional methods and highlights nine issues that researchers must consider. Hartley continues the discussion about the use of questionnaires and suggests that psychology teachers can help improve the teaching of psychology by drawing…

This research investigated the statistical predictive power of organisational commitments for academics' teaching approaches. Participants were 268 academics working in six elite universities in Beijing, mainland China. Results showed that academics' organisational commitments as measured by the Organisational Commitment Inventory significantly…

This study examined the psychometric properties of the school engagement measure (SEM) in Singapore. The sample consisted of 1,027 students from a multi-ethnic Singapore adolescent community. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) confirmed that the two-factor solution, namely, (a) Emotional and (b) Cognitive…

The first aim of this study was to explore the reliability and validity of the Turkish version of the Theoretical Orientation Profile Scale-Revised, and the second aim was to understand the relative influence of personal and professional variables on the choice of a guiding theoretical orientation among Turkish counselor trainees. Results showed…

This study proposes a structured constructs model (SCM) to examine measurement in the context of a multidimensional learning progression (LP). The LP is assumed to have features that go beyond a typical multidimentional IRT model, in that there are hypothesized to be certain cross-dimensional linkages that correspond to requirements between the…

This article discusses talk and gesture as neglected sources of process data (Maddox, 2015, Maddox and Zumbo, 2017). The significance of the article is the growing use of various sources of process data in computer-based testing (Ercikan and Pellegrino, (Eds.) 2017; Zumbo and Hubley, (Eds.) 2017). The use of process data on talk and gesture…

Given family-school engagement is correlated with student academic achievement, educational researchers have long been interested in the construct. However, measuring parental engagement is deceptively challenging. The concept includes school-based engagement, home-based learning support, and family-school communication. In this article we focus…

The "ETS"® Proficiency Profile (EPP), a college-level assessment, has been widely used to evaluate general education student learning outcomes (SLOs) in college. The purpose of this study was to investigate validity evidence for the EPP by evaluating the relationship with outcomes such as student retention, cumulative grade point average…

Predicting and analyzing multimodal dialog user experience (UX) metrics, such as overall call experience, caller engagement, and latency, among other metrics, in an ongoing manner is important for evaluating such systems. We investigate automated prediction of multiple such metrics collected from crowdsourced interactions with an open-source,…