Educational researchers often need to construct precise and reliable measurement scales of complex and varied representations such as participants' written work, videoed lesson segments and policy documents. Developing such scales using can be resource-intensive and time-consuming, and the outcomes are not always reliable. Here we present…

In Australia, one of the key findings of the Teacher Education Ministerial Advisory Group was that not all graduating pre-service teachers possess adequate pedagogical content knowledge (PCK) to teach effectively. The concern is that higher education providers working with pre-service teachers are using pedagogical practices and assessments which…

Validity is broadly defined as how well something measures what it's supposed to measure. The reliability and validity of scores from assessments are two concepts that are closely knit together and feed into each other.

The test view is on the Duolingo English Test (DET), an alternative online English proficiency test with a machine-driven characteristic. The review covers essential information of the DET such as test purpose, usage, score-mapping with CEFR scale, price, and publisher. Meanwhile, the test usefulness is discussed with focuses on reliability,…

General education science courses strive to promote scientific literacy and the development of scientific process skills. However, research shows that many general education courses are still designed to stress content mastery. In this study, the number of topics in five semester-long introductory atmospheric science courses was reduced to…

The main problem of the educational evaluation validity is that it just copies the conceptual framework system of validity from educational measurement to its own conceptual system. The validity conceptual system that fits the need of theory and practice of educational evaluation has not been established yet. According to the inherent attributive…

This paper aims to develop a valid method to assess the key competencies of the exercise physiology profession acquired through work-integrated learning (WIL). In order to develop a competency-based assessment, the key professional tasks needed to be identified and the test designed so students' competency in different tasks and settings could be…

In this "FastFacts," a state asks the Center on Enhancing Early Learning Outcomes (CEELO) to recommend experts in the field of assessing young children who are English Language Learners (ELL) to train administrators and psychologists working in district preschool programs for young children with special needs? This is particularly…

The Berkeley Evaluation and Assessment Research (BEAR) Center at the University of California is developing assessments that are as psychometrically sound as standardized tests and as instructionally relevant as teacher-made, classroom assessments. The BEAR system employs four principles similar to those outlined by the National Research Council:…

To address the need for a standardized system to classify the gross motor function of children with cerebral palsy, the authors developed a five-level classification system analogous to the staging and grading systems used in medicine. Nominal group process and Delphi survey consensus methods were used to examine content validity and revise the…

The Philosophies Held by Instructors of Lifelong-learners (PHIL) was developed to identify a respondent's preference for one of the major schools of philosophical thought: Idealism, Realism, Pragmatism, Existentialism, or Reconstructionism. Using the pool of items from an established instrument, its final form and content validity were determined…

Describes the development of a placement test specifically designed for students entering Pembroke State University. Includes question construction and suitable test standards in discussing the features of a good placement test. Concludes that the test provides a reliable measure of students potential success. (MDH)

With increasing reliance being placed on the results of their surveys, the National Center for Education Statistics (NCES) recognized a need for these survey results to be valid and reliable. As part of the work of the Statistical Analysis Group in Education (SAGE), an effort was undertaken to investigate validity and reliability in survey…

Describes the theoretical framework and practical application of the International Adult Literacy Survey (IALS). Concludes that the survey is based on an empirically-proven statistical construct that has been executed accurately with results that shed light on the relationship between functional literacy and national and individual well being.…

Describes the development of the "Standards Beliefs Instrument," an instrument to measure teachers' beliefs about the NCTM "Curriculum and Evaluation Standards." Discusses implications for using the instrument for self reflection, assessment of teachers' perspectives toward the vision of the "Standards," and…