The reliability of an assessment is defined as the extent to which candidates' results would remain stable if the entire assessment exercise was repeated. Whilst numerous studies have evaluated the reliability of written examinations, relatively little has been done to quantify the reliability of internal teacher assessment within schools. This is…

This article provides a detailed account of a rubric revision process to address seven common problems to which rubrics are prone: lack of consistency and parallelism; the presence of "orphan" and "widow" words and phrases; redundancy in descriptors; inconsistency in the focus of qualifiers; limited routes to partial credit;…

We comprehensively compared all available questionnaires for measuring quantitative autistic traits (QATs) in terms of reliability and construct validity in 3,147 non-clinical and 60 clinical subjects with normal intelligence. We examined four full-length forms, the Subthreshold Autism Trait Questionnaire (SATQ), the Broader Autism Phenotype…

This paper's aim is to discuss the concept of width of a proof put forward by Timothy Gowers. It explains what this concept means and attempts to show how it relates to other concepts discussed in the existing literature on proof and proving. It also explores how the concept of width of a proof might be used productively in the mathematics…

This article advances the enlightened discussion of the nature, logic, and possible effects of the Programme for International Student Assessment (PISA). The purpose is to analyse the assumptions regarding how PISA is to achieve its intended effects, that is, to reconstruct PISA's programme theory (PT) and to probe the validity of its underlying…

The received view of mathematical practice is that mathematicians gain certainty in mathematical assertions by deductive evidence rather than empirical or authoritarian evidence. This assumption has influenced mathematics instruction where students are expected to justify assertions with deductive arguments rather than by checking the assertion…

Implications of the multiple-use of accountability assessments for the process of validation are examined. Multiple-use refers to the simultaneous use of results from a single administration of an assessment for its intended use and for one or more additional uses. A theoretical discussion of the issues for validation which emerge from…

A well-known result of Feinberg and Shannon states that the tribonacci sequence can be detected by the so-called "Pascal's pyramid." Here we will show that any tribonacci-like sequence can be obtained by the diagonals of the "Feinberg's triangle" associated to a suitable "generalized Pascal's pyramid."…

Purpose: The purpose of this paper is to validate an instrument for the Ghoshal and Bartlett model and operationalize its four attributes into a multidimensionality instrument questionnaire. This study operationalizes the four attributes, namely, discipline, support, trust and stretch, into a multidimensionality instrument questionnaire and tests…

Claims of changes in the validity coefficients associated with general mental ability (GMA) tests due to the passage of time (i.e., temporal validity degradation) have been the focus of an on-going debate in applied psychology. To evaluate whether and, if so, under what conditions this degradation may occur, we integrate evidence from multiple…

Metacognitive monitoring processes have been shown to be critical determinants of human learning. Metacognitive monitoring consist of various knowledge estimates that enable learners to engage in self-regulatory processes important for both the acquisition of knowledge and the monitoring of one's knowledge when engaged in assessment. This study…

This study focuses on the confirmatory factor analysis for testing validity and reliability of Traditional Knowledge Attitude Scale (TKAS) to measure university students' attitudes. The items in the TKAS were developed initially from the responses to two open-ended items by 30 university students and literature review on traditional knowledge.…

Background: Engineering educators and practitioners increasingly value contextual competence. A psychometrically sound, practical, and useful scale for assessing undergraduate engineering students' contextual competence is needed. Purpose/Hypothesis: This article provides comprehensive evidence of the content, structural, discriminant, and…

Background: Concept inventories (CIs) are commonly used in engineering disciplines to assess students' conceptual understanding and to evaluate instruction, but educators often use CIs without sufficient evidence that a structured approach has been applied to validate inferences about student thinking. Purpose: We propose an analytic framework for…

Context is an important aspect of educational research and the technological pedagogical content knowledge (TPACK) framework, but is often missing from TPACK research, or its specific meaning is not clear. To provide a systematic and comprehensive view of the extent to which context is included in such research, and to understand the meaning of…