Evaluating digital competencies has become a topic of growing interest in recent years. Although several reviews and studies have summarized the main elements of progress and shortcomings in this area, some issues are yet to be explored. Very little information is available about the ways of ensuring the validity and reliability of the instrument…

One of the challenges of discussing validity arguments for machine scoring of essays centers on the absence of a commonly held definition and theory of good writing. At best, the algorithms attempt to measure select attributes of writing and calibrate them against human ratings with the goal of accurate prediction of scores for new essays.…

The aim of this paper is to describe the process of modification of the research tool designed for measuring the development of personal epistemology--"Standardized Epistemological Understanding Assessment" (SEUA). SEUA was constructed as an improved version of the instrument initially proposed by Kuhn et al. SEUA was proved to be a more…

This study aimed to develop a reliable and valid scale to reveal the cognitive biases of university students in context of analytical thinking skills. During scale development process, firstly, a 5-point Likert type scale pre-trial form consisting of 60 items was created. The pre-trial form was applied to 450 students in Afyon Kocatepe University.…

School psychologists often have reason to suspect that students may not be putting forth full effort during diagnostic tests, or that questionnaire or rating scale data are not credible. However, such suspicions must be tested carefully to yield data-based conclusions. Structured, empirically supported methods for assessing the "response…

Despite widespread use of the Student Course Engagement Questionnaire (SCEQ; Handelsman, Briggs, Sullivan, & Towler, 2005) for the purposes of measuring college student engagement in scholarship of teaching and learning (SoTL) contexts, few studies have been published regarding its psychometric validity. The current study examined the…

This study sought to develop and validate an instrument to test the self-efficacy of teaching engineering design. This study is part of a larger effort to develop an instrument for both pre-service and in-service teachers of Science, Technology, and Engineering education. The focus of this study is on the initial instrument creation process and…

Background: Systematic collection of scientific evidence on the applicability an usability of model and its components is an important aspect of design and development research. Purpose: The aim of this study is to determine external validity of the organic reaction teaching model in terms of its practicability and potentiality in enhancing…

International English Language Testing System (IELTS) scores have been widely used as the language entry requirements for international students in many English-medium universities. However, research on the predictive validity of IELTS on subsequent academic performance has been inconclusive. Additionally, despite the proliferation of IELTS…

This study tested the psychometric properties of the "Sense of Belonging in STEM" Scale (SOB-STEM), a new scale measuring students' subjective evaluation of their academic and social experiences in STEM learning contexts, primarily focusing on purposeful interpersonal interactions. Data from 758 college students were analyzed, yielding…

This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If…

To date, no measure of perceptions reflecting the view of childhood as a social construction exists within the fields of developmental psychology or education. The aim of this small-scale study was to develop items to assess beliefs about children along a spectrum -- at one end of the spectrum conceptualizing children as human "beings"…

The quality of data in surveys is affected by response burden and questionnaire length. With an increasing number of questions, respondents can become bored, tired, and annoyed and may take shortcuts to reduce the effort needed to complete the survey. In this article, direct evidence is presented on how the position of items within a web…

This paper presents a unified Arabic version of the English action verbs mentioned in Bloom's taxonomy (1956) that has been checked for validity and reliability by a panel of education experts. Methodologically, the Bloom's list of action verbs was first translated into Arabic by an expert professor of translation. Then, using a mixed-method…

Civil engineering students in the United States rarely receive instruction about how their work affects social inequities. Indeed, research reveals that most engineering students lack critical consciousness and fail to recognize and analyze real social inequity challenges as they arise in engineering contexts. As history demonstrates, this can…