Purpose: Overall quantitative research aims to observe certain fundamental principles of logic and scientific frame of reasoning. There continues to be challenges on how quantitative research is conducted in the field of information systems. Design/methodology/approach: Structured equation modelling (SEM) research identifies concerns about the…

In this study, we present the Pseudoscientific Belief Scale (PSEUDO; [alpha] = 0.90). The conceptual foundations of the scale include (a) a philosophically grounded and functional demarcation criterion between science and pseudoscience; (b) an analysis of the pseudoscientific status of science denialism, which is integrated into the scale; and (c)…

The current study examined the psychometric properties of scores from the Redox Concept Inventory (ROXCI) scores using both confirmatory factor analysis (CFA) and Rasch analysis. CFA analysis provides evidence for construct validity, and Rasch analysis demonstrates the performance of ROXCI items in terms of their accuracy in estimating person…

Representational competence is essential for the acquisition of conceptual understanding in physics. It enables the interpretation of diagrams, graphs, and mathematical equations, and relating these to one another as well as to observations and experimental outcomes. In this study, we present the initial validation of a newly developed…

Purposes: This study uses think-alouds and cognitive interviews to provide validity evidence for an online formative assessment--i-Ready Standards Mastery (iSM) mini-assessments--which involves a heavy use of innovative items. iSM mini-assessments are intended to help teachers determine student understanding of each of the on-grade-level Common…

The development of valid and reliable strategies to efficiently determine the knowledge landscape of introductory astronomy college students is an effort of great interest to the astronomy education community. This study examines individual item response rates from a widely used conceptual understanding survey, the Test Of Astronomy Standards…

Background: In the last few decades, researchers have turned their attention to students' understanding of scientific concepts at different school levels. The results indicate that the learners have different ideas, and most of them are inaccurate in terms of those generally accepted by the scientific community. Purpose: This study was undertaken…

Background: Misconceptions are major obstacles to learning physics, and the concepts of heat and temperature are some of the common misconceptions that are encountered in daily life. Therefore, it is important to develop valid and reliable tools to determine students' misconceptions about basic thermodynamics concepts. Three-tier tests are…

The Climate Stewardship Survey (CSS) was developed to measure knowledge and perceptions of global climate change, while also considering information sources that respondents 'trust.' The CSS was drafted using a three-stage approach: development of salient scales, writing individual items, and field testing and analyses. Construct validity and…

This study describes the development and validation of a three-tier multiple-choice diagnostic test, the atmosphere-related environmental problems diagnostic test (AREPDiT), to reveal common misconceptions of global warming (GW), greenhouse effect (GE), ozone layer depletion (OLD), and acid rain (AR). The development of a two-tier diagnostic test…

The purpose of this article is to provide an overview of the process used to examine the inter-rater reliability of the Teacher Work Sample (TWS) Scoring Rubric involved with the senior culminating experience for teacher candidates used at a large comprehensive university. The study compared holistic and analytic scores reported by Student Teacher…

Distractor-driven multiple-choice assessment items and Rasch modeling were used as diagnostic tools to investigate students' understanding of middle school chemistry ideas. Ninety-one items were developed according to a procedure that ensured content alignment to the targeted standards and construct validity. The items were administered to 13360…

The undermining effect of extrinsic reward on intrinsic motivation remains unproven. The key unresolved issues are construct invalidity (all four definitions are unproved and two are illogical); measurement unreliability (the free-choice measure requires unreliable, subjective judgments to infer intrinsic motivation); inadequate experimental…