Background: For decades, education researchers have relied on the work of Campbell, Cook, and Shadish to help guide their thinking about valid impact estimates in the social sciences (Campbell & Stanley, 1963; Shadish et al., 2002). The foundation of this work is the "validity typology" and its associated "threats to…

Supplemental resources in science education are made available to students based on the belief that they will improve course-based student learning. This belief is ubiquitous, with supplemental resources being a traditional component of physiology education. In addition, the recent large-scale transition to remote learning caused by the COVID-19…

The purpose of this research study was to identify the multimedia competencies of an educational technologist by creating a valid and reliable survey instrument to administer to educational technology professionals. The educational technology multimedia competency survey developed through this research is based on a conceptual framework that…

University science teachers' technological pedagogical and content knowledge (TPACK) is crucial for effective teaching. Although there has been a plethora of studies investigating pre-service and in-service teachers' TPACK, few studies have examined university instructors' TPACK and university students' perceptions of instructors' TPACK. The main…

Purpose: This paper aims to describe a construct validation study of the Change Facilitator Style Questionnaire (CFSQ), an instrument designed to measure the leadership style of school principals as change facilitators. Design/methodology/approach: Participants included 614 K-12 teachers across the state of Florida involved in the Enhancing…

We present a method for assessing science inquiry performance, specifically for the inquiry skill of designing and conducting experiments, using educational data mining on students' log data from online microworlds in the Inq-ITS system (Inquiry Intelligent Tutoring System; www.inq-its.org). In our approach, we use a 2-step process: First we use…

The online deployment of Technology Engineered online Student Ratings of Instruction (SRIs) by colleges and universities in the United States has dynamically changed the deployment of course evaluation. This research investigation is the fourth part of a post hoc study that analytically and psychometrically examines the design, reliability, and…

This paper presents the Model of Strategic e-Learning to explain and evaluate student e-learning from metacognitive perspectives. An in-depth interview, pilot study and main study are employed to construct the model and develop an instrument--the Online Learning Strategies Scale (OLSS). The model framework is constructed and illustrated by four…

Considerable research has been conducted examining the use of laptops in higher education, however, a reliable and valid scale to assess in-class use of laptops has yet to be developed. The purpose of the following study was to develop and evaluate the "Laptop Effectiveness Scale" (LES). The scale consisted of four constructs: academic…

There are a number of measurement instruments in the field of education whose aims are to measure various aspects of educational technology. However, the psychometric properties of such instruments are not always determined, and their use is not always appropriate. The aim of this study was to determine the psychometric properties of the survey of…

Learning objects are interactive web-based tools that support the learning of specific concepts by enhancing, amplifying, and/or guiding the cognitive processes of learners. Research on the impact, effectiveness, and usefulness of learning objects is limited, partially because comprehensive, theoretically based, reliable, and valid evaluation…

The use of proper measurements of diffusion of information technology as an innovation are essential to determining if progress is being made in state, regional, and national level programs. This project provides a national level cross validation study of several instruments commonly used to assess the effectiveness of technology integration in…

This study investigated the use of an online authentic assessment tool to evaluate students' fluency with the World Wide Web (WWW). Participants included 120 middle and high school students with a strong technology background and a familiarity with navigating the World Wide Web. Using the online Web Expertise Assessment and accompanying WWW…