This toolkit is designed to guide educators in developing and improving practical measurement instruments for use in networked improvement communities (NICs) and other education contexts in which principles of continuous improvement are applied. Continuous improvement includes distinct repeating processes: understanding the problem, identifying…

Students typically find research methods and statistics classes intimidating. In particular, learning different types of data measurement and operationalization can take significant time and practice to understand. Utilizing a pedagogical approach that turns a party game into a fun exercise, students collaboratively learn to operationalize…

Purpose: There is little consensus in the literature regarding a) what it means for a school leader to lead with data, and b) how to measure data-informed leadership in a reliable and valid way. This study examines the psychometric properties of an operational measure intended to assess the extent to which a school leader is a data-informed school…

The influx of data and the advances in computing have led to calls to update the introductory statistics curriculum to better meet the needs of the contemporary workforce. To this end, we developed the COMputational Practices in Undergraduate TEaching of Statistics (COMPUTES) instrument, which can be used to measure the extent to which computation…

In an age of assessment and accountability, academic libraries feel much pressure to prove their value according to new university measurements of student success. This study describes a methodology for how libraries may examine student interactions with services to assess whether library usage impacts student grade point averages (GPAs) and…

Although there is a strong legislative base and perceived efficacy for multidisciplinary team decision making, limited evidence supports its effectiveness or consistency of implementation in practice. In recent research, we used the Decision Observation, Recording, and Analysis (DORA) tool to document activities and adult behaviors during positive…

Many large-scale cross-national studies rely on a single-item measurement when comparing prevalence rates of traditional bullying, traditional victimization, cyberbullying, and cyber-victimization between countries. However, the reliability and validity of single-item measurement approaches are highly problematic and might be biased. Data from…

This study aimed to document pre-service elementary teachers' (PSTs'), who are going to teach K-5, ability to construct as well as evaluate justifications varied in terms of levels of sophistication. Additionally, this study aimed to investigate how PSTs' knowledge of content in which they were being asked to prove influenced their ability to…

Since 1973, the National Assessment of Educational Progress (NAEP) has gathered information about student achievement in mathematics. Results of these periodic assessments, produced in print and web-based formats, provide valuable information to a wide variety of audiences. They inform citizens about the nature of students' comprehension of the…

In this paper we describe the development and refinement of "evidence rules" and "measurement models" within the "evidence model" of the "evidence-centered design" (ECD) framework in the context of the "Packet Tracer" digital learning environment of the "Cisco Networking Academy." Using…

The role of the administrator has evolved over the past 30 years from manager to instructional leader. As instructional leaders, administrators are now responsible for student achievement on high-stakes state-mandated assessments. Therefore, it is imperative principal preparation programs provide the necessary training instructional leaders need…

This study examined the status of critical thinking (CT) and reasoning skills in information communication and technology (ICT) for 190 college students in a higher education system. It analyzed how the students performed in CT, reasoning, and internet copyright and ethical issues. A CT assessment was designed to analyze the CT and reasoning…

This is the first of two reports that summarize the findings from an impact evaluation of a violence prevention intervention for middle schools. This report discusses findings after 1 year of implementation. A forthcoming report will discuss the findings after 2 years and 3 years of implementation. In 2004, the U.S. Department of Education (ED)…

Many people in higher education are looking to networked resources and services when formulating strategies for addressing the pursuits of learning, teaching, research, and community service. Sometimes it may be difficult to determine if users are seeing the same things or the "right" things. This manual provides a set of tools for…

This training text is designed to introduce program evaluation concepts and terminology to beginning program evaluators for state-federal vocational rehabilitation programs. Taking a research approach, the text covers the principles underlying program evaluation, and is geared to give the reader a basic understanding of how these principles can be…