Purpose: The purpose of this paper is to use an extreme case to identify and describe the nature of routines that might support processes and outcomes of data use, drawing from a framework developed by Coburn and Turner (2012a). Design/methodology/approach: The author conducted a four-month case study (Stake, 1995) of an elementary school in a…

Purpose: This policy brief, the third in the AERI-NEPC eBrief series "Understanding validity issues around the world", discusses validity issues surrounding International Large Scale Assessment (ILSA) programs. ILSA programs, such as the well-known Programme of International Student Assessment (PISA) and the Trends in International…

We discuss a recent development in the set theoretic analysis of data sets characterized by limited diversity. Ragin, in developing his Qualitative Comparative Analysis (QCA), developed a standard analysis that produces parsimonious, intermediate, and complex Boolean solutions of truth tables. Schneider and Wagemann argue this standard analysis…

Data collection can be a frustrating experience for student researchers due to difficulty in scheduling appointments with participants. To increase the efficiency of research project data collection, we organized a Research Participation Night in which volunteers were incentivized to participate in as many experiments as time allowed. By offering…

China has made great improvement on subsidizing poverty-stricken students, but the current approaches of granting subsidies is not scientific or humane. Poverty-stricken students who couldn't get sufficient subsidies in suitable ways need some new and more scientific granting approaches, which inspires me to go about this study. The approach, we…

Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement…

Data mining methods for classification and regression are becoming increasingly popular in various scientific fields. However, these methods have not been explored much in educational measurement. This module first provides a review, which should be accessible to a wide audience in education measurement, of some of these methods. The module then…

Influenced by the practices of social scientists, data journalists seek to create stories that frame social reality through quantitative data analysis. While the use of statistics by journalists is not new, exponential growth in available data and a desire for source material unmediated by political and public-relations framings have seen data…

Studies have shown that issues of privacy, control of data, and trust are essential to implementation of learning analytics systems. If these issues are not addressed appropriately, systems will tend to collapse due to a legitimacy crisis, or they will not be implemented in the first place due to resistance from learners, their parents, or their…

In working with individuals with intellectual and developmental disabilities (IDDs), it is direct care staff who are often required to collect data on individuals' behavior which is used as the basis for implementation of empirically based approaches for intervention and treatment. Due to limited resources, indirect and descriptive measures of…

The purpose of this perspective on practice is to share my experience conducting an organizational change evaluation using qualitative methodology at a multinational transportation company Global Logistics. I provide a detailed description of the three phase approach to data analysis and my reflections on the process.

Students of physical chemistry in biochemical disciplines need biochemical examples to capture the need, not always understood, of a difficult area in their studies. The use of thermodynamic data in the chemical reference state may lead to incorrect interpretations in the analysis of biochemical examples when the analysis does not include relevant…

The current study was designed to evaluate a rotating momentary time sampling (MTS) data collection system. A rotating MTS system has been used to measure activity preferences of preschoolers but not to collect data on responses that vary in duration and frequency (e.g., talking). We collected data on talking for 10 preschoolers using a 5-s MTS…

There is a strong, empirical link between facets of afterschool program quality and a range of positive youth outcomes. However, implementing quality programs that are more likely to produce positive youth development require a high-level of knowledge and expertise among program staff. Training staff on the critical components of high-quality…

In this paper, I extend the concept of observer effect into the realm of country-level secondary data analysis. When analyzing what appear to be the same secondary data using the same methods, macro-comparative researchers arrive at different results. I argue that this is a product of idiosyncratic variation directly or indirectly produced by the…