Evaluation data helps inform decision-makers about the time, human capital, and funding required for professional learning to be effective. Evaluation data also guides program improvement and sets leaders' expectations for ongoing monitoring and accountability. The complexities of the educational systems in which professional learning happens mean…

Penciling, a technique used to anonymize images for both human and machine vision, offers an opportunity to reduce technical traceability and retain visual data for online and social media research contexts. Drawing on methods for creating composite narrative and visual accounts to preserve participant anonymity, penciling enables researchers to…

I propose two practical advances to the argument-based approach to validity: developing a living document and incorporating preregistration. First, I present a potential structure for the living document that includes an up-to-date summary of the validity argument. As the validation process may span across multiple studies, the living document…

Within educational research, qualitative data offers unique opportunities to contextualize findings that arise from large-scale quantitative data collection processes. Still, to date, most educational research is based on researchers' determination of what is important, not the participants'. Participatory Rank Methodology (PRM) is a…

The five SEERNet digital learning platforms (DLPs) present unique opportunities for researchers by offering tools, processes, and infrastructure to make research more efficient, scalable, and relevant. However, conducting research within a DLP may require a shift in a researcher's orientation or mindset in how they think about potential research…

The U.S. Department of Education's (ED) Office for Civil Rights (OCR) administers the Civil Rights Data Collection (CRDC), which is a mandatory survey of all public schools and school districts in the 50 states, Washington, D.C., and the Commonwealth of Puerto Rico. To support school districts' timely submission of accurate data, OCR takes steps…

This article considers the multiple relations that emerge from and between Facebook commenters, as well as between commenters, researchers, and the research project during recruitment. To do so, we draw on our experiences of recruiting individuals who have concerns about or are opposed to a range of recent social and legal changes in…

The development of research methodology in any scientific field is closely tied to technological advancements that allow for deeper and more sophisticated data analysis. To help readers understanding the scope of current lexical availability research, this chapter provides a description of the tools and research resources specifically developed…

Stories are more than they seem. Stories can connect humans with other humans, more-than-human things, animals, places and times. And stories can disrupt dominant ways of knowing and being in the world (Ranco & Haverkamp, 2022). Re-telling stories of connection and disruption in research, this paper shares four short autoethnographic musings,…

Program evaluation can seem like a daunting task, but it is an important charge to undertake. This article is designed to provide gifted coordinators, teachers, and anyone else who wants to complete a program evaluation with guidance on how to work through a program evaluation by establishing the importance of program evaluation (e.g., Callahan,…

This paper investigates the methodological discrepancies underlying the measurement of adult learning and education (ALE) participation in the UK by focusing on four major surveys -- APiL, PIAAC, AES, and LFS. Grounded in the Total Survey Error (TSE) framework, we systematically examined the surveys' documentation and compared their definitions,…

Statewide longitudinal data systems (SLDSs) often rely on personal identifiers to securely link individual-level data across early childhood, K-12, higher education, and the workforce. However, different sectors use different types of personal identifiers which can make accurately connecting records difficult. Driver's license data offers a single…

The practice of statistics has the power to motivate and support learning across the STEM (Science, Technology, Engineering, and Mathematics) disciplines. When connected with meaningful science contexts, statistical problem solving through the collection of data and subsequent data analysis, supported by contemporary graphing technology, presents…

Data is ubiquitous and inseparable from the human experience. It constantly informs and transforms interactions, decisions, and understanding. If the total amount of all the data created daily was printed on paper, it would fill a library the size of 110 Libraries of Congress. As a senior research consultant for an education market research and…

Extracting data from studies is the norm in meta-analyses, enabling researchers to generate effect sizes when raw data are otherwise not available. While there has been a general push for increased reproducibility in meta-analysis, the transparency and reproducibility of the data extraction phase is still lagging behind. Unfortunately, there is…