Undergraduate economics programs prepare students for future careers by developing competency working with data, or "data literacy." Our research examined the data literacy components of undergraduate economics programs at R1 and R2 universities in the United States (N = 190). We developed a protocol with core data skills and coded…

Despite the rising popularity of big data, there is speculation that evaluators have been slow adopters of these new statistical approaches. Several possible reasons have been offered for why this is the case: ethical concerns, institutional capacity, and evaluator capacity and values. In this method note, we address one of these barriers and aim…

Transcription is an integral part of much qualitative data analysis, yet rarely has it received close attention in debates over the use (or non-use) of "computer assisted qualitative data analysis software" (CAQDAS). This article draws upon a mixed-methods study that involved transcribing conversational interviews with carers, third…

Engaging with primary researchers during qualitative secondary analysis is a practice much recommended but rarely written about. In this article, I reflect on my experience of crossing an imagined boundary between the discrete textual dataset and its creators, of acknowledging and engaging with those researchers who invested in constructing the…

This paper is a philosophical piece relating to an issue in education theory: what is the epistemological nature of the product of education research and what are the consequences for the reporting of findings and conclusions in particular, what form of contribution to knowledge and/or understanding can emerge from education research? Education…

Interest in applied educational research methodology is growing as educators and researchers strive to seek empirical evidence about what is effective teaching within distinctive contexts. However, for beginner researchers who are interested in conducting case studies within educational settings and are looking for an appropriate starting point,…

To ensure validity in survey research, it is imperative that we properly educate doctoral students on best practices in data quality procedures. A 14-year analysis of 679 studies in the AIS "Basket of 8" journals noted undercommunication in the most pertinent procedures, consistent across journals and time. Given recent calls for…

Consultation relies on story. This is true for researchers, for practitioners, and for clients. Given this fact, qualitative and mixed methods (QMM) research are particularly well suited to listening to the stories that compose the clinical practice of consultation in order to extend understanding and to support improvement and innovation. In this…

This article draws on a new materialist paradigm to explore bricolaging data from an early childhood research project through an immanent ethical lens. This lens enables the researcher to stretch towards non-hierarchical relationships in between subjects and objects, thinking and doing. A bricoleur explores and builds different…

In undergraduate research settings, students are likely to encounter anomalous data, that is, data that do not meet their expectations. Most of the research that directly or indirectly captures the role of anomalous data in research settings uses post-hoc reflective interviews or surveys. These data collection approaches focus on recall of past…

Multimodal learning analytics (MMLA) has increasingly been a topic of discussion within the learning analytics community. The Society of Learning Analytics Research is home to the CrossMMLA Special Interest Group and regularly hosts workshops on MMLA during the Learning Analytics Summer Institute (LASI). In this paper, we articulate a set of 12…

The use of inter-rater reliability (IRR) methods may provide an opportunity to improve the transparency and consistency of qualitative case study data analysis in terms of the rigor of how codes and constructs have been developed from the raw data. Few articles on qualitative research methods in the literature conduct IRR assessments or neglect to…

This paper argues for three aspects of tolerance with respect to QCA research: tolerance with respect to different approaches to QCA; producing QCA research with tolerance (work that is resistant to criticism); and for QCA researchers to be clear about the tolerance of the solutions they present -- especially in terms of calibration and truth…

Single-subjects design has the advantage of providing detailed, individualized analyses of intervention. However, creating a tutorial for single-subject design (SSD) is challenging, and an effective version for online delivery is currently unavailable. Here, we developed an experiential SSD tutorial designed for online delivery and evaluated its…

In the past decade, moderated mediation analysis has been extensively and increasingly employed in social and behavioral sciences. With its widespread use, it is particularly important to ensure the moderated mediation analysis will not bring spurious results. Spurious effects have been studied in both mediation and moderation analysis, but this…