Quantitative evidence synthesis methods aim to combine data from multiple medical trials to infer relative effects of different interventions. A challenge arises when trials report continuous outcomes on different measurement scales. To include all evidence in one coherent analysis, we require methods to "map" the outcomes onto a single…

Reflexivity in quantitative research is central to questioning the ways in which the data is designed, collected and interpreted. It requires the researcher to be reflexive about their knowledge, their positionality, and the bias they may bring at each stage of the research. Unfortunately, though, limited evidence exists on the use of reflexive…

The exposure of scientific scandals and the increase of dubious research practices have generated a stream of studies on Questionable Research Practices (QRPs), such as failure to acknowledge co-authors, selective presentation of findings, or removal of data not supporting desired outcomes. In contrast to high-profile fraud cases, QRPs can be…

This guide offers a comprehensive handbook to scientific research methodology and experimental design, specifically for novice MA and PhD researchers in Education and Language Learning (TESOL/TEFL). It establishes scientific research as a systematic, objective inquiry focused on identifying cause-and-effect relationships through empirical data.…

The nonequivalent-groups anchor-test (NEAT) data-collection design is commonly used in large-scale assessments. Under this design, different test groups take different test forms. Each test form has its own unique items and all test forms share a set of common items. If item response theory (IRT) models are applied to analyze the test data, the…

Experimental psychology is witnessing an increase in research on individual differences, which requires the development of new tasks that can reliably assess variations among participants. To do this, cognitive researchers need statistical methods that many researchers have not learned during their training. The lack of expertise can pose…

The credibility of conclusions arrived at in quantitative research depends, to a large extent, on the quality of data collection instruments used to quantify language and non-language constructs. Despite this, research into data collection instruments used in Applied Linguistics and particularly in the thesis genre remains limited. This study…

We examined the performance of coefficient alpha and its potential competitors (ordinal alpha, omega total, Revelle's omega total [omega RT], omega hierarchical [omega h], greatest lower bound [GLB], and coefficient "H") with continuous and discrete data having different types of non-normality. Results showed the estimation bias was…

The purpose of this research is to identify the situation through content analysis of scale development studies conducted by Turkish researchers in the field of preschool education. Thus, the overall trend of scale development research in preschool education was established. This research is a document analysis study. The documents studied are…

Research funders and policymakers increasingly focus on societal benefits of their investments in research. Research institutions thus face increasing pressure to demonstrate their societal impact to prove their legitimacy and worth. To this end, research institutions need reliable, quantitative methods to measure societal impact. This article…

This research article reports on the initial findings of a critical quantitative study, which developed and implemented a series of quantitative scales utilizing conceptualizations of racial fragility and anti-racist teacher self-efficacy scales. The scales were administered through a survey and yielded a usable sample of 4770 teachers in…

The purpose of this literature review is to study the advantages and limitations of various through-course summative assessment (TCSA) models with the goal of informing the design of the new and innovative adaptive through-year assessment system at NWEA. This system solution will measure each student's command of grade-level standards and academic…

Attribute structure is an explicit way of presenting the relationship between attributes in diagnostic measurement. The specification of attribute structures directly affects the classification accuracy resulted from psychometric modeling. This study provides a conceptual framework for understanding misspecifications of attribute structures. Under…

Though several conceptual inventories have been developed for thermal physics, none target upper-division material and all focus specifically on thermodynamics without including statistical mechanics content. In this paper, we outline the development process of an upper-division thermal physics assessment that captures both thermodynamics and…

This paper focuses information literacy (IL) from a methodological perspective, addressing quantitative IL measures, suitable for evaluating the role of IL in supporting work activities. So far, IL in workplace contexts has mostly been studied using qualitative methods, designed for studying situational and context-dependent practices. Therefore…