This report presents a review of the statistical practices of 30 journals representative of the second language field. A review of 150 articles showed a number of prevalent statistical violations including incomplete reporting of reliability, validity, non-significant results, effect sizes, and assumption checks as well as making inferences from…

Second language (L2) research relies heavily and increasingly on ANOVA (analysis of variance)-based results as a means to advance theory and practice. This fact alone should merit some reflection on the utility and value of ANOVA. It is possible that we could use this procedure more appropriately and, as argued here, other analyses such as…

Traditions of statistical significance testing in second language (L2) quantitative research are strongly entrenched in how researchers design studies, select analyses, and interpret results. However, statistical significance tests using "p" values are commonly misinterpreted by researchers, reviewers, readers, and others, leading to…

Good practice in primary research has evolved over many decades of research in applied linguistics to counter human fallibility and biases. Surprisingly, perhaps, synthesising such research in an entire field has only recently started to develop its own methodologies and recommendations. This paper outlines some of the issues involved, especially…

Applied linguists have turned increasingly in recent years to meta-analysis as the preferred means of synthesizing quantitative research. The first step in the meta-analytic process involves defining a domain of interest. Despite its apparent simplicity, this step involves a great deal of subjectivity on the part of the meta-analyst. This article…

This research project case study describes the research practicalities and design of a mixed methods dissertation study about the language-learning motivation of students who had attended a language immersion school. Mixed methods research, an approach to research in which elements of both quantitative (numbers-focused) and qualitative…

Studies by the National Association for Educational Progress found that English Language Learner (ELL) students perform poorly compared to other students on standardized mathematics exams. The research problem addressed how Sheltered Instruction Observation Protocol (SIOP) affected the instructional practices of high school mathematics teachers.…

Considers both qualitative and quantitative research approaches on second language learning, with focus on second language classroom research. Concludes that both approaches are relevant to determining the important variables to investigate and the relationships those variables have to second language learning outcomes. (Author/CB)

Several methodological issues related to second language acquisition research are considered, and a two-part study is discussed that addresses issues related to data collection, i.e., how and how frequent, and data analysis, i.e., the appropriateness of the statistical tools, the justification of inferences and the comparability of results based…

One of the overriding problems of any psychometric study is that aspects of behavior that are nonquantifiable or difficult to quantify are not considered. The other side of this coin is that those aspects of behavior that are easiest to quantify tend to be what are examined. In evaluating bilingual education programs, problems are found in the…