In this study, we examined the results and interpretations produced from two different IRTree models--one using paths consisting of only dichotomous decisions, and one using paths consisting of both dichotomous and polytomous decisions. We used data from two versions of an impulsivity measure. In the first version, all the response options had…

Country differences in response styles (RS) may jeopardize cross-country comparability of Likert-type scales. When adjusting for rather than investigating RS is the primary goal, it seems advantageous to impose minimal assumptions on RS structures and leverage information from multiple scales for RS measurement. Using PISA 2015 background…

Background: Data literacy (DL) is vital for teachers, as it enables them to build on data and improve teaching and learning. Therefore, developing DL among pre-service teachers is critical. Objectives: The purpose of this study is threefold: to evaluate whether a feedback visualisation of peer assessment-based teaching approach (FVPA-based…

To develop competency in science practices, such as data analysis and interpretation, chemistry learners must develop an understanding of what makes an analysis and interpretation "good" (i.e., the criteria for success). One way that individuals extract the criteria for success in a novel situation is through making social comparisons,…

Posing statistical questions is a fundamental and often overlooked component of statistical inquiry. In this paper, we provide an overview of shared understandings regarding what constitutes a good statistical question. We then describe three approaches--a checklist for improving statistical questions, a three-phase feedback activity, and a…

Recent work on measuring growth with categorical outcome variables has combined the item response theory (IRT) measurement model with the latent growth curve model and extended the assessment of growth to multidimensional IRT models and higher order IRT models. However, there is a lack of synthetic studies that clearly evaluate the strength and…

Intelligent tutoring systems (ITSs) teach skills using learning-by-doing principles and provide learners with individualized feedback and materials adapted to their level of understanding. Given a learner's history of past interactions with an ITS, a learner performance model estimates the current state of a learner's knowledge and predicts her…

Scores estimated from multidimensional item response theory (IRT) models are not necessarily comparable across dimensions. In this article, the concept of aligned dimensions is formalized in the context of Rasch models, and two methods are described--delta dimensional alignment (DDA) and logistic regression alignment (LRA)--to transform estimated…

R and Python are commonly used software languages for data analytics. Using these languages as the course software for the introductory course gives students practical skills for applying statistical concepts to data analysis. However, the reliance upon the command line is perceived by the typical nontechnical introductory student as sufficiently…

Recent work on measuring growth with categorical outcome variables has combined the item response theory (IRT) measurement model with the latent growth curve (LGC) model (e.g., McArdle, 1988) and extended the assessment of growth to multidimensional IRT models (e.g., Hsieh, von Eye, & Maier, 2010; Huang, 2013) and higher-order IRT models…

Contribution: An automated methodology that provides visualizations of students' free text comments from course satisfaction surveys. Focusing on sentiment, these visualizations reveal learning and teaching aspects of the course that either may require improvement or are performing well. They provide educators with a simple, systematic way to…

We present an analysis of log data from a semester's use of the OpenDSA eTextbook system with the goal of determining the most difficult course topics in a data structures course. While experienced instructors can identify which topics students most struggle with, this often comes only after much time and effort, and does not provide real-time…

Previous research revealed significant differences in the effectiveness of various feedback sources for encouraging students' oral presentation performance. While former studies emphasised the superiority of teacher feedback, it remains unclear whether the quality of feedback actually differs between commonly used sources in higher education.…

Open-ended, short-answer questions, referred to as constructed responses (CR), allow students to express knowledge and skills through their own words. While CRs can reduce the likelihood of guessing correct answers, they also enable students to provide errant responses due to a lack of knowledge or a misunderstanding of the question.…

Lord's Wald test for differential item functioning (DIF) has not been studied extensively in the context of the multidimensional item response theory (MIRT) framework. In this article, Lord's Wald test was implemented using two estimation approaches, marginal maximum likelihood estimation and Bayesian Markov chain Monte Carlo estimation, to detect…