Mathematics modelling is a vital competency for students of all ages. In this study, we aim to fill the research gap about valid and reliable tools for assessing and grading mathematical modeling problems, particularly those reflecting multiple steps of the modelling cycle. We present in this paper the design of a reliable and valid assessment…

In recent years, mathematical models of decision making, such as the diffusion model, have been endorsed in individual differences research. These models can disentangle different components of the decision process, like processing speed, speed-accuracy trade-offs, and duration of non-decisional processes. The diffusion model estimates individual…

This work sets out to examine the validity and reliability of the Mathematical Modeling Attitude Scale (MMAS), a instrument measuring teachers' attitude towards mathematical modeling. A cross-sectional survey research was utilised to describe the validity and reliability of the MMAS. The population of the present study focused on Malaysian…

This paper presents the design and development of a rubric for assessing mathematical modelling for mathematical modelling tasks at the secondary level. A rubric was crafted based on the mathematical modelling competencies synthesised by the researchers identified from four sources. The rubric was fine-tuned following an interview with three…

In recent years the use of expert judgement to set and maintain examination standards has been increasingly criticised in favour of approaches based on statistical modelling. This paper reviews existing research on this controversy and attempts to unify the evidence within a framework where expertise is utilised in the form of comparative…

The subject of the research is to build methodologies to evaluate the student knowledge by testing. The author points to the importance of feedback about the mastering level in the learning process. Testing is considered as a tool. The object of the study is to create the test system models for defence practice problems. Special attention is paid…

This paper aims to investigate how stability varies with the approach used in estimating school performance in a large sample of English primary schools. The results show that (a) raw performance is considerably more stable than adjusted performance, which in turn is slightly more stable than growth model estimates; (b) schools' performance…

Product assessment is widely applied in creative studies, typically as an important dependent measure. Within this context, this study had 2 purposes. First, the focus of this research was on methods for investigating possible rater effects, an issue that has not received a great deal of attention in past creativity studies. Second, the…

Traditional approaches to the investigation of the objectivity of ratings for constructed-response items are based on classical test theory, which is item-dependent and sample-dependent. Item response theory overcomes this drawback by decomposing item difficulties into genuine difficulties and rater severity. In so doing, objectivity of ability…

A technique is presented to transform incomplete categorical data into complete data by imputing appropriate scores into missing cells. A solution of the optimization problem is suggested, and relevant psychometric theory is discussed. The average correlation should be at least 0.50 before the method becomes practical. (SLD)

Using a recruitment test for Korean teachers, the use of the Rasch measurement model to control the effects of judge variable on the grading of essay-type items is examined. Ways of minimizing the variation of grading due to judge severity and reducing the number of judges without threatening objectivity of ability measurements are presented.…

Psychometric theory has been one of psychology's stronger foundations and a major contributor to the recognition of psychology as a scientific discipline. Basic principles of psychometric theory led to the development of respected intelligence tests and large and comprehensive testing and assessment programs. This paper synthesizes major…

The Rasch simple logistic model is used to examine the relative item parameter values of a personality inventory with respect to populations cross-classified by sex and country. While items conform to the model within each of the populations, half the items show significant discrepancies among the populations. (Author/RL)

This paper outlines the development of a quantitative instrument designed to measure students' multiple achievement goals and key aspects of their cognitive engagement in Australian educational settings. The paper demonstrates the use of congeneric measurement models in assessing and improving the validity of the scales comprising the Goal…

The consistency of ratings between two sections of a course taught by an instructor within a given semester was studied by examining sources of variation in rating instructor/course obtained through a college teacher evaluation system. Data were analyzed for five business school instructors at a Sogang University in Seoul (South Korea). Each…