This study aimed at constructing a criterion-reference test to measure the research and statistical competencies of graduate students at the Jordanian governmental universities, the test has to be in its first form of (50) multiple choice items, then the test was introduced to (5) arbitrators with competence in measurement and evaluation to…

This study investigated the effects of practical activities and manual on science students' academic performance on solubility in Uruan Local Education Authority of Akwa Ibom State. The study adopted pretest, posttest non randomized quasi experimental design. Three research questions and three hypotheses were formulated to guide the study. One…

In preparation for online administration of the ACT® test, ACT conducted studies to examine the comparability of scores between online and paper administrations, including a timing study in fall 2013, a mode comparability study in spring 2014, and a second mode comparability study in spring 2015. This report presents major findings from these…

This study compared several exposure control procedures for CAT systems based on the three-parameter logistic testlet response theory model (Wang, Bradlow, & Wainer, 2002) and Masters' (1982) partial credit model when applied to a pool consisting entirely of testlets. The exposure control procedures studied were the modified within 0.10 logits…

Nested logit models have been presented as an alternative to multinomial logistic models for multiple-choice test items (Suh and Bolt in "Psychometrika" 75:454-473, 2010) and possess a mathematical structure that naturally lends itself to evaluating the incremental information provided by attending to distractor selection in scoring. One potential…

A central goal of science education is to help students to develop their higher order thinking skills to enable them to face the challenges of daily life. Enhancing students' higher order thinking skills is the main goal of the Kurdish Science Curriculum in the Iraqi-Kurdistan region. This study aimed at assessing 7th grade students' higher order…

Optimal assessment tools should measure in a limited time the knowledge of students in a correct and unbiased way. A method for automating the scoring is multiple choice scoring. This article compares scoring methods from a probabilistic point of view by modelling the probability to pass: the number right scoring, the initial correction (IC) and…

Multiple-choice exams, while widely used, are necessarily imprecise due to the contribution of the final student score due to guessing. This past year at the United States Naval Academy the construction and grading scheme for the department-wide general chemistry multiple-choice exams were revised with the goal of decreasing the contribution of…

Do multiple choice unit tests reflect what students have learned during the unit? The day before the administration of a county-mandated multiple choice test, two classes were shown a topic they had not previously seen, and told it would be on the test. One class was shown the same material and told it was not important, and two classes were not…

Concept inventory tests are one method to evaluate conceptual understanding and identify possible misconceptions. The multiple-choice question format, offering a choice between a correct selection and common misconceptions, can provide an assessment of students' conceptual understanding in various dimensions. Misconceptions of some engineering…

Item development is a time- and resource-intensive process. Automatic item generation integrates cognitive modeling with computer technology to systematically generate test items. To date, however, items generated using cognitive modeling procedures have received limited use in operational testing situations. As a result, the psychometric…

Energy is one of the most central and richly connected ideas across all science disciplines. The purpose of this study was to develop a measurement instrument for assessing students' understanding of the energy concept within and across different science disciplines. To achieve this goal, the Inter-Disciplinary Energy concept Assessment (IDEA) was…

Researchers have widely adopted measures of teachers' mathematical knowledge for teaching (MKT). This paper investigates why teachers select "I'm not sure" as a suggested solution in MKT items. In this study, in-service teachers responded to multiple-choice MKT items, they submitted written responses to open-ended questions, and they…

The amount of research evaluating the technical merits of general outcome measures of science and social studies achievement is growing. This study targeted criterion validity for critical content monitoring. Questions addressed the concurrent criterion validity of alternate presentation formats of critical content monitoring and the measure's…

There are various types of instructional media related to Valence Shell Electron Pair Repulsion (VSEPR) but there is a lack of diversity of resources devoted to assessment. This research presents an assessment and comparison of students' understanding of VSEPR theory before and after tuition involving the use of the foam molecule model (FMM) and…