The purpose of this technical appendix is to share detailed results and more fully describe the sample and methods used to produce the research brief, "COVID's Impact on Science Achievement: Trends from 2019 through 2024. We investigated three main research questions in this brief: 1) How did science achievement in 2021 and 2024 compare to…

The aim of this research is to study the merits and complementarity of Construct Mapping and Categorical Principal Components Analysis as two approaches that explore the dimensionality of multiple-choice items in achievement tests. Data from the two forms of the Romanian National Assessment Tests on Science were used to explore the dimensionality…

Open ended and multiple choice questions are commonly placed on the same tests; however, there is a discussion on the effects of using different item types on the test and item statistics. This study aims to compare model and item fit statistics in a mixed format test where multiple choice and constructed response items are used together. In this…

It is a generally held view amongst educators today that the development of students' inference skills is an important aspect in their education as 21st Century learners as it requires higher order cognitive competences. Oftentimes, students in the lower tracks are considered slower learners and may have difficulties with the development of such…

While other fields such as statistics and education have examined various issues with quantitative work, few studies in physics education research (PER) have done so. We conducted a two-phase study to identify and to understand the extent of these issues in quantitative PER. During phase 1, we conducted a focus group of three experts in this area,…

Describing the motion in a vertical roller coaster loop requires a good understanding of Newton's laws, vectors and energy transformation. This paper describes how first-year students try to make sense of force and acceleration in this example of non-uniform circular motion, which was part of a written exam. In addition to an analysis of the exam…

Collaborative problem solving (CPS) is an important 21st-century skill that is crucial for both career and academic success. However, developing a large-scale and standardized assessment of CPS that can be administered on a regular basis is very challenging. In this report, we introduce a set of psychometric considerations and a general scoring…

Multiple-choice testing is a staple within the U.S. higher education system. From classroom assessments to standardized entrance exams such as the GRE, GMAT, or LSAT, test developers utilize a variety of validated and heuristic driven item-writing guidelines. One such guideline that has been given recent attention is to randomize the position of…

Problem solving is an integral part of doing science, yet it is challenging for students in many disciplines to learn. We explored student success in solving genetics problems in several genetics content areas using sets of three consecutive questions for each content area. To promote improvement, we provided students the choice to take a…

The aim of this study was to examine ninth-grade students' perception of a Swedish national test in science (high-stakes for the students) and a field trial (low-stakes for the students), in terms of test-taking motivation. The study is based on semi-structured interviews with 12 students. Overall, the students had a positive perception of the…

Assessment is a key lever for educational improvement. Assessments can be used to monitor, signal, and influence science teaching and learning -- provided that they are of high quality, reflect the rigor and intent of academic standards, and elicit meaningful student performances. Since the release of "A Framework for K-12 Science…

One of the fatal problems emerge in educational practice is misconception as it is related to the students' understanding. Consequently, these must be detected at the beginning of learning process. This research was conducted to construct and develop the specific diagnostic test to detect the misconception in protist material. The instrument…

This research investigated how collaborative e-learning strategies affected the understanding of DNA Replication among the 9th-grade Biology CC class. The study involved 24 diverse students (ages 15-17), including regular education students, English Language Learners (ELLs), and students with IEPs selected through proportional stratified random…

Plant identification is a critical skill for students in biological sciences, especially forestry. Many students begin with limited plant identification abilities and struggle to learn this skill. To support student learning of identification and ecological characteristics of important forest plants in an undergraduate forest ecology course at the…

This study was conducted to examine the achievements of students in the concepts of light and shadow measured in different assessment formats according to the learning style and gender. In this study, correlational survey model was used. The sample consisted of 10th grade (16 years) high school students (n=815) from different types of six high…