One of the widely known evaluation models adapted to education is the Kirkpatrick model. However, this model has limitations when used by evaluators especially in the complex environment of higher education. Addressing the scarcity of a collective effort on discussing these limitations, this review paper aims to present a descriptive analysis of…

In this study, the effect of using on-screen calculators on eighth grade students' performance on two TIMSS 2019 Problem Solving and Inquiry Tasks items considered as examples of technology-enhanced items administered on computers was examined. For this purpose, three logistic regression models were run where the dependent variables were giving a…

Collaborative problem solving (CPS) is inherently an interactive, conjoint, dual-strand process that considers how a student reasons about a problem as well as how s/he interacts with others to regulate social processes and exchange information (OECD, 2013). Measuring CPS skills presents a challenge for obtaining consistent, accurate, and reliable…

The purpose of this study was to explicate one preservice middle grades mathematics teacher's Knowledge of Content and Students (KCS) in the context of multiple solution strategies. This study's purpose is to underline the importance of preservice teachers' KCS and provide possible investigative methods for evaluating preservice teachers' KCS.…

In the preschool period, children's friendships considered a crucial developmental task. Hence, it is critical to evaluate children's mental representations of friendships during this period. This study aims to evaluate the validity and reliability of the story completion protocol designed to evaluate preschool children's mental representations of…

Errors in examination papers and other assessment instruments can compromise fairness. For example, a history question containing an incorrect historical date could be impossible for students to answer. Incorrect instructions at the start of an examination could lead students to answer the wrong number of questions. As there is little research on…

The aim of this study is to investigate the impact of online peer feedback in the Information Technologies and Software course on the improvement of collaborative problem-solving skills (CPS), which are considered essential skills for the 21st century. The impact of peer feedback on CPS was designed using a mixed-methods approach that combines…

This study was carried out to develop a test to assess algorithmic thinking skills. To this end, the twelve steps suggested by Downing (2006) were adopted. Throughout the test development, 24 middle school sixth-grade students and eight experts in different areas took part as needed in the tasks on the project. The test was given to 252 students…

The use of multiple-choice items for classroom testing is firmly established for many good reasons. The content any unit or course of study can be well sampled. Test scores can be reliable (trusted). And time spent administering and scoring can be minimized. This article provides a current review of best practices in the design and use of a…

The aim of this paper is to introduce a software that is appropriate for the generalizability theory for not only balanced but also unbalanced data sets. Because it is possible to have unbalanced data sets while conducting a study, the researchers have devised an easy solution, other than deleting data, to balance the design to cope with this…

This study investigated the factors that are directly and indirectly related to collaborative problem-solving skills of students in Türkiye with multiple and multilevel mediation models, according to PISA 2015 results. The PISA 2015 Türkiye sample consisted of 5895 students. After missing data assignment and outlier analysis, the analyses were…

Experimental studies have a considerable impact on the educational policies and practices of many countries. In Turkey, policymakers are planning to initiate a STEM education reform in K-12 schools based on experimental studies. However, the methodological flaws in these studies may lead to biased outcomes and may mislead the STEM education…

The purpose of this research is to examine measurement invariance of collaborative problem solving skills measured by PISA 2015 Xandar subtest for Singapore, Norway, and Turkey. The research was conducted with 2990 participants' data obtained from Turkey (1032), Norway (923), and Singapore (1035) on PISA 2015 collaborative problem solving study.…

This study analyses teachers' viewpoints on the potential undesirable influences of high stake exams. Seven stimulants related to undesirable influences of high stake exams on education were given to 191 teachers in a pairwise comparisons format. The participating teachers in this study were asked to choose one undesirable influence by comparing…

This study aimed to adapt the Physical Metacognition Inventory (PMI) developed by Taasoobshirazi and Farley (2013) to Turkish. PMI consists of 24 items and six factors. The scale items were translated into Turkish by the researchers, and a Turkish-English comprehensibility form was prepared to elicit the opinions of Turkish-English language…