This article reports on the development of the literary portfolio as an alternative to standard written tests in summative assessment of literary competences in the English as a foreign language (EFL) classroom. It is argued that traditional class tests put a too narrow focus on those aspects of literary competences that are more readily…

The purpose of this study is to identify to what extent that the reading comprehension, question types, attitude toward science, test method, and subject matter knowledge predict the PISA scientific literacy scores of the students. The study uses the method of correlational research, which is a type of quantitative research method. We reached out…

In this study, whether item position effects lead to DIF in the condition where different test booklets are used was investigated. To do this the methods of Lord's chi-square and Raju's unsigned area with the 3PL model under with and without item purification were used. When the performance of the methods was compared, it was revealed that…

The application of knowledge to new contexts (i.e., transfer) is a central aim of learning processes and has become a new focus of testing effect research. In a quasi-experimental design, we investigated the transfer of retrieval practice effects on English vocabulary learning on eighth-grade students (N = 182) by applying a typical testing effect…

This study aims to examine Turkish exam papers of the students, who study in the secondary school of 5th, 6th, 7th and 8th classes. The exam papers have been examined from various aspects, including the number and type of questions, the language expression and distribution of the questions, the cognitive level (according to the Bloom's taxonomy),…

In this research, the effect of an item's type and cognitive level on its difficulty index was investigated. The data source of the study consisted of the responses of the 12535 students in the Turkey sample (6079 and 6456 students from eighth and fourth grade respectively) of TIMSS 2015. The responses were a total of 215 items at the eighth-grade…

In online environments, listening involves being able to pause or replay the recording as needed. Previous research indicates that control over the listening input could improve the measurement accuracy of listening assessment. Self-pacing also supports the second language (L2) comprehension processes of test-takers with specific learning…

The purpose of this study was to examine eighth-grade students' science performance in terms of two test design components, item format, and cognitive domain. The portion of Taiwanese data came from the 2011 administration of the Trends in International Mathematics and Science Study (TIMSS), one of the major international large-scale assessments…

Wording effects associated with positively and negatively worded items have been found in many scales. Such effects may threaten construct validity and introduce systematic bias in the interpretation of results. A variety of models have been applied to address wording effects, such as the correlated uniqueness model and the correlated traits and…

The purpose of this study is to investigate whether students are more successful on abstract or illustrated test questions. To this end, the questions on an abstract test were changed into a visual format, and these tests were administered every three days to a total of 240 students at six middle schools located in the Erzurum city center and…

The chapters in this online volume comprise the TIMSS & PIRLS International Study Center's technical report of the methods and procedures used to develop, implement, and report the results of TIMSS 2019. There were various technical challenges because TIMSS 2019 was the initial phase of the transition to eTIMSS, with approximately half the…

Home language (HL) effects on academic language literacy have been extensively discussed. However, previous research has mostly focused on Indo--European languages. This study extends the literature by using data (n = 17,600) collected in a diversified language area: Guangxi, China. We examined the effects of four HLs and four socioeconomic…

The aim of the article is to investigate the effects of the foreign language section of TEOG (Transition Examination from Primary to Secondary Education) on language teacher practices in the classroom. The participants of the study include 30 English language teachers working at lower secondary schools in Turkey. The results of the study indicate…

Many scales contain both positively and negatively worded items. Reverse recoding of negatively worded items might not be enough for them to function as positively worded items do. In this study, we commented on the drawbacks of existing approaches to wording effect in mixed-format scales and used bi-factor item response theory (IRT) models to…

The so-called control-of-variables strategy (CVS) incorporates the important scientific reasoning skills of designing controlled experiments and interpreting experimental outcomes. As CVS is a prominent component of science standards appropriate assessment instruments are required to measure these scientific reasoning skills and to evaluate the…