Although self-report surveys are widely used for data collection, data quality can vary across populations because certain groups are more likely to engage in insufficient effort responding (IER). Our study examined how different levels of the educational system--student groups, schools, and cultural contexts--affect data quality due to IER, using…

Questionnaires are by far the most common tool for measuring noncognitive constructs in psychology and educational sciences. Response bias may pose an additional source of variation between respondents that threatens validity of conclusions drawn from questionnaire data. We present a mixture modeling approach that leverages response time data from…

This study investigates consistent and inconsistent respondents to mixed-worded questionnaire scales in large-scale assessments. Mixed-worded scales contain both positively and negatively worded items and are universally applied in different survey and content areas. Due to the changing wording, these scales require a more careful reading and…

Examining the testing processes, as well as the scores, is needed for a complete understanding of validity and fairness of computer-based assessments. Examinees' rapid-guessing and insufficient familiarity with computers have been found to be major issues that weaken the validity arguments of scores. This study has three goals: (a) improving…

Over time international large-scale assessments have grown in terms of number of studies, cycles, and participating countries, many of which are a heterogeneous mix of economies, languages, cultures, and geography. This heterogeneity has meaningful consequences for comparably measuring both achievement and non-achievement constructs, such as…

According to Bronfenbrenner's socio-ecological model, school is an essential microsystem of the developing child. Schools provide important developmental contexts for children and adolescents, as they constitute environments that might either foster or evoke students' emotional instability. In particular, less is known about the precise and…

Background: While rotated test booklets have been employed in large-scale assessments to increase the content coverage of the assessments, rotation has not yet been applied to the context questionnaires administered to respondents. Methods: This paper describes the development of a methodology that uses rotated context questionnaires in…

The Program for International Assessment tested students in mathematics from 41 countries and found that students in the United States ranked in the lowest percentile. This struggle with math among youth in the United States prompted this quasi-experimental quantitative study about using interactive technology to engage and motivate 9th grade…

The aim of this study was to investigate response-process based evidence for the validity of the Programme for International Student Assessment's (PISA) self-report questionnaire scales as measures of specific psychological constructs, with a focus on scales meant to measure inclination toward specific learning strategies. Cognitive interviews (N…

The main purpose of this paper is provide information relevant for the formulation of new policies for the integration of technology in education from the discussion of research results that analyse computer skills and digital media uses among students (between 12 to 18 years old) from schools in the city of Rio de Janeiro, Brazil. The schools…

Multivariate matching in Differential Item Functioning (DIF) analyses may contribute to understand the sources of DIF. In this context, detecting appropriate additional matching variables is a crucial issue. This present article argues that the variables which are correlated with communalities in item difficulties can be used as an additional…

Effective teaching and teachers are key to producing high-performing students worldwide. So how can countries prepare teachers to face the diverse challenges in today's schools? The Teaching and Learning International Survey (TALIS) helps answer this question. TALIS asks teachers and schools about their working conditions and the learning…

This study examined contextual effects in Norwegian 10th-grade students' reports on cognitive and metacognitive strategies when using the Cross-Curricular Competencies (CCC) instrument. The CCC was first administered as the final task in a long (three-hour) testing session in the Organisation for Economic Co-operation and Development Program for…

International studies like PISA use context student or school questionnaires to collect data on student family background, attitudes and learning context. Questionnaire constructs are typically measured using dichotomous or Likert-type items. Scaling of questionnaire items in order to obtain measures of family background, student attitudes or…