This article reports on the development and psychometric evaluation of a new teacher observation instrument to systematically assess young primary school students' well-being and detect potential indicators of psychological trauma, the RaPTOSS: "Risk and Protective factors Trauma Observation School Situations." The RaPTOSS is developed…

While methodologies are often presented as standardised procedures which, under specified conditions, should lead to the same conclusions, this case study presents the complex and deeply personal process of research (Addey and Piattoeva 2022). We analyse our application of network ethnography -- an approach presented by Ball (2016) -- to the study…

This paper evaluates the multistage adaptive test (MST) design of a large-scale academic language assessment (ACCESS) for Grades 1-12, with an aim to simplify the current MST design, using both operational and simulated test data. Study 1 explored the operational population data (1,456,287 test-takers) of the listening and reading tests of MST…

As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams'…

In low-stakes testing contexts, there are minimal personal consequences associated with examinee performance. Examples include assessments administered for research, program evaluation, test development, and international comparisons (e.g., Programme for International Student Assessment [PISA]). Because test-taking motivation can suffer in…

The aim of this study was to develop a valid and reliable measurement instrument to find out adolescents' relative deprivation levels and to determine the statistical characteristics of the instrument. The Relative Deprivation Scale-Adolescent Form was prepared and applied to 586 adolescents within the scope of the study. Exploratory Factor…

Evaluation scholars have committed decades of work to the development of evaluator competencies. The 2018 American Evaluation Association (AEA) Evaluator Competencies may be useful for evaluators to identify their strengths and weaknesses to improve their practice; however, a few empirically validated self-assessment tools based on the…

Social networking sites (SNSs) are widely used to support online learning and knowledge exchange (KE) in projects that require the coordination of collaborative team-playing, especially in COVID-19 world pandemic. Paradoxically, while digital infrastructures enable instant communication, SNSs are not always conducive to KE behaviours, as learners…

Increasingly, teacher learning groups (TLGs) are being deployed as a way to realise high-quality educational designs. There is a need for monitoring and for insights into the development of TLGs. Therefore, in the present study, the 'Dimensions of Social Learning Questionnaire' (DSL-Q) is developed that can be used to map the social configuration…

Given the absence of expertise criteria of academics or lecturers, we sought to explore relevant studies to formulate an informed framework of academic expertise. Academics at higher education institutions are often considered experts. Usually, academic roles comprise teaching, research, and community service. Therefore, academics' expertise…

When constructing measurement scales, regular and reversed items are often used (e.g., "I am satisfied with my job"/"I am not satisfied with my job"). Some methodologists recommend excluding reversed items because they are more difficult to understand and therefore engender a second, artificial factor distinct from the…

In computer-based tests allowing revision and reviews, examinees' sequence of visits and answer changes to questions can be recorded. The variable-length revision log data introduce new complexities to the collected data but, at the same time, provide additional information on examinees' test-taking behavior, which can inform test development and…

Background: Evidence-based assessments for people with aphasia (PWA) in Greek are predominantly impairment based. Functional communication (FC) is usually underreported and neglected by clinicians. This study explores the adaptation and psychometric testing of the Greek (GR) version of The Scenario Test. The test assesses the everyday FC of PWA in…

One result of recent changes in testing is that previously established linking frameworks may not adequately address challenges in current linking situations. Test linking through equating, concordance, vertical scaling or battery scaling may not represent linkings for the scores of tests developed to measure constructs differently for different…

This article presents design principles and practical steps for web-based Q methodology surveys. Drawing on the experience of two online Q studies, we discuss theoretical concerns, sort and survey design, software programs, and issues in researcher-participant engagement. We argue that opening Q methodology to online modes of data collection is…