The two studies conducted by Weiss, Keith, Zhu, and Chen in 2013 on the Wechsler Adult Intelligence Scale (WAIS-IV) and the Wechsler Intelligence Scale for Children (WISC-IV), respectively, provide strong evidence for the validity of a four-factor solution corresponding to the current hierarchical model of both scales. These analyses support the…

Fidelity measurement is critical for testing the effectiveness and implementation in practice of psychosocial interventions. Adherence is a critical component of fidelity. The purposes of this review were to catalogue adherence measurement methods and assess existing evidence for the valid and reliable use of the scores that they generate and the…

This study assessed the validity of the Social Communication Questionnaire (SCQ) in a sample of 69 adults, aged 18-40 years old. Participants included 21 adults diagnosed with an autism spectrum disorder (ASD) and intellectual disability (ID), and 48 individuals diagnosed with ID and no diagnosis of an ASD. The SCQ yielded a sensitivity of 0.71…

The majority of documented phishing attacks have been carried by email, yet few studies have measured the impact of email headers on the predictive accuracy of machine learning techniques in detecting email phishing attacks. Research has shown that the inclusion of a limited subset of email headers as features in training machine learning…

Background/Context: Recent U.S. policy has brought a shift in assessment use, from measurement tools to policy levers. In particular, testing has become a core part of teacher evaluation policies in many states, with test results becoming akin to a job evaluation. Purpose: To explore the notion of consequential validity in assessment use and…

In validating uses of testing, it is helpful to distinguish those that rely directly on the information provided by scores or score distributions ("direct" uses and consequences) versus those that instead capitalize on the motivational effects of testing, or use testing and test reporting to shape public opinion ("indirect" uses and consequences).…

The number of public school students who are English learners (ELs) has been increasing steadily in the United States. According to a report by Snyder, de Brey, and Dillow (2016), in the 2014-2015 school year, nearly 4.6 million students enrolled in Kindergarten through grade 12 (K-12) in U.S. schools were English learners, representing…

A large number of studies document that children differ in the degree they are shaped by their developmental context with some being more sensitive to environmental influences than others. Multiple theories suggest that "Environmental Sensitivity" is a common trait predicting the response to negative as well as positive exposures.…

After considering the relationships between (a) reading fluency and reading rate and (b) reading rate and sight vocabulary, this study addressed a very practical question. Can a cut score on a sight vocabulary task (1-min) predict level of reading fluency 4+ months into the future? The prediction was tested at multiple times point across grades…

Teacher evaluation systems commonly rely on observation of teaching practice (OTP) by school principals. However, the value of OTP as evidence of teacher effectiveness depends on its psychometric quality. In this study, we address a key aspect of the psychometric quality of principals' OTP ratings. Specifically, we investigate the degree to which…

The overarching purpose of our study was to compare performances of treatment and control condition students who completed a literacy-infused, inquiry-based science intervention through sixth grade as measured by a big idea assessment tool which we refer to as the Big Ideas in Science Assessment (BISA). First, we determine the concurrent validity…

This study describes the adaptation and validation of the American Institute for Research (AIR) Self-Determination Scale for use in Norwegian research and education. The study contributes to the field by enabling reliable assessment of self-determination of Norwegian students with intellectual disability. The operational equivalence of the…

Ecological citizenship is a type of citizenship that encourages individuals, communities and organizations as citizens of the world to consider environmental rights and responsibilities. When the literature is examined, it is seen that there are four most emphasized dimensions of ecological citizenship. These are responsibility, sustainability,…

This report presents further validation evidence for the Student Subjective Wellbeing Questionnaire (SSWQ). Analyses conducted with a sample of urban middle-school students (Grades 5-8, N = 335) targeted two limitations from previous validation studies: the lack of convergent validity evidence linking responses to the SSWQ with actual school…

This article presents the validity bias review feedback and outcomes of new performance-based assessments to evaluate candidates seeking principal licensure. Until now, there has been little empirical work on performance assessment for principal licensure. One state recently developed a multi-task performance assessment for leaders and has…