Inter-rater reliability, commonly assessed by intra-class correlation coefficient ICC, is an important index for describing the extent to which there is consistency amongst two or more raters in assigned measures. In organizational research, the data structure is often hierarchical and designs deviate substantially from the ideal of a balanced…

This technical report describes the results of analyses performed on data collected from 2013 to 2017, using the IDEA Feedback System for Administrators (FSA). The FSA is used to gather impressions from core constituents about an administrator's performance of relevant administrative roles, as well as her/his leadership style, interpersonal…

These are the appendixes for the report, "What Grade 7 Foundational Knowledge and Skills Are Associated with Missouri Students' Algebra I Achievement in Grade 8?" To increase opportunities for students to take more advanced math courses in high school, many school districts enroll grade 8 students in Algebra I, a gateway course for…

How important is mastering information and communication technologies (ICT) in modern labour markets? We present the first evidence on this question, drawing on unique data that provide internationally comparable information on ICT skills in 19 countries from the OECD Programme for the International Assessment of Adult Competencies (PIAAC). Our…

When is the right moment to transition an English learner student from part-time participation in English language development classes into full-time participation in mainstream English-only classes? English learner students should be moved into full-time mainstream English-only classes when they are sufficiently fluent in English to be able to…

This paper provides the first population-based evidence on how much standardized test scores vary among public school districts within each state and how segregation explains that variation. Using roughly 300 million standardized test score records in math and ELA for grades 3 through 8 from every U.S. public school district during the 2008-09 to…

Proactive preliminary minimum sample size determination can be useful for the early planning stages of a latent variable modeling study to set a realistic scope, long before the model and population are finalized. This study examined existing methods and proposed a new method for proactive preliminary minimum sample size determination.

Across the Regional Educational Laboratory Southeast Region there is growing interest in strengthening the presence of online learning in all public schools to help equalize education opportunities for all students and prepare students for a digital future. For instance, the North Carolina General Assembly has required that the state transition to…

This study examines the accuracy of performance ratings from the Framework for Leadership (FFL), Pennsylvania's tool for evaluating the leadership practices of principals and assistant principals. The study analyzed three key properties of the FFL: internal consistency, score variation, and concurrent validity. To measure the internal consistency…

Children who start school with strong language skills initiate a trajectory of academic success, while children with weaker skills are likely to struggle. Research has demonstrated that media and parent-child interactions, both characteristics of the home literacy environment, influence children's language skills. Using a national sample of…

AP Potential™ is an educational guidance tool that uses PSAT/NMSQT® scores to identify students who have the potential to do well on one or more Advanced Placement® (AP®) Exams. Students identified as having AP potential, perhaps students who would not have been otherwise identified, should consider enrolling in the corresponding AP course if they…

We conducted a meta-analysis of 28 studies comprising 39 samples to ask the question, "What is the magnitude of the association between various baseline child cognitive characteristics and response to reading intervention?" Studies were located via literature searches, contact with researchers in the field, and review of references from…

Federal initiatives and other research have led states across the nation to sharpen their focus on teacher evaluation in recent years. In 2009 a seminal report, "The Widget Effect," from The New Teacher Project revealed that in districts using a binary rating system to evaluate teachers, less than 1 percent of teachers received an…

It is commonly believed that education is a good thing for individuals. Yet, its correlation with subjective well-being is most often only weakly positive, or even negative, despite the many associated better individual-level outcomes. We here square the circle using novel Japanese data on happiness aspirations. If reported happiness comes from a…

Data from the ALEKS-based placement program at the University of Illinois is presented visually in several ways. The placement exam (an ALEKS assessment) contains precise item-specific information and the data show many interesting properties of the student populations of the placement courses, which include Precalculus, Calculus, and Business…