Inter-rater reliability (IRR), which is a prerequisite of high-quality ratings and assessments, may be affected by contextual variables, such as the rater's or ratee's gender, major, or experience. Identification of such heterogeneity sources in IRR is important for the implementation of policies with the potential to decrease measurement error…

This research represents an unforeseen outcome of the authors' National Science Foundation Innovation Technology Experiences for Students and Teachers (ITEST) program grant in science education. The grant itself focused on the use of serious educational games (SEGs) in the science classroom, both during and after school, to teach science content…

We develop a Bayesian hierarchical model for the analysis of ordinal data from multirater ranking studies. The model for a rater's score includes four latent factors: one is a latent item trait determining the true order of items and the other three are the rater's performance characteristics, including bias, discrimination, and measurement error…

KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term…

KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term…

KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term…

In November of 2007, Alberta Advanced Education and Technology contracted Insightrix Research, Inc. to conduct a survey of individuals who graduated from post-secondary institutions in Alberta in the fall of 2005 or the spring of 2006 (excluding apprenticeship graduates, who are surveyed through a separate initiative). The purpose of the survey is…

In November of 2007, Alberta Advanced Education and Technology contracted Insightrix Research, Inc. to conduct a survey of individuals who graduated from post-secondary institutions in Alberta in the fall of 2005 or the spring of 2006 (excluding apprenticeship graduates, who are surveyed through a separate initiative). The purpose of the survey is…