The Program for the International Assessment of Adult Competencies (PIAAC) is a multicycle international survey of adult skills and competencies sponsored by the Organization for Economic Cooperation and Development (OECD). The survey examines a range of basic skills in the information age and assesses these adult skills consistently across…

Propensity score methods account for selection bias in observational studies. However, the consistency of the propensity score estimators strongly depends on a correct specification of the propensity score model. Logistic regression and, with increasing popularity, machine learning tools are used to estimate propensity scores. We introduce a…

The ability of universities and colleges to predict the success of admitted students continues to be a key concern of higher education officials. Apart from a desire to see students have successful academic careers, there is also the fiscal reality of greater tuition revenues providing needed support for university budgets. Using administrative…

The Program for the International Assessment of Adult Competencies (PIAAC) is a multicycle survey of adult skills and competencies sponsored by the Organization for Economic Cooperation and Development (OECD). The survey examines a range of basic skills in the information age and assesses these adult skills consistently across participating…

This publication describes the methods and procedures used for the 2008/18 Baccalaureate and Beyond Longitudinal Study (B&B:08/18). The B&B graduates, who completed the requirements for a bachelor's degree during the 2007-08 academic year, were first surveyed as part of the 2008 National Postsecondary Student Aid Study (NPSAS:08), and then…

This report describes the design, methods, and results of the 2016/20 Baccalaureate and Beyond Longitudinal Study (B&B:16/20) conducted by the U.S. Department of Education's National Center for Education Statistics (NCES). It is the second follow-up with a cohort of bachelor's degree recipients originally identified during the 2015-16 National…

Mastering traditional algorithms has formed mathematics teaching in primary education. Educational reforms have emphasized variation and creativity in teaching and using computational strategies. These changes have recently been criticized for lack of empirical support. This research examines the effect of teaching two differently structured…

The Mathematics, 3D Printing, and Computational Thinking Through Work-Based Learning (MPACT) program relies on teacher professional development, specialized curriculum and materials, and STEM industry mentors to provide grades 4-7 students with project-based experiences implemented across three learning modules. This technical report presents…

The Mathematics, 3D Printing, and Computational Thinking Through Work-Based Learning (MPACT) program combines teacher professional development, specialized curriculum and materials and STEM industry mentors to provide grade 4-7 students with project-based experiences implemented across three learning modules. This technical report presents…

Unavoidable sample size issues beset psychological research that involves scarce populations or costly laboratory procedures. When incorporating longitudinal designs these samples are further reduced by traditional modeling techniques, which perform listwise deletion for any instance of missing data. Moreover, these techniques are limited in their…

The impact of misspecifying covariance matrices at the second and third levels of the three-level model is evaluated. Results indicate that ignoring existing covariance has no effect on the treatment effect estimate. In addition, the between-case variance estimates are unbiased when covariance is either modeled or ignored. If the research interest…

The International Association for the Evaluation of Educational Achievement (IEA) has been researching the impact of information and communications technologies (ICT) on educational processes, and factors supporting or impeding the pedagogical use of ICT, since the late-1980s. More recently it has turned its attention to investigating ICT-related…

IEA's International Computer and Information Literacy Study (ICILS) 2018 investigated how well students are prepared for study, work, and life in a digital world. ICILS 2018 measured international differences in students' computer and information literacy (CIL): their ability to use computers to investigate, create, participate, and communicate at…

The purpose of this study is to evaluate the extent to which item response theory (IRT) proficiency estimation methods are robust to the presence of aberrant responses under the "GRE"® General Test multistage adaptive testing (MST) design. To that end, a wide range of atypical response behaviors affecting as much as 10% of the test items…

In response to a request for additional analyses, in particular reporting confidence intervals around the results, we re-analyzed the data from prior studies. This supplementary report presents the results of the additional analyses addressing classification accuracy, reliability, and criterion-related validity evidence. For ease of reference, we…