The ways in which examination standards are conceptualised and operationalised differently across nations has not been given sufficient attention. The international literature on standard-setting has been dominated by the psychometrics tradition. Broader conceptualisations of examination standards have been discussed in the literature in England,…

In a wide range of fields, professional practice is being transformed by the increasing influence of digital analytics: the massive volumes of big data, and software algorithms that are collecting, comparing and calculating that data to make predictions and even decisions. Researchers in a number of social sciences have been calling attention to…

The article dwells upon the methodological and technological aspects of the project to develop a framework of qualifications of the Ural region, which concerned with some of the features of the procedure of doing research, as well as the development of diagnostic tools. The work presents the methods of the processing of data collected during the…

The authors observe in this commentary that construct maps can help standard-setting panels to make realistic and internally consistent recommendations for performance-level descriptions (PLDs) and cut-scores, but the benefits may not be realized if policymakers do not fully understand the rationale for the recommendations provided by the…

In this issue of "Measurement: Interdisciplinary Research and Perspectives," Adam E. Wyse provides a thorough review of research to date on the use of construct maps in standard setting. He juxtaposes concepts and methods in ways that make their connections to one another clearer and more obvious than they might otherwise have been. In…

In his article "Construct Maps for Standard Setting," Adam E. Wyse provides a detailed review on the current use of construct maps in standard setting, including how they may be operationalized within a variety of standard-setting methods. The premise of the argument is that construct maps can serve as a useful tool for conducting a…

In 2018, the Professional Educator Licensing and Standards Board (PELSB) opened rulemaking on the Standards of Effective Practice, which are the core set of knowledge and skills that all teacher candidates in Minnesota teacher preparation programs learn. Opening these regulations has created the opportunity for Minnesota to start rethinking how…

Personnel standards are the foundations for how states and nations approve a program, engage in systemic assessment, and provide effective professional development to its early childhood professionals. However, despite the extensive use of paraprofessionals in early intervention/early childhood special education programs, there is a lack of…

Innovation has become an increasingly important concept for Australian businesses in enabling them to continue to compete in an international market, but where does vocational education and training (VET) sit in this? To date, VET has been largely overlooked by the National Innovation and Science Agenda as a potential contributor in this field.…

English learners (ELs) are among the fastest-growing populations of students in our nation's public schools. This diverse subgroup of approximately 4.5 million students brings important cultural and linguistic assets to the public education system, but also faces a greater likelihood of lower graduation rates, academic achievement, and college…

The purpose of the present study was to extend past work with the Angoff method for setting standards by examining judgments at the judge level rather than the panel level. The focus was on investigating the relationship between observed Angoff standard setting judgments and empirical conditional probabilities. This relationship has been used as a…

In Sino-foreign cooperative education, high-quality introduced educational resources must benefit the growth and development of students, facilitate the school's capacity building and the improvement of overall educational standards, and promote national socioeconomic development. It is necessary to establish and perfect the various working…

Evidence to support the credibility of standard setting procedures is a critical part of the validity argument for decisions made based on tests that are used for classification. One area in which there has been limited empirical study is the impact of standard setting judge selection on the resulting cut score. One important issue related to…

The Angoff method requires experts to view every item on the test and make a probability judgment. This can be time consuming when there are large numbers of items on the test. In this study, a G-theory framework was used to determine if a subset of items can be used to make generalizable cut-score recommendations. Angoff ratings (i.e.,…

The construct map is a promising tool for organizing the data standard-setting panelists interpret. The challenge in applying construct maps to standard-setting procedures will be the judicious selection of data to include within this organizing framework. Therefore, this commentary focuses on decisions about what to include in the construct map.…