This chapter focuses on IR's role in coordinating a pilot of the Degree Qualifications Profile (DQP) for assessment in a new master's degree program and provides guidance on frameworks that can be used, important technical considerations, and ways IR can be involved to advance the use of rubrics as a primary program assessment tool.

Learning analytics has been defined as the measurement, collection, analysis, and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs. The potential use of data and learning analytics in educational contexts has caught the attention of educators and…

When subscores on a test are reported to the test taker, the appropriateness of reporting them depends on whether they provide useful information above what is provided by the total score. Subscores that fail to do so lack adequate psychometric quality and should not be reported. There are several methods for examining the quality of subscores,…

The OECD's Assessment of Higher Education Learning Outcomes (AHELO) project is an important contribution to discussions of how to define and measure the quality of global higher education. There is a genuine need for quality measures that can help to ensure students have equitable access to high-quality higher education wherever they study but do…

Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

This chapter offers both challenges and new directions in conducting quantitative assessments and research with queer-spectrum and trans-spectrum college student populations. Both the challenges and future directions are grounded in the literature and the experiences of the authors.

In this article the authors describe a three-step instructional coaching cycle that can helps coaches become more effective. The article provides the steps and related components to: (1) Identify; (2) Learn; and (3) Improve. While the instructional coaching cycle is only one effective coaching program, coaches also need professional learning that…

The music education profession is faced with two serious problems regarding the (mis)use of data in music teacher evaluation. The first has to do with the quality and kinds of data that music teachers have been forced to use; the second is concerned with how these data are being used in the music teacher evaluation process. The evidence I will use…

Purpose: The gold standard for diagnosing childhood apraxia of speech (CAS) is expert judgment of perceptual features. The aim of this study was to identify a set of objective measures that differentiate CAS from other speech disorders. Method: Seventy-two children (4-12 years of age) diagnosed with suspected CAS by community speech-language…

As implementation of multi-tiered systems of support becomes common practice across the nation, practitioners continue to need strategies for intensifying interventions and supports for the subset of students who fail to make adequate progress despite strong programs at Tiers 1 and 2. Experts recommend making several changes to the structure and…

The usability of computer interfaces has a major influence on learning. Optimising the usability of e-learning resources is therefore essential. However, this may be neglected because of time and monetary constraints. User testing is a common approach to usability evaluation and involves studying typical end-users interacting with the application…

In this commentary, we build on Xinying Yin and Gayle Buck's discussion by exploring the cultural practices which are integral to formative assessment, when it is viewed as a sociocultural practice. First we discuss the role of assessment and in particular oral and written formative assessments in both western and Samoan cultures, building on the…

The purpose of this study is to analyse the feasibility of an evidential reasoning (ER) method for portfolio assessments and comparison of the results found with those based on a traditional holistic judgement. An ER approach has been incorporated into portfolio assessment of an undergraduate engineering design course delivered as a project-based…

While regression discontinuity has usually been applied retrospectively to secondary data, it is even more attractive when applied prospectively. In a prospective design, data collection can be focused on cases near the discontinuity, thereby improving internal validity and substantially increasing precision. Furthermore, such prospective…

In recent years, context-aware mobile learning (CAML) has been widely applied to various fields and has become a popular issue in educational research. Despite the tremendous potential of CAML and its growing significance, continued evaluations and refinements under the advice of field experts and instructors are crucial to ensure its validity,…