This article presents the findings of a systematic qualitative analysis of research in the ethics of digital trace data use in learning and education. From the resulting analysis of 77 peer-reviewed studies, we (1) map the characteristics of research by study type, academic community, institutional setting, and national context; (2) identify the…

Purpose: This study aims to analyse and evaluate the methodology followed by the Times Higher Education Impact Rankings (THE-IR), as well as the coverage obtained and the data offered by this ranking, to determine if its methodology reflects the degree of sustainability of universities, and whether their results are accurate enough to be used as a…

Institutional researchers are often tasked with assessing why college-wide initiatives succeed or fail. This can be a difficult task: researchers need to discriminate between multiple feasible explanations, work with limited data, and produce compelling narratives. Process tracing is a qualitative methodology that enables researchers to make valid…

The purpose of this document is to serve as a reference guide for States involved in the P-20 effort to map data elements to the Common Education Data Standards (CEDS). It describes how one State used Align to assist in development of its P-20 system and describes in detail how this project could be replicated. The CEDS provide a shared vocabulary…

The purpose of this study is to look closely at how aspects of instructional leadership, and organizational learning affect the quality of madrasah in improving the quality of graduate the state madrasah aliyah. The experiment was conducted using a quantitative approach with descriptive and inferential methods, in inferential methods used…

This pan Canadian participatory action research project involved faculty and managers in twelve Canadian colleges and institutes, nine employers, and 1300 students and workers in examining exemplary practice in essential skills as a way of catalyzing system change. Multiple sources of data were used in the three year project and key findings…

Designing, validating, and deploying learning analytics tools for instructors or students is a challenge that requires techniques and methods from different disciplines, such as software engineering, human-computer interaction, computer graphics, educational design, and psychology. Whilst each has established its own design methodologies, we now…

Interest in collecting and mining large sets of educational data on student background and performance to conduct research on learning and instruction has developed as an area generally referred to as learning analytics. Higher education leaders are recognizing the value of learning analytics for improving not only learning and teaching but also…

The use of rubrics for grading and feedback in higher education has increased in response to requirements for consistency and transparency across a diverse range of assessment tasks. There is a growing evidence base demonstrating the reliability of rubrics across different markers and instances. The number of studies describing the impact of…

Institutional report cards are increasingly being used by higher educational institutions to present academic outcomes to external audiences of prospective students and parents, as well as program and institutional evaluators. While some prospective students are served by national transparency measures most users mine information from the…

The present publication is one of the outcomes of the OBSERVAL-NET project (follow-up of the OBSERVAL project). The main aim of OBSERVAL-NET was to set up a stakeholder-centric network of organisations supporting the validation of non-formal and informal learning in Europe based on the formation of national working groups in the 8 participating…

The authors reviewed 42 empirical studies of teaching of critical thinking skills in postsecondary education published between 1994 and 2009. The instructional intervention, test measure, and research design of the studies were analyzed. Study results suggest that: (1) the same instructional interventions can lead to different results, depending…

Because it is often impractical or impossible to obtain school transcripts or records on subjects, many researchers rely on college students to accurately self-report their academic record as part of their data collection procedures. The purpose of this study is to investigate the validity and reliability of student self-reported academic…

This discussion constructs a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research and then introduces the…

The authors have over the years tried to revise meta-analysis because it's basic premise is to add apples and oranges together and analyze. In other words, various data on the same subject are chosen using different samples, research strategies, and number properties. The findings are then homogenized and a statistical analysis is used (Snell, J.…