In undergraduate research settings, students are likely to encounter anomalous data, that is, data that do not meet their expectations. Most of the research that directly or indirectly captures the role of anomalous data in research settings uses post-hoc reflective interviews or surveys. These data collection approaches focus on recall of past…

States' commitments to tackling long standing inequities have been stifled by missing data, long delays, insufficient data-analysis tools, and the excessive reporting burden placed on states and institutions. If states hope to achieve their completion and equity goals, they need access to data that does not leave them guessing--so they can…

The development in information science has enabled an explosive growth of data, which attracts more and more researchers to engage in the field of big data analytics. Noticeably, in many real-world applications, large amounts of data are imbalanced data since the events of interests occur infrequently. Classification of imbalanced data is an…

The preregistration of research plans and hypotheses may prevent publication bias and questionable research practices. We incorporated a modified version of the preregistration process into an undergraduate capstone research course. Students completed a standard preregistration form during the planning stages of their research projects as well as…

The authors encourage those in the field of school psychology to consider the use of learning disabilities assessment practices in relation to specific American Psychological Association and National Association of School Psychologists ethical codes and in regard to the American Educational Research Association, American Psychological Association,…

Scientific discoveries take place within scientific communities that are established in legitimating organizations such as universities and research institutes. Often times, scientists undergo tensions and paradoxes as they evaluate the risks they are willing to accept in their work. The types of risk/benefit decisions scientists make to determine…

The selection of appropriate data sources for institutional research is discussed. It is suggested that the provision of timely, accurate information for administrative decision-making depends on the researcher's ability to determine which data are relevant to the problem. This is of particular concern for institutional researchers because they…

The preparation and use of data needed to make objective, useful comparisons in higher education are considered. The needs for comparative data in higher education, including demands for accountability and strategic planning, are reviewed. In addition, data-related problems are considered: problems of narrowness, misrepresentation, sameness,…

Too few researchers understand what statistical significance testing does and does not do, and consequently their results are misinterpreted. This Digest explains the concept of statistical significance testing and discusses the meaning of probabilities, the concept of statistical significance, arguments against significance testing,…

Deliberations about social policy often center on estimates of harm or benefit generated by different interest groups. Problems in what is measured and how it is measured are illustrated by a discussion of research into sexual abuse and rape. Advocacy research is an unreliable foundation for social policy formation. (SLD)

Directors of educational projects need to be aware of the consequences their decisions may have for evaluation and appreciate the need for working closely with their evaluators from the earliest planning stage. Attempting to address the needs of project directors and evaluators, this guidebook deals with one central aspect of project…

Measuring cognitive achievement gains in project evaluation is dealt with. This guide provides those concerned with project evaluation with the basic tools for conducting technically sound, interpretable evaluation studies. Exotic designs are avoided and five basic models which appear feasible to implement in real-world settings are focused on.…

Used data from 51 pairs of parents to show the results of miscalculations and inadequate procedures on the assessment of the relative validity of the final-say measure of marital power. Demonstrated that, even when analytical procedures are carefully selected, external criterion variables must be used. (JAC)

Preparation of this paper facilitated by Grant GS-1741 from the Division of Social Sciences of the National Science Foundation.

This document deals with a common problem: the fact that "needs assessment" is often required by law and regulation, but there is little agreement on what the term means or what the process entails. The uses and definitions of the term "needs assessment" are examined and categorized along with the various methodologies which are ascribed to it.…