Social research methodologists have postulated that the transparency of survey procedures and data processing is mandatory for assessing the Total Survey Error. Recent analyses of data from cross-national surveys have demonstrated an increase in the quality of documentation reports over time and significant differences in documentation quality…

When conducting research on sensitive topics, it is challenging to use new methods of data collection given the apprehensions of Institutional Review Boards (IRBs). This is especially worrying because sensitive topics of research often require novel approaches. In this article a brief personal history of navigating the IRB process for conducting…

Instrumental variable estimators hold the promise of enabling researchers to estimate the effects of educational treatments that are not (or cannot be) randomly assigned but that may be affected by randomly assigned interventions. Examples of the use of instrumental variables in such cases are increasingly common in educational and social science…

This document discusses social survey research in which the need for identification of respondents may bring social research into conflict with the law and social custom. The paper deals with two features of the conflict--the products of such research, and the way in which privacy of the respondent can be assured regardless of the product. The…

Methodological incarceration occurs when research and investigation are restricted by the traditional concepts of how a study should be designed and are hampered by those notions which dictate what research is. This paper examines several reasons why social science research in general--reading research in particular--is considered by some to be…

Evaluators need new strategies that will support their commitment to science and at the same time preserve the objectivity of the evaluation. The article discusses three strategies, dealing with: philosophical foundations, the subjectivity of the "objects" of the studies, and the subjectivity of the observer. (Author/GDC)

Two methods for dividing an interrupted time-series study between baseline and experimental phases when study resources are limited are compared. In fixed designs, the baseline duration is predetermined. In flexible designs the baseline duration is contingent on remaining resources and the match of results to prior expectations of the evaluator.…

This monograph is one of a continuing series initiated to provide materials for teachers, parents, school administrators, and governmental decision-makers that might encourage reexamination of a range of evaluation issues and perspectives about schools and schooling. This monograph is a description and analysis of two contrasting paradigms: one…

Evaluation of the productivity of government-applied social research is considered from the aspects of the several major government and public constituencies. Public and government concepts of the public good in evaluation research are differentiated. Government-imposed constraints on evaluation research are outlined and their impacts considered.…

Relativism is an inevitable consequence of our interpretive mode of being in the world. This is so for both our daily lives and our professional lives. What does not overly concern us at the former level should likewise not concern us at the latter level. (Author/BJV)

Many evaluation researchers are now attempting to synthesize quantitative and qualitative approaches. Although such efforts appear to carry great promise, some subtleties and incompatibilities of these approaches are perhaps being overlooked. Implications for social inquiry are discussed. (Author/GDC)

Variations in perceptions of evaluation, research methods, time, social class, and priorities are only some of the reasons why evaluation work in a Third World setting calls evaluators' basic assumptions about people and society into question. Evaluation experiences in the Caribbean are used to illustrate practical problems that may arise.…

How social science theory and insight could be applied to understanding and resolving the issues surrounding misconduct in scientific research is discussed. Understanding why scientists break the norms of acceptable conduct may come when their survey responses are interpreted in the contexts of sociology and psychology. (SLD)

Triangulation strategy results in evidence characterized by the following: (1) convergence; (2) inconsistency; and (3) contradiction. In order to render the data sensible, the researcher or evaluator must report data collection procedures, as well as the three levels of information from which explanations of social phenomena are constructed. (BJV)

A model is described which illustrates two general uses of multiple analyses to evaluate quasi-experiments: obtaining estimates of the treatment effect, and checking the validity of the experiment. (MH)