In this article, we examine whether cross-national studies disclose enough information for independent researchers to evaluate the validity and reliability of the findings (evaluation transparency) or to perform a direct replication (replicability transparency). The first contribution is theoretical. We develop a heuristic theoretical model…

Agent-based modeling has become increasingly popular in recent years, but there is still no codified set of recommendations or practices for how to use these models within a program of empirical research. This article provides ideas and practical guidelines drawn from sociology, biology, computer science, epidemiology, and statistics. We first…

In experimental research, internal validity refers to what extent researchers can conclude that changes in dependent variable (i.e. outcome) are caused by manipulations in independent variable. The causal inference permits researchers to meaningfully interpret research results. This article discusses (a) internal validity threats in social and…

Persson's (2012a) article offers a timely contribution to the science of giftedness through questioning the validity of research emerging from within this paradigm. Using evidence from a number of disciplines he demonstrates that what is regarded as gifted behaviour in one culture could be regarded as quite ordinary within another. He therefore…

Over the past few years, the focus group method has assumed a very important role as a method for collecting qualitative data in social and behavioural science research. This article elucidates theoretical and practical problems and prospects associated with the use of focus groups as a qualitative research method in social and behavioural science…

This article examines feminist research, neo-Marxist critical ethnography, and Freirian "empowering" research in order to reconceptualize validity within the context of openly ideological research. Issues of importance to openly ideological researchers are discussed. (MT)

Content analysis of 364 articles in the Journal of Agricultural Education 1990-1999 indicated that a majority of studies did not mention nonresponse error as a threat to external validity, did not attempt to control for nonresponse error, or did not cite literature on handling it. Protocols to address nonresponse error were proposed. (Contains 24…

Qualitative research evokes rather stereotyped responses from the mainstream of social science. The following 10 standardized responses to the stimulus "qualitative research interview" (QRI) are discussed: (1) it is not scientific, only common sense; (2) it is not objective, but subjective; (3) it is not trustworthy, but biased; (4) it is not…

Methods of assessing effect size and the flows that limit their usefulness are discussed. The various statistical procedures for estimating variance accounted for are based on different statistical models producing sharply differing results. The methods reflect too greatly the particular study characteristics and hence have limited…

Examines the conceptual framework of bipolar models of social knowledge use that are transactions between knowledge producers and decision makers. Topics discussed include methodological consequences of bipolar models; levels of validity in social research; social contexts of choosing models for social research; and views on the practice of…

The decisive power of an experiment, for both social evaluation research and laboratory experimentation as well, is only as strong as the clarity of the basic assumptions which underlie it. A dialectical methodology is proposed for assessing the influence of key assumptions in both settings. (Author/CTM)

This technical document, part of a series of chapters described in SO 011 759, describes a basic model of panel analysis used in a study of the causes of institutional and structural change in nations. Panel analysis is defined as a record of state occupancy of a sample of units at two or more points in time; for example, voters disclose voting…

This document is part of a series of chapters described in SO 011 759. The chapter advocates the analysis of event-histories (data giving the number, timing, and sequence of changes in a categorical dependent variable) with maximum likelihood estimators (MLE) applied to log-linear rate models. Results from a Monte Carlo investigation of the impact…

A model is described which illustrates two general uses of multiple analyses to evaluate quasi-experiments: obtaining estimates of the treatment effect, and checking the validity of the experiment. (MH)

By drawing analogies to the history of mental testing, the author concludes that the responsibility for critical evaluation and beneficial use of social indicators rests with social scientists. Future directions of critical inquiry are suggested. (Author/MH)