Partially specified correlation matrices (not to be confused with matrices with missing data or EM-correlation matrices) can appear in research settings such as integrative data analyses, quantitative systematic reviews or whenever the study design only allows for the collection of certain variables. Although approaches to fill in these missing…

Publication pressure has been touted to promote questionable research practices (QRP) and scientific or research misconduct (RM). However, logically attractively as it is, there is no unequivocal evidence for this notion, and empirical studies have produced conflicting results. Other than difficulties in obtaining unbiased empirical data, a direct…

In medical sciences, a disease condition is typically associated with multiple risk and protective factors. Although many studies report results of multiple factors, nearly all meta-analyses separately synthesize the association between each factor and the disease condition of interest. The collected studies usually report different subsets of…

This chapter summarizes ten selected issues and common problems that arise in most assessment research projects. These include: (1) the uses of grades in assessment; (2) institutional review boards; (3) research design as a compromise; (4) standardized testing; (5) self-reported measures; (6) missing data; (7) weighting data; (8) conditional…

A revised version of Kaiser's Measure of Sampling Adequacy for factor-analytic data matrices is presented. (Author)

The choice of a common metric for the meta-analysis (quantitative synthesis) of correlational and experimental research studies is presented and justified. First, a background for the problem of identifying a common metric is presented. Second, the percentage of accounted variance (PAV) is described as the metric of choice, and reasons are given…

A process for judging the alignment between curriculum standards and assessments developed by the author is presented. This process produces information on the relationship of standards and assessments on four alignment criteria: Categorical Concurrence, Depth of Knowledge Consistency, Range of Knowledge Correspondence, and Balance of…

Randomized response (RR) is a well-known method for measuring sensitive behavior. Yet this method is not often applied because: (i) of its lower efficiency and the resulting need for larger sample sizes which make applications of RR costly; (ii) despite its privacy-protection mechanism the RR design may not be followed by every respondent; and…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

Considers both qualitative and quantitative research approaches on second language learning, with focus on second language classroom research. Concludes that both approaches are relevant to determining the important variables to investigate and the relationships those variables have to second language learning outcomes. (Author/CB)

Social constructivist theories of race suggest no two measures of race will capture the same information, but the degree of "error" this creates for quantitative research on inequality is unclear. Using unique data from the General Social Survey, I find observed and self-reported measures of race yield substantively different results when used to…