The objective of this paper is to comment on the think-aloud methods presented in the three papers included in this special issue. The commentary offered stems from the author's own psychological investigations of unobservable information processes and the conditions under which the most defensible claims can be advanced. The structure of this…

This special issue of "Assessment in Education" contains the type of debate needed about what Cizek (2015) calls a "… lingering flaw in the concept of validity…." Some practitioners might not agree that the current theory of validation is flawed. Specifically, the debate Jon Twing is referencing concerns the role of the…

In this commentary, we offer a set of visual tools that can assist education researchers, especially those in the field of mathematics, in developing cohesiveness from a mixed methods perspective, commencing at a study's research questions and literature review, through its data collection and analysis, and finally to its results. This expounds…

In the May 2010 issue of "Psychological Bulletin," R. E. McGrath, M. Mitchell, B. H. Kim, and L. Hough published an article entitled "Evidence for Response Bias as a Source of Error Variance in Applied Assessment" (pp. 450-470). They argued that response bias indicators used in a variety of settings typically have insufficient data to support such…

Discusses issues relating to the reliability, validity, utility, and information value of unobtrusive testing of library reference services; provides suggestions for practical applications of these criteria; applies study findings to library decision making and planning; and identifies topics for further methodological refinement. (Author/CLB)

One major reason for the problems of test validation is an overemphasis on the need for empirical validity data, and a failure to recognize the primary importance of explicit verbal definitions of what the test is intended to measure and rational arguments in support of the means chosen for obtaining the measurement. (Author/LC)

In response to Ebel (TM 508 146) Gardner argues that neither intrinsic rational validity associated with ability tests nor a validity coefficient relating a test to performance as the sole information about validity is sufficient. All relevant data about a test and its functioning are essential in describing the validity of the test. (Author/LC)

Examines and contests the claim that all language tests are in reality testing the same underlying ability which is very similar to the Spearman g-factor for intelligence. Conclusions indicate that the argument for the existence of a g-factor in language tests is not tenable on statistical grounds. (SL)

This paper deals with six sets of concerns and suggestions that arise as attitudes toward urban teaching are assessed. The first set arises from the complexity of measuring attitudes. It is strongly recommended that critiques of attitude data be based on plausible rival hypotheses. The second set involves the identification of beliefs related to a…

Examines the impact of online systems designed to be searched by end users on the process of database and product evaluation. Two testing methods, beta tests and user surveys, are evaluated, and possible solutions to testing problems are suggested. (CLB)

Proposes that, while there may be real sex differences in vocational interests, Gottfredson's reanalysis of Self-Directed Search predictive data provides no support for the counseling use of sex-divergent raw interest scores. (RC)

Considers the bases of criticism of parent report as an index of their children's behavioral development and ways in which problems associated with parent report were addressed in the construction of the MacArthur Communicative Development Inventories (CDIs). Examines the nature of responses elicited from parents as they complete the CDIs. (BC)

Identifies some underlying assumptions about language, testing and its use, and second language acquisition (SLA) for those current on the issue of oral proficiency assessment. Suggests that even with its limitations, the assessment procedure can become a source of data for future SLA research. (Author/LMO)

Summative measures of learning collected at the conclusion of an associate or bachelor's degree program are insufficient to help educators and students maximize learning and personal development across the college years. Managing the desired outcomes of college requires an understanding of when learning and growth occur during the educational…

Describes a study done by Herbert White that resulted in rankings of library and information science programs based on perceptual assessments by faculty and library directors. Problems with this methodology are discussed, and further findings based on extensive interviews with subjects of the White study are reported. (CLB)