Based on findings from a large meta-data-based literature survey, this article is intended to provide a comprehensive synthesis of key features of China's music education system as seen through the lens of n = 116 major research studies, drawn from a total of N = 3,257 high-impact Chinese journal articles published during 2007 to 2019. The…

This paper addresses the wicked problem of measuring the productivity of learning and teaching in higher education. We show how fundamental validity issues and difficulties identified in educational productivity research point to the need for a qualitatively different framework when considering the entire question. We describe the work that needs…

Addresses concerns about the trustworthiness of research results derived from image-based data, particularly questions of validity assessment. Compares examples of such research to provide an illustration of these issues. Presents a tentative strategy for ensuring trustworthiness based on five criteria: completeness, interpretive adequacy,…

Notes that problems of measurement in educational research are often addressed by using the terms validity and reliability. Discusses the meaning given to these terms and how they relate to the aims of the measurement process in educational research. (RKM)

Sees important aspect of graduate education as learning how to evaluate quality and validity of research. Notes that study of families presents particular challenges. Examines three methods to teach students to critique family research. Sees all three as holding promise in teaching students how to evaluate family research and notes that all three…

Describes a classroom demonstration that illustrates the error of using an inappropriate test to conclude that a specific ability does not exist within a subject or a population. Shows ways to expand the lesson to cover the issue of null conclusions. Points out social and methodological implications of the demonstration. (Author/LS)

Social facilitation can be defined as the effect of an audience or coactors on performance. Research on social facilitation effects has produced some contradictory and confusing findings. Some studies have found that the presence of others enhances performance; other studies have found that the presence of an audience or coactors impairs…

Discusses research into the external validity of simulation games used in education, i.e., the degree to which the games correspond to the real-life situations they are designed to simulate. An exploratory study examines the validity of a business game and potential problems of validity research are examined. (JJD)

Points out that variability in focus, method, and conceptual level of case studies causes difficulties in validating such studies. Notes method variations raise questions about validity. Claims the validity of case studies lies in their usefulness as projective models. States teachers can generate their own theories where practical educational…

Bias due to attrition of respondents poses a threat to the internal and external validity of research findings. Discusses methods of detecting attrition bias in longitudinal family research, and presents Heckman's procedure to correct attrition bias. Data from the University of California Longitudinal Study of Generations are used to illustrate…

A recent article by William R. Dunlap on admissions criteria is presented to illustrate applied statistical misuse. It is the basis for discussion of severe methodological problems including range truncation, dummy coding, identifying race and sex bias, measuring professional potential, and generalization of findings. The author's response is…

In discussions about qualitative research, questions often arise concerning appropriate research focus, researcher objectivity, manipulation of people or environments examined, study completeness, and value considerations. Goodness questions (reliability, replicability, and validity) get mixed with value questions (generalizability), with…

Recent research indicates that introductory psychology college students continue to be the primary source of subjects for psychological research. This extensive use of involuntary subjects in a required service subject pool raises numerous important questions for science and for educational and professional ethics. A general overview of research…

The hypothesis that conventional approaches to evaluating contaminants in performance appraisal overlook important individual ratee effects was examined. A rating form was developed that consisted of the following dimensions and behaviors: warmth; guided discourse or indirect teaching methods; control of subject matter; enthusiasm and reinforcing;…

The Randominzed Response Technique was used with 83 undergraduate students in an Introductory Statistics course to: (1) demonstrate a means by which information of a sensitive nature can be obtained in a confidential manner; and (2) illustrate to a group of somewhat skeptical students an application of statistics to an interesting, real-world…