Researchers in second language (L2) and education domain use different statistical methods to assess their constructs of interest. Many L2 constructs emerge from elements/parts, i.e., the elements "define" and "form" the construct and not the other way around. These constructs are referred to as emergent variables (also called…

Factor analysis is a versatile class of psychometric techniques used by researchers to provide insight into the psychological dimensions (factors) that may account for the relationships among variables in a given dataset. The primary goal of a factor analysis is to determine a more parsimonious set of variables (i.e., fewer than the number of…

American Educational Research Association (AERA) standards stipulate that researchers show evidence of the internal structure of instruments. Confirmatory factor analysis (CFA) is one structural equation modeling procedure designed to assess construct validity of assessments that has broad applicability for counselors interested in instrument…

Educational research emphasizes the advantages of multimethod designs. However, if the design comprises different perspectives, the question of construct validity emerges. We related this question to student and teacher ratings of student-student relations, which are of high interest in research on physical education. In our study, 2,160 students…

We estimated the invariance of educational achievement (EA) and learning attitudes (LA) measures across nations. A multi-group confirmatory factor analysis was used to estimate the invariance of educational achievement and learning attitudes across 55 nations (Programme for International Student Assessment [PISA] 2006 data, N = 354,203). The…

This paper introduces five commonly used approaches to analyzing multiple-choice test data. They are classical test theory, factor analysis, cluster analysis, item response theory, and model analysis. Brief descriptions of the goals and algorithms of these approaches are provided, together with examples illustrating their applications in physics…

Studies that examine the impacts of education interventions on key student, teacher, and school outcomes typically collect data on large samples and on many outcomes. In analyzing these data, researchers typically conduct multiple hypothesis tests to address key impact evaluation questions. Tests are conducted to assess intervention effects for…

The acceleration of educational research has resulted in an array of concepts, research instruments, and methods which demand clarification and integration, because new conditions and assumptions have been introduced without considering their effect upon the educational process. Special attention needs to be given to the development of evaluation…

The purpose of this study was to investigate the relationship between sample size and the quality of factor solutions obtained from exploratory factor analysis. This research expanded upon the range of conditions previously examined, employing a broad selection of criteria for the evaluation of the quality of sample factor solutions. Results…

Illustrated is the power of multidimensional scaling in reducing a complex set of proximity measures to a simple geometric picture that shows the relationship among data objects. Methods are discussed for determining the number of dimensions needed to represent a set. (Author/DEP)

There is a void in existing knowledge concerning specific tasks performed by researchers, developers, diffusers, and evaluators and the specific competencies required of them in performing educational research and research-related tasks. The work reported in this document is the analysis and interpretation of data obtained in interviews as…

The author begins with a general review of source credibility research, as an introduction to his study on the dimensions of credibility for teachers in the classroom and the dimensions of faculty-course evaluation questionnaires. His investigation utilized 46 semantic differential scales for the concepts "this teacher" and "this class," using as…

Construct validity has been an issue in assessment centers literature. This study developed a model for competency-based assessment centers by integrating competency modeling, training design, assessment centers, and multi-source feedback assessment. Several propositions in conjunction with the model were also developed to help resolve construct…

Periodic summaries of research techniques used in important journals help professors of educational research teach each new generation of researchers. Literature published in "American Educational Research Journal" (AERJ), "Educational Researcher" (ER), and "Review of Educational Research (RER) is reviewed for the 10-year…

In 1969, the American Educational Research Association (AERA) empaneled a Task Force on Research Training and charged it with (1) building a relevant knowledge base about training needs and problems and (2) developing procedures to attack these problems. During its two years of study, the Task Force carried out a series of three USOE-supported…