Despite increased efforts to assess the adoption rates of open science and robustness of reproducibility in sub-disciplines of education technology, there is a lack of understanding of why some research is not reproducible. Prior work has taken the first step toward assessing reproducibility of research, but has assumed certain constraints which…

Gathering labeled data in educational data mining (EDM) is a time and cost intensive task. However, the amount of available training data directly influences the quality of predictive models. Unlabeled data, on the other hand, is readily available in high volumes from intelligent tutoring systems and massive open online courses. In this paper, we…

An underlying theme of this paper is that it can be easier and more efficient to conduct valid and effective research studies in online environments than in traditional classrooms. Taking advantage of the "big data" available in an online university, we conducted a study in which a massive online database was used to predict student…

The sharply drawn distinction between research and evaluation, and the equally sharp distinction between the carefully controlled laboratory-type experiment and the study occurring in the field, are seen as arbitrary and not very helpful. In illustrating this thesis, the author develops a design generally regarded as a "research" design…

This paper reports on a continuing research project on metaphor in the language of teachers, and describes the ways in which an academic mainframe computer is being used in this research. Because the substance of the research and the computing procedures used are closely related, they are not readily separated. Following early sections dealing…

Student data banks for ongoing research and evaluation have been implemented by a number of professional schools. Institutions selecting software designs for the establishment of such systems are often faced with making their choice before all the possible uses of the system are determined. Making software design decisions involves "rational"…

This paper describes and evaluates a computerized system, MATCH, which is being used in South Carolina to match or link student records from year to year. The functioning of MATCH and its specific features are described, and its use in matching student test scores is detailed. The problem of mismatched records and the use of visual editing to…

Since problems associated with the statistical methodology of educational research are becoming increasingly important, this paper examines a subset of problems associated with the analysis and interpretation of aggregated data. Two major questions arise: (1) if a researcher knows the level (e.g., individual, teacher/classroom, school, school…

Eighteen papers on instructional technology, computerized testing, and computer assisted test construction (CATC) presented at the 1976 Association for Educational Data Systems (AEDS) convention are included here. Two papers discuss computer assisted instruction in calculus and teacher education courses. The use of computers in theoretical…