Questions regarding the generalizability of results from educational experiments have been at the forefront of methods development over the past five years. This work has focused on methods for estimating the effect of an intervention in a well-defined inference population (e.g., Tipton, 2013; O'Muircheartaigh and Hedges, 2014); methods for…

In this paper we present an Agent-based evaluation approach in a context of Multi-agent simulation learning systems. Our evaluation model is based on a two stage assessment approach: (1) a Distributed skill evaluation combining agents and fuzzy sets theory; and (2) a Negotiation based evaluation of students' performance during a training…

Randomized experiments are commonly used to evaluate if particular interventions improve student achievement. While these experiments can establish that a treatment actually "causes" changes, typically the participants are not randomly selected from a well-defined population and therefore the results do not readily generalize. Three…

Research aim was to reveal peculiarities of the education of social skills among senior high school age students in physical education classes. We hypothesized that after the end of the educational experiment the senior high school age students will have more developed social skills in physical education classes. Participants in the study were 51…

Retrieval practice is a powerful way to promote long-term retention and meaningful learning. However, students do not frequently practice retrieval on their own, and when they do, they have difficulty evaluating the correctness of their responses and making effective study choices. To address these problems, we have developed a guided retrieval…

Affective feedback during a self-assessment test could help induce the learner to an optimal emotional state regarding the learning material. However, there is a lack of experimental evidence concerning the influence of affective feedback during a self-assessment test. This paper is a step towards this direction. The effect of achievement-based…

When students leave their advising appointments, how do they feel? Excited? Disappointed? If advisors and students do not share expectations and goals, the student may harbor negative feelings about the advising experience, which have the potential to lead to withdrawal and dissatisfaction. We surveyed students at a large midwestern university to…

Mobile learning is considered an evolution of e-learning that embraces the ubiquitous nature of current computational systems in order to improve teaching and learning. Within this context it is possible to develop mobile applications oriented to learning, but it is also important to assess to what extent such applications actually work. In this…

In manual assembly work, parts are often assembled by applying force with a simple tool or by hand. A worker thus needs control the force he or she applies in working, as an appropriate level of force is requisite for minimizing work failures and improving efficiency. The object of this study is to clarify the relationship between the level of…

Volume 1 of this study describes and costs two possible satellite networks which could be used in education in Canada. In order to determine whether these networks were plausible or useful, a letter and a description of the two hypothetical networks were sent, before the cost study was completed, to all Canadian Universities and provincial…

Practical methods for implementing true experimental designs in evaluation settings in which such designs are rarely used are presented. Particular attention is paid to educational settings. (Author/JKS)

Volume 1 of this study describes and costs two possible satellite networks which could be used in education in Canada. In order to determine whether these networks were plausible or useful, a letter and a description of the two hypothetical networks (Volume 2) were sent, before the cost study was completed, to all Canadian universities and…

This paper reports the preliminary results of an experiment on the impact of computer assisted instruction (CAI) on disadvantaged students participating in the U.S. Department of Labor's Job Corps Program. In 1980-81, data were collected from participants in the Job Corps Comprehensive Computer Program at a large center in the Southwest. The…

School management activities can be improved by the more complete and systematic use of information on the concrete situation. Teacher judgments constitute an underutilized source of such information, e. g., concerning the distribution of student achievement levels. In this study, the application of formal techniques from management science…

Discusses the need for awareness of real and potential problems in educational evaluation approaches, kinds of problems there are with true experimental designs and with quasi-experimental designs, and the criteria applied by the Joint Dissemination Review Panel to its review of educational programs. (MF)