Artificial intelligence (AI) aims to build intelligent systems that can interact with and assist humans. During the interaction, a system learns the requirements from the human user and adapts to the needs to complete tasks. A popular type of interactive system is retrieval-based, where the system uses a retrieval function to retrieve relevant…

Purpose: The purpose of this paper is to evaluate the presence of systems thinking after an educational proposal on climate sustainability based on reflection and video creation. To evaluate this competency, an evaluation rubric was constructed. Design/methodology/approach: This research is a case study with a mixed approach. It was carried out…

This article presents discussion and recommendations on approaches to retrospectively evaluating development interventions in the long term through a systems lens. It is based on experiences from the implementation of an 18-month study to investigate the impact of development interventions on economic and social change over a 40-year period in the…

Math in Common® (MiC) is a five-year initiative that supports a formal network of 10 California school districts as they implement the Common Core State Standards in mathematics (CCSS-M) across grades K-8. As the MiC initiative moves into its second year, one of the central activities that each of the districts is undergoing to support CCSS…

Systematic evaluation is an essential tool for understanding program effectiveness. This article describes the pilot test of a statewide evaluation tool for the Supplemental Nutrition Assistance Program-Education (SNAP-Ed). A computer algorithm helped Community Nutrition Educators (CNEs) build surveys specific to their varied educational settings…

Until recently, states focused on ensuring the presence of a "highly qualified teacher" in every classroom. Under the 2001 reauthorization of the Elementary and Secondary Education Act (ESEA), known as No Child Left Behind (NCLB), this title described a teacher holding at least a bachelor's degree and the appropriate state license and…

A comprehensive assessment system is one in which three types of assessments: summative, benchmark, and formative assessments are routinely administered to all students in K-12 classrooms. The first part of this report summarizes the research on comprehensive assessment systems and provides clarity in terms of how each individual assessment type…

This fall, the nine states that finished as runners up in last year's groundbreaking Race to the Top competition will have an opportunity to reapply for a grant. The winners will receive a combined $200 million to help implement the bold education reform plans they developed last year. Many of the eligible states already have clear roadmaps toward…

Discusses design and evaluation concepts and methodologies in the context of comprehensive system design (CSD) and considers the concept of error throughout. Topics addressed include six core concepts of CSD; design processes; evaluation concepts; evaluation processes, including criterion-related validity, construct validity, and systemic…

This study was designed to illuminate the state of education in Taiwan by constructing Educational Indicator Systems. The study, sponsored by the National Science Council between 1998 and 2000, was the first comprehensive indicator project to cover all educational levels in Taiwan. Various research methods were used, including panel discussion,…

This paper describes the use of the CoFIND (Collaborative Filter in N Dimensions) system to evaluate two assessment styles. CoFIND is a resource database which organizes itself around its users' needs. Learners enter resources, categorize, then rate them using "qualities," aspects of resources which learners find worthwhile, the n dimensions of…

The idea of "capacity" is particularly important in the reform of educational systems because the system can be both the initiator and the subject of change. In fact, the requirement for capacity is present at all levels of the system in systemic reform. In educational change, four types of capacity are generally considered: (1) human…

A study of current trends in performance evaluations indicates that most large organizations are placing increasing emphasis on the importance of performance appraisal and are making continuing efforts to improve their systems. Trends include narrative evaluations, typing pay more closely to performance, and frequent changes in the appraisal…

Different dimensions of evaluation utilization and evaluator strategies for stimulating use are discussed, in terms of designing a formal evaluation utilization system. While the need exists to improve the design process, there is no simple formula. Evaluators should see part of their function as creating a repository of knowledge. (SLD)

Explains how to create an organizational system that will result in good performance. Topics discussed include process versus system; two views of a system, i.e., mechanistic and organic; and components of a system, including performance guides, measurement of results, feedback, and training. (LRW)