Educational assessment is inherently uncertain, where physiological, psychological and social factors play an important role in establishing judgements which are assumed to be "absolute". AI and other algorithmic approaches to grading of student work strip-out uncertainty, leading to a lack of inspectability in machine judgement and…

ChatGPT is emerging as a formidable asset for music educators, poised to enhance student engagement, refine assessment methods, and automate repetitive tasks related to music teaching. The core of this perspective revolves around the use of custom prompt templates that support individualized and reflexive teaching practices. The broader…

Novel and innovative modes of interacting with website information, which necessitate methods and tools for their evaluation have arisen. However, it is essential to develop such methods from contexts of use at a macro (i.e. cultural) and micro (individual use contexts) level. Activity theory has been used extensively in systems evaluation as it…

Presents a fuzzy evaluation method of SGML documents based on computing with words. Topics include filtering the amount of information available on the Web to assist users in their search processes; document type definitions; linguistic modeling; user-system interaction; and use with XML and other markup languages. (Author/LRW)

Discussion of users of information retrieval systems focuses on a machine-learning approach to inferring the user's context in the Okapi system. Results of an evaluation experiment are given, and it is concluded that context learning can help information retrieval systems adapt to users' particular queries. (Author/LRW)

Discusses how to design effective user interfaces for computer-based training (CBT) programs. Four types of interfaces are described: presentation, including consistency; conversation, including feedback and flexibility; navigation; and explanation, including online help. A job aid for evaluating CBT interfaces is included. (Contains 13…

Focuses on methods of generating and evaluating hypertext. Highlights include historical landmarks; nonlinearity; literary hypertext; models of hypertext; manual, automatic, and semi-automatic generation of hypertext; mathematical models for hypertext evaluation, including computing coverage and correlation; human factors in evaluation; and…

Presents two methods for evaluating automatically generated hypertext links: one is based on correlations between shortest paths in the hypertext structure and a semantic similarity measure, and the other is based on measuring users' performances using hypertext. Advantages and disadvantages of computer versus human evaluation are discussed.…

Discusses the need to revise concepts of teaching and learning in relation to technology. Topics include distance learning; accountability in learning and the outcomes of the educational process; the relationship between humans and technology; globalization; measuring an organization's knowledge; assessment; regulating agencies; and the role of…

Discussion of transactions in computer-based instruction for ill-structured and visual domains focuses on two transactions developed for meteorology training that provide the capability to interact with video and graphic images at a very detailed level. Potential applications for the transactions are suggested, and early evaluation reports are…

Identifies current trends in the automation of indexing, of information retrieval, and of interaction between the system and the users. Topics discussed include location, navigation, and indexing; digital libraries; matching documents to queries; weight of concepts; query structure, including fuzzy sets; algorithms; stemming; clustering; users'…

Describes a computer-aided instruction program developed at Sheffield City Polytechnic, England, which teaches students to analyze simple sentences into their constituents and to draw tree diagrams representing their structures. Program strategy, control and operation of the programs, and evaluation are discussed. Three references and illustrative…

Discusses general issues of computer and human understanding; contrasts three paradigms of information retrieval methodology, including statistical, deep semantic or natural language, and smart Boolean; describes CONIT, a knowledge-based intermediary retrieval assistance system; and examines system evaluation procedures, including a…

Describes computer program which converts text of user input and system responses from online search system into fixed format records describing interaction. Query language syntax, format of output record produced by parser, problems in constructing parser, its performance characteristics, and recommendations for improving process of logging…

Reviews the development of research and evaluation in information retrieval. Highlights include the Cranfield projects concerning recall and precision, the Medlars experiment that focused on relevance, TREC (Text Retrieval Conference), evaluation versus understanding, interface versus functionality, document length, and terms and user interaction.…