User modelling algorithms such as Performance Factors Analysis and Knowledge Tracing seek to determine a student's knowledge state by analyzing (among other features) right and wrong answers. Anyone who has ever graded an assignment by hand knows that some answers are "more wrong" than others; i.e. they display less of an understanding…

This paper intends to construct a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research. Then it is followed by…

The major emphasis of this paper is in the examination of test item response patterns. Tatsuoka and Tatsuoka (1980) have developed two indices of response consistency: the norm-conformity index (NCI) and the individual consistency index (ICI). The NCI provides a measure of the degree of consistency between the response pattern of an individual and…

There are two types of errors made in feeling-of-knowing (FOK) studies: a commission error occurs when a subject answers a question incorrectly, and an omission error occurs when a subject fails to provide an answer for a given question. A subject makes a commission error if he or she responds to the following question, "In which city does…

Training methods naturally employed by trainers were analyzed and compared to systematic structured training procedures. Trainers were observed teaching retarded subjects how to assemble a bicycle brake, roller skate, carburetor, and lawn mower engine. Trainers first taught using their own (personal) method, which was recorded in terms of types of…

An index identifying factors leading to unusual response patterns by students, the modified caution index, was computed for the reading comprehension and study skills items of Booklet 5 from the 1979 National Assessment of Educational Progress (NAEP) reading achievement survey given to the 9-, 13- and 17-year-old samples. The analyses focused on…

College students from colleges and universities throughout the United States were surveyed about the location of the world's 50 most populous countries. Over 3,300 responses were examined to determine the perceived geographic range of given countries, the regional degree of accuracy among students, and the overall significance of response errors.…

The technique individuals use to narrow the possible responses in "solicits" (demands, requests, or questions requiring a response) in and outside the classroom often helps to avoid miscommunication and can be a useful tool for classroom teachers. A narrowing exercise was completed by 35 classes of native English and English as a second language…