The "e-rater"® automated essay scoring system is used operationally in the scoring of the argument and issue tasks that form the Analytical Writing measure of the "GRE"® General Test. For each of these tasks, this study explored the value added of reporting 4 trait scores for each of these 2 tasks over the total e-rater score.…

This is a psychometric analysis of an instrument to assess the socio-emotional development of school students, How I Feel (HIF), developed as a situational judgment test, with scoring based on expert judgments. The HIF test was administered in grades 4-9, 1999-2005. Internal consistency, retest reliability, and year-to-year stability were…

We present a method for assessing science inquiry performance, specifically for the inquiry skill of designing and conducting experiments, using educational data mining on students' log data from online microworlds in the Inq-ITS system (Inquiry Intelligent Tutoring System; www.inq-its.org). In our approach, we use a 2-step process: First we use…

The Woodcock Johnson III Brief Assessment is a "maximum performance test" (Reynolds, Livingston, Willson, 2006) that is designed to assess the upper levels of knowledge and skills of the test taker using both power and speed to obtain a large amount of information in a short period of time. The Brief Assessment also provides an adequate…

With a construct-centered reliability analytical approach the reliability analysis should crystallize the multi-traits or constructs that the test specialists developed to measure from student performance and then estimate the degree of fit between the theoretical expectations of test developers and the performance exhibited by students. This…

Used a multitrait-multimethod approach to investigate the validity of scores on locally prepared performance assessments taken by 6,000 third and fourth graders in reading, language arts, and mathematics. A partial explanation for the lack of construct validity evidence for the performance assessment scores is the probable low reliability of…

A previous research report described a prototype measure of the skill of negotiation in interpersonal competency and the results of an initial validation study of that measure. This report describes the results of two further validation studies of the computer simulation negotiation skill measure. In study 1, 37 second- and third-year law students…

Attempts to improve a set of patient assault vignettes for a simulation by developing and testing a control version of the vignettes and exploring additional question and alternative scoring procedures. Influences of victim gender and assault severity are examined for 58 neuropsychiatric hospital nurses and 12 mental health experts. (SLD)