The Simulated Oral Proficiency Interview (SOPI) is a semi-direct performance-based speaking test that emulates the face-to-face Oral Proficiency Interview (OPI) as closely as practical, using a tape recording and printed test booklet. The prototypical SOPI contains simple personal background questions typical of an initial encounter (warm-up) and…

A confirmatory approach to assessing test structure using multidimensional item response theory (MIRT) was developed and evaluated. The approach involved adding to the exponent of the MIRT model an item structure matrix that allows the user to specify the ability dimensions measured by an item. Various combinations of item structures were fit to…

The ways in which experience and academic training influence the types of questions therapists ask of their clients were studied. Psychologists and psychology students of varying degrees of expertise (n=138) were provided an artificial intelligence program that simulated a date rape client's responses to typed questions and were asked to conduct a…

Binary or graded disagree-agree responses to attitude items are often collected for the purpose of attitude measurement. Although such data are sometimes analyzed with cumulative measurement models, recent investigations suggest that unfolding models are more appropriate (J. S. Roberts, 1995; W. H. Van Schuur and H. A. L. Kiers, 1994). Advances in…

A study analyzed student delays in flight certification at 106 University Aviation Association (UAA) member postsecondary institutions. After a pilot survey of 5 institutions, questionnaires were mailed to the 101 remaining UAA administrators; 80 responses were returned. Correlations of items in the survey were analyzed and significant…

This research explored the degree to which group sizes can differ before the robustness of analysis of variance (ANOVA) and analysis of covariance (ANCOVA) are jeopardized. Monte Carlo methodology was used, allowing for the experimental investigation of potential threats to robustness under conditions common to researchers in education. The…

This monograph presents a rationale for proactive social skills training for persons with mental retardation as well as over 100 examples of such instruction across the K-12 continuum. Chapter 1 provides a conceptual framework of social competence with principles of what, when, and how to teach social skills. Chapter 2 discusses the direct…

Fit analysis is widely performed in item response theory (IRT) based test development to assess the fit of individual items to the IRT model being used. The paper explores a step fit analysis procedure that is an extension of IRT-based item fit diagnostics applied to the response categories present in popular performance-based tasks. The step fit…

Test-retest reliabilities and practice effect magnitudes were considered for nine computer-simulated tasks of everyday cognition and five traditional neuropsychological tests. The nine simulated everyday memory tests were from the Memory Assessment Clinic battery as follows: (1) simple reaction time while driving; (2) divided attention (driving…

Current omnibus procedures for the analysis of interaction effects in repeated measures designs which contain a grouping variable are known to be nonrobust to violations of multisample sphericity, particularly when group sizes are unequal. An alternative approach is to formulate a comprehensive set of contrasts on the data which probe the specific…

The multitrait-multimethod (MTMM) paradigm is used widely to assess construct validity, but D. A. Kenny and D. A. Kashy (1992) lament that even after 30 years we still do not know how to analyze MTMM data. The Composite Direct Product (CDP) model has recently attracted considerable attention. Its strengths and weaknesses are evaluated, and a…

A study examined the varying degrees to which learners of Spanish at the intermediate and advanced levels use paragraph-like structure in their answers during a simulated oral proficiency exam. Subjects were 24 students preparing for the Spanish Texas Oral Proficiency Test. Data from simulated oral proficiency interviews were compared to a model…

This study investigated and compared the properties of five methods of item exposure control within the purview of estimating examinees' abilities in a computerized adaptive testing (CAT) context. Each of the exposure control algorithms was incorporated into the item selection procedure and the adaptive testing progressed based on the CAT design…

A simulation experiment demonstrated that the perceptual sensitivity of Swedish and Danish students at upper secondary school level varies systematically concerning the basic conditions for "personal growth." An attempt is made to constrain this concept contextually, in such a way that it can be described behaviorally. It is made evident…

A simple scheme is proposed for smoothly approximating the ability distribution for relatively long tests, assuming that the item characteristic curves (ICCs) are known or well estimated. The scheme works for a general class of ICCs and is guaranteed to completely recover the theta distribution as the test length increases. The proposed method of…