This article describes the development and validation of a listening questionnaire designed to assess second language (L2) listeners' metacognitive awareness and perceived use of strategies while listening to oral texts. The process of instrument development and validation is described, along with a review of the relevant literature related to…

DETECT, the acronym for Dimensionality Evaluation To Enumerate Contributing Traits, is an innovative and relatively new nonparametric dimensionality assessment procedure used to identify mutually exclusive, dimensionally homogeneous clusters of items using a genetic algorithm ( Zhang & Stout, 1999). Because the clusters of items are mutually…

Although clinical judgment is often used in assessment and treatment planning, rarely has research examined its reliability, validity, or impact in practice settings. This study tailored the frequency of home visits in a prevention program for aggressive-disruptive children (n = 410; 56% minority) on the basis of 2 kinds of clinical judgment:…

One of the most important effect sizes used in meta-analysis is the standardized mean difference (SMD). In this article, the conditions under which SMD effect sizes based on different measures of the same construct are directly comparable are investigated. The results show that SMD effect sizes from different measures of the same construct are…

Background: Those engaged in research might argue that we are involved in a process of explaining the world to others and to ourselves. The way in which we go about that process differs. The kind of questions we are concerned about answering will determine the approach we use, the information we gather and how we analyse the data. Some research…

In recent years, peer assessment has been increasingly used as an alternative method of assessment in classrooms. The study described in this paper employed a 13-item Likert-scale instrument to evaluate participants' attitudes towards both general (seven items) and online peer assessment (six items). A sample of 280 pre-service teachers and 108…

This study was designed to investigate the equivalence reliability between the suggested FITNESSGRAM[R] muscular strength and endurance test, the 90[degrees] push-up (PSU), and alternate FITNESSGRAM[R] tests of upper-body strength and endurance (i.e., modified pull-up [MPU], flexed-arm hang [FAH], and pull-up [PU]). Children (N = 383) in Grades 3…

In many countries, an athlete's performance at sporting competitions is often used as part of the selection criteria for entry into college. These criteria could be biased depending upon the procedures utilized by the authorities in a particular country. The purpose of this study was to calibrate, by using the Rasch rating scale model, the…

The structural validity of the Ohio Ninth Grade Proficiency Test was investigated with the test scores of 713 eighth graders who had their first opportunity to take the test in March 1999 in a large urban school district in Ohio. The study examined a hypothetical structure of the test to determine its fit to the data. Confirmatory factor analysis…

A Number of good ideas can help improve the achievement of low-performing students and close the achievement gap, including determining the placement of veteran teachers, purchasing new curricula, and providing after-school tutoring. However, it is the teacher--and what the teacher does in the classroom--that makes the most difference for…

The study's purpose was to extend the research dealing with the influence of grades on student evaluation of teaching (SET). Fifty-four college faculty served as study participants. Discriminate analysis indicated that a student with a higher expected course grade would give a higher SET rating of teaching effectiveness. This finding is consistent…

The Kessler 10 Psychological Distress Scale (K10) is a brief 10-item questionnaire designed to measure the level of distress and severity associated with psychological symptoms in population surveys. It is being used widely, including in the World Health Organization World Mental Health Survey, and as a clinical outcome measure, although little…

The calculation of composite indicators and the derivation of respective rankings is a common method used to benchmark countries or regions. However, although the statistical robustness of these rankings is often criticised, they often still spark off heated political debate. Here, we assess the sensitivity of the province ranking published by the…

The present study utilized both the IRT-LR (item response theory likelihood ratio) and a series of CFA (confirmatory factor analysis) multi-sample analyses to systematically examine the relationships between DIF (differential item functioning) and DTF (differential test functioning) with a random sample of 15 000 Korean examinees. Specifically,…

Neuropsychological tests have limited sensitivity in identifying subtle residual cognitive impairments in patients with good medical recovery from head injury and post-concussive syndrome. Detecting and characterizing residual "real life" cognitive difficulties can be problematic for treatment purposes. This study investigated the usefulness of a…