Reciprocal, paired, qualitative, formative peer assessment of academic writing by 12 educational psychology postgraduate students was compared to staff assessments. Although there was very little evidence of conflict between views of staff and peers, assessments focused on different details. Students found the process time consuming,…

Developed a new instrument, the Basic Technology Competencies for Educators Inventory (BTCEI), using the responses of 437 undergraduate and graduate teacher education students. Results support the theoretical structure of the BTCEI. Scores for the nine domains had high internal consistency reliability and adequate stability reliability. (SLD)

The validity and reliability of methods for assessing nonformal learning are influenced by the type of knowledge being measured, which in turn influences assessment criteria. Satisfactory methods must consider the specific character of nonformal learning. (SK)

This essay argues that reliability should be reconceptualized in a way that reflects the importance of the theoretical expectations of the test specialist and the learning and problem solving of the test takers. It is time to characterize clearly the substantive theoretical framework supporting reliability studies and the technical evaluation of…

Investigated the relation between 7- and 8-year-olds' interpretations of human behavior and children's beliefs about the stability of human traits. Found that the belief that traits are stable predicted a greater tendency to make trait judgments in the academic and sociomoral domains, and an increased focus on outcomes such as performance and…

Whether a middle alternative in the response choices to a questionnaire influences the reliability and validity of survey responses was studied with 1,390 physicians, nurses, and midwives. Including a neutral option had little effect on overall reliability and validity, but allowed better coherence when items were considered globally. (SLD)

Studied the reliability and accuracy of data from Statistics Sweden's Level of Living Surveys (register data) on the return on schooling using a sample of 2,914 adults. Findings show that this register data does not show some partial secondary and postsecondary studies that did not lead to degrees, and that there are difference in annual and…

Studied the sampling variability of estimated variance components using data collected over several years for a listening and writing performance assessment and evaluated the stability of estimated measurement precision. Results indicate that the estimated variance components varied from one year to another and suggest that the measurement…

Investigated the assumption that determining an adequate sample size in structural equation modeling can be aided by considering the number of parameters to be estimated. Findings from maximum likelihood confirmatory factor analysis support previous research on the effect of sample size, measured variable reliability, and the number of measured…

Developed two empirical measures designed to assess educators personal and professional beliefs about diversity, the Personal Beliefs about Diversity Scale and the Professional Beliefs about Diversity Scale. Results of reliability and validity studies of the scales, including pilot tests and field studies that involved 756 preservice and…

Notes professional journalists know they cannot be efficient news reporters without being able to do basic math. Describes five kinds of calculations journalists use, kinds of stories calculations appear in, and how to work with them. Discusses questions to ask about the reliability of data. Offers exercises dealing with mean and median, percent…

Provides an overview of the Portfolio Placement Project (PPP) at the University of Arizona; explores the concept of validity as it relates to the PPP; explores the concept of reliability within the PPP; and argues that the PPP has had enormous positive impact on the curriculum of the University of Arizona and the schools whose students submit…

Argues that teachers who manage their classrooms around learning style instruction are engaging in a practice of debatable value. Notes a lack of supportive research and the questionable reliability and validity of learning style inventories. Suggests that confusion over learning style instruction is magnified by the limitations inherent in the…

The ability of persons faking posttraumatic stress disorder or head injury to respond consistently across serial testings on the Minnesota Multiphasic Personality Inventory-2 was studied with 118 undergraduates. Results suggest that test takers can fake and describe symptoms consistently, and that type of disorder may affect temporal response…

Second-language (L2) learners differ from native speakers in how extensively (1) native-like success on one principle of universal grammar (UG) predicts success on other principles (lateral consistency) and (2) this level of success remains stable (longitudinal consistency). Research on Japanese as a second-language acquisition indicates that…