The work reported in this paper reflects a collaborative effort of many individuals representing multiple organizations. It began during a session at the October 2008 meeting of TILSA when a representative of a member state asked the group if any of their programs had experienced unexpected fluctuations in the annual state assessment scores, and…

Although stress is frequently claimed to impede foreign language (FL) reading comprehension, it is usually not explained how. We investigated the effects of stress, working memory (WM) capacity, and inferential complexity on Spanish FL readers' inferential processing during comprehension. Inferences, although necessary for reading comprehension,…

The study examined the knowledge of the functional relations between potential difference, magnitude of current, and resistance among seventh graders, ninth graders, 11th graders (in technical schools), and college students. It also tested the efficiency of a learning device named "functional learning" derived from cognitive psychology on the…

Under the premise that vocabulary learning in a Spanish as a second language in-class environment may be affected by the instructional approach adopted by the instructors or the materials followed, this study explores the influence of rather distant teaching styles, such as implicit and explicit approaches, on the learning outcome of Spanish…

The evaluation of educational interventions requires assessments that consistently (reliably) produce data from which accurate (valid) inferences about the test subjects can be made for some stated purpose. Despite codified definitions of all these terms, there remains vibrant debate about the assessment design process and how measures of…

The purpose of the present study was to examine the effect that teacher choice of intervention has on their level of procedural implementation and quality of implementation. The following research questions helped to guide the study: (1) Do teachers randomly assigned to the intervention "choice" group have higher ratings of procedural fidelity…

Despite high-stakes applications of assessment findings, assessment data are frequently collected in situations that are of low-stakes to examinees. Because low-stakes tests are of little consequence to the examinees, test-taking motivation and thus the validity of inferences drawn from unmotivated examinees' scores are of concern. The current…

Data-driven planning or evidence-based decision making represents nothing new in its concept. For years, business leaders have claimed they have implemented planning informed by data that have been strategically and systematically gathered. Within higher education and student affairs, there may be less evidence of the actual practice of…

Three experiments explored how pictures in award-winning children's storybooks contribute to their cohesion. In Experiment 1, one group of college students read storybooks with pictures, and another group read them with the pictures removed. Both groups answered questions inserted periodically. The source for about one half of the questions was…

Lecoutre, Lecoutre, and Poitevineau (2010) have provided sophisticated grounding for "p[subscript rep]." Computing it precisely appears, fortunately, no more difficult than doing so approximately. Their analysis will help move predictive inference into the mainstream. Iverson, Wagenmakers, and Lee (2010) have also validated…

Two-year colleges play an important role in facilitating transfers to four-year institutions. This has resulted in the demand to assess how well the community college systems train students for successful transfer to four-year bachelor-granting institutions. Existing datasets on two-year college transfer rates provides inconsistent and, sometimes,…

In their seminal paper, Edwards and Parry (1993) presented the polynomial regression as a better alternative to applying difference score in the study of congruence. Although this method is increasingly applied in congruence research, its complexity relative to other methods for assessing congruence (e.g., difference score methods) was one of the…

For decades teacher educators have used video to support developing preservice teachers, but new technologies open the possibility of a much more dynamic and real-time use for video of teaching. This article describes an initial attempt to leverage these technologies to develop a teacher learning community focused on evidence-based arguments about…

A belief bias effect in syllogistic reasoning (Evans, Barston, & Pollard, 1983) is observed when subjects accept more valid than invalid arguments and more believable than unbelievable conclusions and show greater overall accuracy in judging arguments with unbelievable conclusions. The effect is measured with a contrast of contrasts, comparing…

This study examines the specificity of information provided by structural assessment of knowledge (SAK). SAK is a technique which uses the Pathfinder scaling algorithm to transform ratings of concept relatedness into network representations (PFnets) of individuals' knowledge. Inferences about individuals' overall domain knowledge based on the…