It is imperative to collect validity evidence prior to interpreting and using test scores. During the process of collecting validity evidence, test developers should consider whether test scores are contaminated by sources of extraneous information. This is referred to as construct irrelevant variance, or the "degree to which test scores are…

The purpose of this study was to understand faculty perspectives of institutional change. The context for the institutional change was a shift from a largely traditional student population with a focus on the liberal arts to a range of adult and non-traditional students seeking professional degrees. The three research questions which guided the…

One of the most serious forms of cheating occurs when examinees have item preknowledge and prior access to secure test material before taking an exam for the purpose of obtaining an inflated test score. Examinees that cheat and have prior knowledge of test content before testing may have an unfair advantage over examinees that do not cheat. Item…

The Rasch model is commonly used to calibrate multiple choice items. However, the sample sizes needed to estimate the Rasch model can be difficult to attain (e.g., consider a small testing company trying to pretest new items). With small sample sizes, auxiliary information besides the item responses may improve estimation of the item parameters.…

Multiple-select multiple-choice items, or multiple-choice items with more than one correct answer, are used to quickly assess content on standardized assessments. Because there are multiple keys to these item types, there are also multiple ways to score student responses to these items. The purpose of this study was to investigate how changing the…

Our visual system samples external information, adjusts its sensitivity and constructs a stable representation of the world that allows us to perceive and interact with objects in our environments. Visual information with different levels of complexity is processed through the hierarchically organized visual cortical areas. This dissertation…

Despite the increasing demand for diagnostic information, observed subscores have been often reported to lack adequate psychometric qualities such as reliability, distinctiveness, and validity. Therefore, several statistical techniques based on CTT and IRT frameworks have been proposed to improve the quality of subscores. More recently, DCM has…

Although there is consensus on the relevance of the feedback given to student teachers, few instances in the literature have addressed this topic. Even less is said about feedback to mathematics lesson plans and how to characterize it. Lesson plans are artifacts that help establish a link between theory and practice, relate to a broader sense of…

In contexts of first language (L1) acquisition, prediction and adaptation are often viewed as fundamental to the learning process (Rabagliati et al., 2016). One mechanism that has been proposed to specifically account for such adaptive behavior is error-based implicit learning (e.g., Chang et al., 2006). According to this account, speakers…

This dissertation describes a program of research encompassing three studies that focused on examining the effects of enhanced expectancies and perceptions of success on motor learning. OPTIMAL theory (Wulf & Lewthwaite, 2016) proposes that practice manipulations that enhance a learner's expectations for future successful outcomes lead to…

Genetics is universally recognized as a core aspect of biological and scientific literacy. Beyond genetics' own role as a major unifying topic within the biological sciences, understanding genetics is essential for understanding other integral ideas such as evolution and development. Genetics understanding also underlies public decision making…

Mandarin Chinese verbs are composed of one to four characters that function together as a conceptual unit. However, in modern spoken Chinese, most of these verbs are two-character compounds. This dissertation is focused on adult second language (L2) learners' acquisition of these two-character verb compounds. Specifically, the acquisition of a…

According to the RAND model framework, reading comprehension test performance is influenced by readers' reading skills or reader characteristics, test properties, and their interactions. However, little empirical research has systematically compared the impacts of reader characteristics, test properties, and reader-test interactions across…

Under the framework of item response theory (IRT) and generalizability (G-) theory, this study examined the effects of item difficulty on rating reliability and construct validity on both the constructed-response (CR) items and essay items on English examinations. The data collected for this study were students' scores and responses on the two…

The purpose of this study was to construct a holistic education school evaluation tool using Montessori Erdkinder principles, and begin the validation process of examining the proposed tool. This study addresses a vital need in the holistic education community for a school evaluation tool. The tool construction process included using Erdkinder…