Several standardized and validated information literacy (IL) tests have been developed for use in U.S. post-secondary contexts, but fewer choices exist for schools outside of the U.S. In an earlier study (Cowan, Graham, & Eva, 2016) the authors explored IL testing at a Canadian university using the international version of the SAILS Cohort…

Language proficiency tests have become common instruments to judge people based on their performance. Thus, the scores on language proficiency tests, such as the International English Language Testing System (IELTS) or Teaching English as a Foreign Language (TOEFL), play a crucial role in the test-takers' lives. Because of increasing demands on…

Background: This paper extends a recent study by Kaplan and Su ("J Educ Behav Stat" 41: 51-80, 2016) examining the problem of matrix sampling of context questionnaire scales with respect to the generation of plausible values of cognitive outcomes in large-scale assessments. Methods: Following Weirich et al. ("Nested multiple…

In the past 2 decades, there has been an increasing tendency to use scores from the "TOEFL iBT"® Speaking test for decisions regarding the certification of international graduate students as teaching assistants at North American universities. To obtain validity evidence in support of the usefulness of the speaking scores for this…

The purpose of this study is to determine the best IRT model [Rasch, 2PL, 3PL, 4PL and mixed IRT (2 and 3PL)] for the science and technology subtest of the Transition from Basic Education to Secondary Education (TEOG) exam, which is carried out at national level, it is also aimed to predict the item parameters under the best model. This study is a…

Assessment has an important role in education and it has a critical role in the teaching process. Through appropriate assessment, teachers can classify and grade their students, give feedback and structure their teaching accordingly. Recently, educators and scientists have been becoming more interested in the requirements of assessment procedures…

Individual person fit analyses provide important information regarding the validity of test score inferences for an "individual" test taker. In this study, we use data from an undergraduate statistics test (N = 1135) to illustrate a two-step method that researchers and practitioners can use to examine individual person fit. First, person…

The study is on performance measurement in academia. It aims at developing and validating the measurement scale for the performance of higher institutions. The items were developed based on the extant literature. Data were collected via an online survey in which a questionnaire link was sent to 269 vice chancellors/presidents of the sampled…

Objective: This study reports on the operationalization and testing of the newly developed Relationship Quality (RQ) scale, designed to assess an individual's perception of his or her RQ in their current partnership. Methods: Data were generated through extended sampling from an original U.K.-based research project, "Enduring Love? Couple…

Grading is often a faculty member's least favorite chore, especially in engineering where open-ended problems prevail. For this reason, multiple-choice test items could be a popular alternative for assessing learning and understanding. In addition, most Learning Management Systems allow the instructor to create multiple-choice questions to be…

Attribute structure is an explicit way of presenting the relationship between attributes in diagnostic measurement. The specification of attribute structures directly affects the classification accuracy resulted from psychometric modeling. This study provides a conceptual framework for understanding misspecifications of attribute structures. Under…

Assessment specialists expend a great deal of energy to promote valid inferences from test scores gathered in low-stakes testing contexts. Given the indirect effect of perceived test importance on test performance via examinee effort, assessment practitioners have manipulated test instructions with the goal of increasing perceived test importance.…

The purpose of this research is to develop an instrument to evaluate local curriculum developed by the local government. Local curriculum is to preserve the uniqueness or culture of the Region. With a well-run educational system, students as young people can develop local or regional uniqueness. Type of this research is a research and development…

The effect of the response scale direction on response behavior is a well-known phenomenon in survey research. While there are several approaches to explaining how such response order effects occur, the literature reports mixed evidence. Furthermore, different question formats seem to vary in their susceptibility to these effects. We therefore…

Debilitating test anxiety is a general threat to validity if it biases assessment scores. Moreover, if bias differs between demographic groups, anxiety also raises concerns about test fairness. This study applied structural equation modeling to investigate possible measurement bias due to anxiety on the ACT® assessment and relationships among…