Assessment in higher education with a transformational instead of a reproductive purpose can be a powerful way of supporting student learning. Since university teachers usually design their own assessments, it is important to investigate their conceptions of assessment. The current study focuses on teachers' conceptions of their current and ideal…

Multiple-choice testing is a staple within the U.S. higher education system. From classroom assessments to standardized entrance exams such as the GRE, GMAT, or LSAT, test developers utilize a variety of validated and heuristic driven item-writing guidelines. One such guideline that has been given recent attention is to randomize the position of…

Using randomly ordered name generators, we tested the effect of name generators' relative position on the likelihood of respondents' declining to respond or satisficing in their response. An online survey of public health staff elicited names of information sources, information seekers, perceived experts, and friends. Results show that when name…

This study focused on grade 12 students' understanding of reaction kinetics. A 4-tier diagnostic instrument was developed for this purpose and administered to 137 students in the main study. Findings showed that reaction kinetics is a difficult topic for these students, with a total of 25 alternative conceptions (ACs) being uncovered. Except for…

This study applied the mode of on-the-fly assembled multistage adaptive testing to cognitive diagnosis (CD-OMST). Several and several module assembly methods for CD-OMST were proposed and compared in terms of measurement precision, test security, and constrain management. The module assembly methods in the study included the maximum priority index…

This study tested the applicability of the theoretical Examination for Candidates of Driving License (ECODL) in Turkey as a computerized adaptive test (CAT). Firstly, various simulation conditions were tested for the live CAT through an item response theory-based calibrated item bank. The application of the simulated CAT was based on data from…

This research focuses on the performance (as measured by exam grades) of students in a section of Accounting Principles taught face to face (traditional delivery) versus one section of the same class taught in an online format versus two sections of the same course taught in a hybrid format. The distinction of this research is that the students in…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the development of the 2020 Grades 3-8 English Language Arts Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2020…

Test assembly is the process of selecting items from an item pool to form one or more new test forms. Often new test forms are constructed to be parallel with an existing (or an ideal) test. Within the context of item response theory, the test information function (TIF) or the test characteristic curve (TCC) are commonly used as statistical…

Background: Comprehension is critical for classroom learning and educational success. Inferences are integral to good comprehension: successful comprehension requires the listener to generate local coherence inferences, which involve integrating information between clauses, and global coherence inferences, which involve integrating textual…

The purpose of this study was to investigate the impact of two different Direct Behavior Rating--Single Item Scale (DBR-SIS) formats on rating accuracy. A total of 119 undergraduate students participated in one of two study conditions, each utilizing a different DBR-SIS scale format: one that included percentage of time anchors on the DBR-SIS…

Vocabulary learning is an incremental process. Vocabulary knowledge, especially for second-language learners, may develop across a lifetime. Teachers with experience in providing feedback on their students' vocabulary use in writing or speech might have noticed that it is sometimes difficult to pinpoint one aspect of word knowledge. The reason is…

This study examined information integration cognitive mechanisms underlying the test anxiety judgments of 474 engineering students. The experimental design considered the orthogonal combination of three factors (teaching style, exam type, and test mode), resulting in 12 experimental scenarios. During the experiments, participants were provided one…

This study explored the cognitive mechanism behind information integration in the test anxiety judgments in 140 engineering students. An experiment was designed to test four factors combined (test goal orientation, test cognitive functioning level, test difficulty and test mode). The experimental task required participants to read 36 scenarios,…

Computer-based testing (CBT), which refers to delivering assessments with computers, has been widely used in large English proficiency tests worldwide. Despite an increasing CBT in China, limited research is available concerning whether CBT can be used for the Test for English Majors-Band 4 (TEM 4). The current study investigated whether testing…