Evaluators use their eyes to see what is there, whether it is intended or not. But they use their test instruments to measure what is intended, whether it is there or not. Evaluators have been broadening their repertoire of instruments for years: curriculum-embedded tests, observer checklists, audiotape recorders, videotape recorders, unobtrusive…

Although a number of instruments for assessing attitudes toward statistics have been developed, several questions with regard to the structure and item functioning remain unresolved. In this study, the structure of the Survey of Attitudes Toward Statistics (SATS-36), a widely used questionnaire to measure six aspects of students' attitudes toward…

Web-based standard setting holds promise for reducing the travel and logistical inconveniences of traditional, face-to-face standard setting meetings. However, because there are few published reports of setting standards via remote meeting technology, little is known about the practical potential of the approach, including technical feasibility of…

This paper investigated the current situation of oral English teaching, learning, and assessment at the tertiary level in China through needs analysis and explored the implications for the development of a diagnostic speaking test. Through random sampling, the researcher administered both a student questionnaire and a teacher questionnaire to over…

Independently learning from informative texts becomes increasingly important from the age of 11. Little information is available, however, on (a) how and to what extent late elementary education students already apply specific text-learning strategies, and (b) whether different learner profiles can already be distinguished. In this study, a…

The logic model that implicitly drives most professional development (PD) efforts asserts that PD leads to changes in teacher knowledge and beliefs, which leads to improved classroom practice, and ultimately, better student outcomes. However, efforts to study the impacts of PD programs are often hampered by the scarcity of high-quality…

Problem Statement: Based on developments in the 21st century technology has become a large part of the classroom experience. Teachers need to have an understanding of how technology can be coordinated with pedagogy and content knowledge in order to integrate technology effectively into classroom instruction. Self-efficacy beliefs toward technology…

In this paper, we report on 2 studies developing, testing, and using an observation tool for measuring primary literacy instruction, the Developing Language and Literacy Teaching (DLLT) rubrics. In Study 1 (an instrumentation study), we show that the DLLT has a high level of internal consistency, that there are high levels of inter-rater…

The purpose of this research is to develop a multidimensional computerized adaptive test for diagnosing the cognitive process of grade 7 students in learning algebra by applying multidimensional item response theory. The research is divided into 4 steps: 1) the development of item bank of algebra, 2) the development of the multidimensional…

The aim of this study was to develop a tool to measure levels of mathematical knowledge gained in high school, as perceived by incoming engineering students. The study included 657 engineering students in the 2011-2012 academic year. Factor analysis was used to obtain a scale consisting of 47 items (Cronbach Alpha coefficient, 0.975). The…

In the province of Quebec, Canada, a trend towards full inclusion has impelled teachers to adapt their instruction to meet the needs of both advanced and weaker learners in regular school settings. The main purpose of the present investigation was to develop and validate the Differentiated Instruction Scale (DIS), which assesses the use of…

When do item adaptations veer from their intent and, instead of increasing access, modify the construct being measured? This study analyzed early elementary student achievement data from a statewide field test containing both standard and adapted science items. Four student groups were included in this analysis: English language learners, students…

Introduction: The metacognitve ability to accurately estimate ones performance in a test, is assumed to be of central importance for initializing task-oriented effort. In addition activating adequate problem-solving strategies, and engaging in efficient error detection and correction. Although school children's' ability to estimate their own…

This article describes the development and the initial validation of an instrument that can be used to assess teachers' beliefs about science teaching and learning. The instrument, which is called the Beliefs About Reformed Science Teaching and Learning (BARSTL) questionnaire, draws on the current national science education reform efforts in order…

Educating a nation of culturally, ethnically/racially, and linguistically diverse (CLD) students is one of the many challenges facing teachers and teacher educators, resulting in teachers' questioning their ability to improve learning for these groups. Yet teacher efficacy is significantly related to student achievement, motivation, and students'…