This article explores the comparability of assessment tools under different format conditions. Prior studies have not considered the interaction of format and device on time to complete an assessment and have instead treated each of them separately with conflicting results. This study assesses, by linear regressions using web-based data, the…

Questionnaires routinely measure unipolar and bipolar constructs using rating scales. Such rating scales can offer odd numbers of points, meaning that they have explicit middle alternatives, or they can offer even numbers of points, omitting the middle alternative. By examining four types of questions in six national or regional telephone surveys,…

In social research, the use of agree/disagree (A/D) questions is a popular method for measuring attitudes. Research has shown that A/D questions require complex cognitive processing and are susceptible to response bias. Thus, some researchers recommend the use of item-specific (IS) questions. This study examines the processing of A/D and IS…

The effect of the response scale direction on response behavior is a well-known phenomenon in survey research. While there are several approaches to explaining how such response order effects occur, the literature reports mixed evidence. Furthermore, different question formats seem to vary in their susceptibility to these effects. We therefore…

Of all the approaches to collecting data in the social sciences, the administration of questionnaires to respondents is among the most prevalent. Despite their popularity, there is broad consensus among survey design experts that using these items introduces excessive error into respondents' ratings. The authors attempt to answer the following…

An English placement test (PT) is an essential component of any foundation program. It helps place students into their suitable language proficiency level so that they do not spend time learning materials below or above their levels. It also helps teachers to prepare teaching materials to students of similar levels (Brown, 2004; Illinois, 2012).…

The effects of computer and paper test media on EFL test-takers with different computer familiarity in writing scores and in the cognitive writing process have been comprehensively explored from the learners' aspect as well as on the basis of related theories and practice. The results indicate significant differences in test scores among the…

The purpose of this paper is to provide a detailed description of the Monitoring the Future research design, including sampling design, data collection procedures, measurement content, and questionnaire format. This study assesses the changing lifestyles, values, and preferences of American youth on a continuing basis. Each year since 1975, at…

This study analyzed effective test formats that utilized tablets for tests in university information basic subjects in blended learning environments. Specifically, three types of test were created: (1) multiple-choice, (2) fill-in-the-blank, and (3) a mixture of multiple-choice and fill-in-the-blank. An analysis focusing on university students'…

Metacognition refers to students' knowledge and regulation of cognition, as well as their accuracy in predicting their academic performance. This study addressed two major questions: 1) how do metacognitive knowledge, regulation and accuracy differ across domains?, and 2) how do students' individual differences relate to their reported…

It is critical for countries to ensure that capable secondary school students receive further preparation in advanced mathematics and science, so that they are ready to enter challenging university-level studies that prepare them for careers in science, technology, engineering, and mathematics (STEM) fields. This group of students will become the…

The validity studies planned for the Test Design activities deal primarily with the appropriateness of items generated for a domain. Previous exploratory work in the field related to overall test content appropriateness ratings has not been satisfactory. Studies which are solely based on correlational data suffer from confounding with…

A study was undertaken to develop a checklist of desirable characteristics of mail questionnaires. The checklist was to reflect some degree of consensus among experts in survey research and to be used as a general guide by novice questionnaire designers. A second objective was to take a first step toward development of an objective measure of…

This study of survey research experts was conducted to determine desirable characteristics of mail questionnaires. The 82-item Likert-scale instrument used in the study covered general appearance, instructions, choice of items, choice of response options, wording, order of items, and item format. The instrument was administered to: 8 subjects who…

The Survey of Testing Practices was administered to 470 undergraduate students at Pepperdine University and the Univesity of California Los Angeles. The items concerned testing practices in three or four classes taken the previous term: type of test, test administration, class size, procedures for returning tests, test difficulty, and observed…