Questionnaire designers are encouraged to write questions as complete sentences. In self-administered surveys, incomplete question stems may reduce visual clutter but may also increase burden when respondents need to scan the response options to fully complete the question. We experimentally examine the effects of three categories of incomplete…

The rapid advancements in generative artificial intelligence have opened new avenues for enhancing various aspects of research, including the design and evaluation of survey questionnaires. However, the recent pioneering applications have not considered questionnaire pretesting. This article explores the use of GPT models as a useful tool for…

Mostly in web surveys, attention checks have been proposed to identify inattentive respondents in self-administered surveys as previous research has argued that low-quality answers may introduce severe biases in data analyses. The increasing popularity of mixing survey modes for conducting probability-based surveys amplifies the need for…

Advance translation is a method of source questionnaire development for multilingual survey projects to enhance translatability and (inter)cultural portability. The aim is to minimize translation issues in the final translation stage. I empirically tested the results of a previously conducted advance translation in a think-aloud study and analyzed…

Previous research on grid questions has mostly focused on their comparability with the item-by-item method and the use of shading to help respondents navigate through a grid. This study extends prior work by examining whether lexical similarity among grid items affects how respondents answer the questions in an experiment where we manipulated…

Web, or online, probing has the potential to supplement existing questionnaire design processes by providing structured cognitive data on a wider sample than typical qualitative-only question evaluation methods can achieve. One of the practical impediments to the further integration of web probing is the concern of survey managers about how the…

Migration of participants in demographic and epidemiological studies results in missing data. One approach to reduce resulting losses in statistical power and potential biases is to follow up migrants at their new residence. We describe the follow-up of migrants who were eligible for participation in a trial of a new questionnaire to measure adult…

Short message service (SMS or text messaging) surveys can collect data quickly and inexpensively. However, SMS surveys have space constraints that pose difficulties to questionnaire designers: Questions can only be 160 characters or less, surveys must be short, and many respondents use phones with small screens. In this article, we compare SMS and…

Paired interviews are used to evaluate whether a questionnaire functions properly for both the target respondent and an alternate respondent (proxy). We developed a new application of this tool to evaluate whether a Patient Experience of Care Survey (PECS) for long-term care hospitals (LTCHs) and inpatient rehabilitation facilities (IRFs)…

Previous research shows that the direction of rating scales can influence participants' response behavior. Studies also suggest that the device used to complete online surveys might affect the susceptibility to these effects due to the different question layouts (e.g., horizontal grids vs. vertical individual questions). This article contributes…

Self-assessment measures are commonly used in questionnaire surveys. However, one of the problems with self-reports is that they may be prone to differences in scale usage among respondents. The anchoring vignette method addresses this issue. It relies on two assumptions: response consistency and vignette equivalence. Here we aim to develop a…

A key challenge in the design of effective survey questionnaires is to write questions that respondents can understand consistently. Recommendations in the questionnaire design literature propose the use of respondents' own terminology to facilitate comprehension and the response process. In this article, we propose an innovative questionnaire…

Behavior coding is used to detect issues in questionnaires by flagging interactions between survey respondents and interviewers when their interactions deviate from standardized interviewing. It has become a popular method for evaluating survey questionnaire quality and has been used mostly in Western countries, with little research being done in…

Recent research has shown mixed-mode surveys are advantageous for organizations to use in collecting data. Previous research explored web/mail mode effects for four-contact waves. This study explores the effect of web/mail mixed-mode systems over a series of contacts on the customer satisfaction data from the Florida Cooperative Extension Service…

To collect reliable statistical data on domestic violence in Curaçao, we conducted a large-scale quantitative study (n = 816). To meet with the special needs of the population and topic, we designed a tailored mixed-mode survey to assess the prevalence of domestic violence in Curaçao and its health consequences. Great care was taken to reduce…