Questionnaire designers are encouraged to write questions as complete sentences. In self-administered surveys, incomplete question stems may reduce visual clutter but may also increase burden when respondents need to scan the response options to fully complete the question. We experimentally examine the effects of three categories of incomplete…

The rapid advancements in generative artificial intelligence have opened new avenues for enhancing various aspects of research, including the design and evaluation of survey questionnaires. However, the recent pioneering applications have not considered questionnaire pretesting. This article explores the use of GPT models as a useful tool for…

Mostly in web surveys, attention checks have been proposed to identify inattentive respondents in self-administered surveys as previous research has argued that low-quality answers may introduce severe biases in data analyses. The increasing popularity of mixing survey modes for conducting probability-based surveys amplifies the need for…

Survey organizations aiming to improve response rates in the later stages of fieldwork often attempt refusal conversions. However, reestablishing contact with units that have refused participation at prior stages of fieldwork may prove costly and time consuming. In this article, the potential of using a refusal conversion procedure in a single…

The presentation of survey requests represents an easily modifiable feature of survey communications that can in some contexts affect response propensities. Here, we examine how two features: the framing of the participation request (informed by prospect theory) and the inclusion of targeted appeals based on demographic background (age or…

Advance translation is a method of source questionnaire development for multilingual survey projects to enhance translatability and (inter)cultural portability. The aim is to minimize translation issues in the final translation stage. I empirically tested the results of a previously conducted advance translation in a think-aloud study and analyzed…

Declining survey response rates concern researchers aiming to ensure study validity. This article tested the effectiveness of multiple pre-incentives on increasing survey response to the Millennium Cohort Study. Participants consisted of U.S. military service members and veterans, and were randomly assigned to receive a $2 bill, $5 gift card,…

Previous research on grid questions has mostly focused on their comparability with the item-by-item method and the use of shading to help respondents navigate through a grid. This study extends prior work by examining whether lexical similarity among grid items affects how respondents answer the questions in an experiment where we manipulated…

Web surveys are popular in social sciences for reaching a large audience at a low cost and in a short period. However, response rates and nonresponse bias are still issues of concern. Using a factorial randomized control trial design, this study explores whether different communication emails affect response rates, representativeness, and response…

This study examined the feasibility of conducting a follow-up survey of panel attriters as a panel maintenance measure to investigate respondents' reasons for attrition, assessing their willingness to rejoin, and updating their addresses. We surveyed FReDA panelists who had not participated in two consecutive subwaves and were excluded from the…

Previous survey research has found that prompt interventions for speeding and straightlining were effective at reducing these undesirable response behaviors in web surveys. However, the effects of prompt interventions on data quality measures are mixed, and it is unclear how prompt interventions affect key survey estimates. We conducted an…

Researchers have become increasingly interested in response times to survey items as a measure of cognitive effort. We used machine learning to develop a prediction model of response times based on 41 attributes of survey items (e.g., question length, response format, linguistic features) collected in a large, general population sample. The…

We tested a novel extension to mailed invitations to a web-push survey, using a postcard invitation to deliver a scratch-off giftcode incentive similar to an instant-win lottery ticket. Scratch-off postcards were included as one of five conditions in randomized survey experiment varying two mailing types (letter and postcard) and three incentive…

Expected yield rates are essential to a survey's data collection plan, as they inform requisite sample sizes to meet the survey's objectives. Given an overall expected yield rate for a self-administered mail survey, this short take describes a simple method for using the Census Planning Database to assign differential yield rates to lower-level…

Even small monetary incentives, e.g., a one-dollar bill in a postal invitation letter, can increase the response rate in a web survey. However, in the euro currency area, the smallest amount of monetary incentive for a postal invitation is a five-euro bill, which is costly. As such, we conducted a random experiment with prepaid stamp and postcard…