Although self-report surveys are widely used for data collection, data quality can vary across populations because certain groups are more likely to engage in insufficient effort responding (IER). Our study examined how different levels of the educational system--student groups, schools, and cultural contexts--affect data quality due to IER, using…

Online surveys are widely used in social science research as well as in empirical studies of open, online, and distance education. However, students' responses are likely to be at odds with their actual behavior. In this context, we examined the discrepancies between self-reported use and actual use (i.e., learning analytics data) among 20,646…

In web surveys, no interviewer is present to clarify question comprehension problems, which can be particularly prevalent among respondents with low literacy skills. Although plain language is used in various contexts to improve text comprehensibility, its use in social science questionnaires has not been investigated to date. Using a…

Probes are follow-ups to survey questions used to gain insights on respondents' understanding of and responses to these questions. They are usually administered as open-ended questions, primarily in the context of questionnaire pretesting. Due to the decreased cost of data collection for open-ended questions in web surveys, researchers have argued…

The designs of many student-facing learning analytics (SFLA) dashboards are insufficiently informed by educational research and lack rigorous evaluation in authentic learning contexts, including during remote laboratory practical work. In this article, we present and evaluate an SFLA dashboard designed using the principles of formative assessment…

Short message service (SMS or text messaging) surveys can collect data quickly and inexpensively. However, SMS surveys have space constraints that pose difficulties to questionnaire designers: Questions can only be 160 characters or less, surveys must be short, and many respondents use phones with small screens. In this article, we compare SMS and…

The National Center for Education Statistics (NCES) sponsors the National Teacher and Principal Survey (NTPS) on behalf of the U.S. Department of Education in order to collect data on public and private schools, principals, and teachers in the United States. The U.S. Census Bureau conducts the survey for NCES. The NTPS provides data on the…

This study describes a method for collecting data from nonliterate, non-English-speaking populations. Our audio computer-assisted self-interview instrument with color-labeled response categories was designed for use with helper assistance. The study included 30 dyads of nonliterate older Hmong respondents and family helpers answering questions…

The purpose of this study is to examine the written response instruments used in postgraduate theses completed in the field of special education in Turkey between 2015 and 2018 and explore the psychometric profiles of these instruments. In the study, a total of 137 master's theses and 37 dissertations were reviewed using the Data Collection…

Previous research shows that interviewers to some extent fail to expend the effort that is needed to collect high-quality survey data. We extend the idea of interviewer satisficing to a related task, in which the interviewers themselves answer survey questions. We hypothesize that interviewers who self-administer the questionnaire in a careless…

Although numerous survey-based studies have found that students who identify as lesbian, gay, bisexual, or questioning (LGBQ) have elevated risk for many negative academic, disciplinary, psychological, and health outcomes, the validity of the types of data on which these results rest have come under increased scrutiny. Over the past several years,…

The School Survey on Crime and Safety (SSOCS) is managed by the National Center for Education Statistics (NCES) within the Institute of Education Sciences of the U.S. Department of Education. SSOCS collects extensive crime and safety data from principals and administrators of public schools in the United States. Data from this collection can be…

This article describes the development of the Design Evaluation and Feedback Tool (DEFT), a custom-built web-based system that collects and reports data to support teaching, learning, and research in project-based engineering design education. The DEFT system collects data through short weekly questionnaires for students and instructors in…

Instructional technologists and faculty in post-secondary institutions have increasingly adopted learning analytics interventions such as dashboards that provide real-time feedback to students to support student' ability to regulate their learning. But analyses of the effectiveness of such interventions can be confounded by measures of students'…

Contemporary office work is becoming increasingly challenging as many routine tasks are automated or outsourced. The remaining problem solving activities may also offer potential for lifelong learning in the workplace. In this study, we analyzed problem solving in an office work setting using an Internet-based, semi-standardized diary to collect…