Much of the contemporary literature around assessment practices in higher education focuses on assessment quality and its fitness for purpose. However, there is limited research around student comprehension of written assessment task descriptions and their understanding of the task itself. The purpose of this study was to examine a number of…

Advancements in computational linguistics have allowed educational researchers to examine large amounts of text and assess the reading difficulty of that text for speakers whose first language is English (L1), and speakers whose first language is not English (L2). Considering L2 students exploring higher education, extant research suggests these…

Although text readability has traditionally been measured based on simple linguistic features, recent studies have employed natural language processing techniques to develop new readability formulas that better represent theoretical accounts of reading processes. This study evaluated the construct validity of different readability formulas,…

Readers often struggle to identify the main ideas in expository texts. Existing research and instruction provide some guidance on how to encourage readers to identify main ideas. However, there is substantial variability in how main ideas are operationalized and how readers are prompted to identify main ideas. This variability hinders…

To better understand Tennessee's new standardized science assessments, this quantitative study utilized a nonexperimental, descriptive-comparative design to compare the readability of the long-used science TCAP assessment with the newly created science TNReady assessment in grades three, four, and five. As new standards in the state boast higher…

Response time has been used as an important predictor of student performance in various models. Much of this work is based on the hypothesis that if students respond to a problem step too quickly or too slowly, they are most likely to be unsuccessful in that step. However, something that is less explored is that students may cycle through…

Estimating the difficulty of reading tests is critical in second language education and assessment. This study was aimed at examining various text features that might influence the difficulty level of a high-stakes reading comprehension test and predict test takers' scores. To this end, the responses provided by 17,900 test takers on the reading…

For decades, educators have relied on readability metrics that tend to oversimplify dimensions of text difficulty. This study examines the potential of applying advanced artificial intelligence methods to the educational problem of assessing text difficulty. The combination of hierarchical machine learning and natural language processing (NLP) is…

Education is central to promoting healthy, active lifestyles, but most educational materials may be less than suitable for public dissemination. Related kinesiology studies have mainly focused on the reading grade level of print materials. Suitability encompasses more qualities than that and also concerns digital media. This study had two…

For decades, educators have relied on readability metrics that tend to oversimplify dimensions of text difficulty. This study examines the potential of applying advanced artificial intelligence methods to the educational problem of assessing text difficulty. The combination of hierarchical machine learning and natural language processing (NLP) is…

This study examined the extent to which prior beliefs and reading instructions impacted elements of a reader's mental representation of multiple texts. College students' beliefs about childhood vaccinations were assessed before reading two anti-vaccine and two pro-vaccine texts. Participants in the experimental condition read for the purpose of…

Nowadays, text readability is of great importance. Simple but very often ignored, readability statistics can provide information about the level of difficulty of the readability of particular documents and increase an evaluator's credibility. Hence, this research aims to examine the readability index of the test instrument for BIPA (Bahasa…

Readers often struggle to identify the main ideas in expository texts. Existing research and instruction provide some guidance on how to encourage readers to identify main ideas. However, there is substantial variability in how main ideas are operationalized and how readers are prompted to identify main ideas. This variability hinders…

Textbooks are an important source of knowledge input on which the transmission of academic knowledge often relies, especially in the early stages of academic learning. Adopting a corpus-based approach, this study evaluates the text difficulty of science textbooks used in secondary English-medium instruction schools in Hong Kong, with a focus on…

This article evaluates the mandatory English as a foreign language textbooks provided by the government in Chile in terms of readability and types of questions. Three readability formulas are used to analyze the texts: Flesch Reading Ease, Flesch-Kincaid Grade Level, and Coh-Metrix L2 reading index (RDL2). To evaluate the cognitive demands that…