ERIC Number: ED666504
Record Type: Non-Journal
Publication Date: 2021
Pages: 133
Abstractor: As Provided
ISBN: 979-8-7386-4892-2
ISSN: N/A
EISSN: N/A
Available Date: 0000-00-00
The Time Course and Interaction of Emoji and Text Processing during Natural Reading: Evidence from Eye Movements
Eliza Barach
ProQuest LLC, Ph.D. Dissertation, State University of New York at Albany
Emojis are nonverbal elements used in text-based communication that may function like gestures in spoken communication (Feldman et al., 2017; McCulloch & Gawne, 2018). Like words, emojis can convey semantic information and support message comprehension (Lo, 2008; Riordan, 2017b). Nevertheless, the cognitive and perceptual processes involved in emoji recognition and integration during reading remain unclear. Specifically, it is unclear how early semantic processing of emojis begins as well as how emojis and text interact during reading. Such empirical questions have implications for contemporary models of eye movement control, such as "E-Z Reader" (Reichle et al., 1998, 2012) and "SWIFT" (Engbert et al., 2002, 2005). To investigate the time course of emoji and text processing, across two experiments I monitored participants' eye movements while they read sentences containing a target word (e.g., "coffee") with a semantically congruent (e.g., [hot beverage emoji]) or incongruent (e.g., [beer mug emoji]) or no emoji. Both experiments revealed that emoji processing begins in the parafovea and has an overlapping time course with that of words. As evidence for parallel lexical processing during reading, Experiment 2 revealed a semantic emoji "parafoveal-on-foveal" (PoF) effect whereby a congruent parafoveal emoji facilitated foveal target word processing. Lastly, the data from Experiment 2 were reanalyzed to examine if processing difficulty at the fovea (i.e., foveal load) influences the degree of parafoveal processing (i.e., "the foveal load hypothesis"; Henderson & Ferreira, 1990) and subsequent processing of an emoji (i.e., "spillover effects"). Foveal load was not only operationalized by target word frequency, but also by orthographic distinctiveness, and semantic diversity. Although the results for the fixation time eye-tracking measures failed to document support for the foveal load hypothesis or spillover effects, the emoji skipping measure revealed greater parafoveal processing of incongruent emojis under low foveal load conditions. In summary, this dissertation demonstrates the generalizability of key assumptions of models of eye movement control during reading to emojified text. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com.bibliotheek.ehb.be/en-US/products/dissertations/individuals.shtml.]
Descriptors: Nonverbal Communication, Reading Skills, Text Structure, Reading Comprehension, Semantics, Eye Movements, Visual Aids
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com.bibliotheek.ehb.be/en-US/products/dissertations/individuals.shtml
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A