Sound symbolism refers to associations between language sounds and certain perceptual or semantic properties. One well-studied example is the maluma/takete effect, in which individuals tend to associate round-sounding nonwords like maluma with round shapes, and spiky-sounding nonwords like takete with spiky shapes. This phenomenon suggests that…

Purpose: This study was designed to distinguish the degree of sharing of representations between different modalities by investigating whether a word encountering experience in one modality impacts word processing in another modality. Method: In three experiments, participants experienced some words frequently in the auditory modality (Experiment…

Effective collaboration and teamwork skills are critical in high-risk sectors, as deficiencies in these areas can result in injuries and risk of death. To foster the growth of these vital skills, immersive learning spaces have been created to simulate real-world scenarios, enabling students to safely improve their teamwork abilities. In such…

The past decades witness an ongoing interest in reconceptualizing writing as digital multimodal composing (DMC). The emergence of language and multimodal generative artificial intelligence (GAI) tools leads to new forms of DMC processes and products. Yet prior studies have mostly examined non-GAI-assisted DMC, and few have explored how…

The pervasive use of synchronous computer-mediated communication (SCMC) in second language (L2) learning has generated increasing interest among researchers in integrating SCMC with task-based language teaching (TBLT). This study examined the effects of task complexity on Chinese EFL learners' language production in SCMC modality to develop…

Research in adults has shown that novel words are encoded rather swiftly but that their semantic integration occurs more slowly and that studying definitions presented in a written modality may benefit integration. It is unclear, however, how semantic integration proceeds in children, who (compared to adults) have more malleable brains and less…

Though previous research has shown a decreased sensitivity to emotionally-laden linguistic stimuli presented in the non-native (L2) compared to the native language (L1), studies conducted thus far have not examined how different modalities influence bilingual emotional language processing. The present experiment was therefore aimed at…

Purpose: There is a 40-year history of interest in the use of arm and hand gestures in treatments that target the reduction of aphasic linguistic impairment and compensatory methods of communication (Rose, 2006). Arguments for constraining aphasia treatment to the verbal modality have arisen from proponents of constraint-induced aphasia therapy…

New high-frequency multimodal data collection technologies and machine learning analysis techniques could offer new insights into learning, especially when students have the opportunity to generate unique, personalized artifacts, such as computer programs, robots, and solutions engineering challenges. To date most of the work on learning analytics…

This research uses fMRI to understand the role of eight cortical regions in a relatively complex information-processing task. Modality of input (visual versus auditory) and modality of output (manual versus vocal) are manipulated. Two perceptual regions (auditory cortex and fusiform gyrus) only reflected perceptual encoding. Two motor regions were…

Describes three experiments conducted to examine the superior retention of related word pairs when the second word in the pair required active construction by the subject. The results confirm the importance of subjects' checking solution adequacy and of associative relationships in recall. (PMJ)

In two studies, sixth graders (Study 1) and fourth graders (Study 2) listened to or read a text. Some students were asked to imagine pictures of the material. Oral presentation of the material produced better results than written-only forms. Fourth graders benefited more from mental imagery than did sixth graders. (Author/JJD)

This paper discusses the results of a study of 27 college students with deafness that investigated whether cognitive processes are modality dependent in individuals with deafness. The experiment included two separate parts, one composed of shape trials and the other composed of word trials. An initial stimulus was shown on a computer screen for…

Videotaped productions of isolated American Sign Language signs or sentences were presented at speeds of two to six times normal. Results indicated a breakdown in intelligibility at around 2.5 to 3 times the normal rate. Results are similar to those found for auditory reception of time-compressed speech suggesting a modality-independent limit to…

Reports three experiments investigating the relationship of the suffix effect and echoic memory. Shows that echoic memory persists for at least 20 seconds. Illustrates that echoic memory can be used to establish a more effective nonechoic memory. Shows that recency recall is higher to auditory than to visual items. (PMJ)