Sound symbolism refers to associations between language sounds and certain perceptual or semantic properties. One well-studied example is the maluma/takete effect, in which individuals tend to associate round-sounding nonwords like maluma with round shapes, and spiky-sounding nonwords like takete with spiky shapes. This phenomenon suggests that…

Purpose: This study was designed to distinguish the degree of sharing of representations between different modalities by investigating whether a word encountering experience in one modality impacts word processing in another modality. Method: In three experiments, participants experienced some words frequently in the auditory modality (Experiment…

Effective collaboration and teamwork skills are critical in high-risk sectors, as deficiencies in these areas can result in injuries and risk of death. To foster the growth of these vital skills, immersive learning spaces have been created to simulate real-world scenarios, enabling students to safely improve their teamwork abilities. In such…

D-ID Creative Reality Studio (D-ID) is a platform for creating Artificial Intelligence (AI) presenter (digital human) videos, translating videos, and designing conversational agents. D-ID seamlessly integrates deep-learning face animation technology, large language models (LLMs), natural language processing (NLP), and speech synthesis and…

The past decades witness an ongoing interest in reconceptualizing writing as digital multimodal composing (DMC). The emergence of language and multimodal generative artificial intelligence (GAI) tools leads to new forms of DMC processes and products. Yet prior studies have mostly examined non-GAI-assisted DMC, and few have explored how…

The pervasive use of synchronous computer-mediated communication (SCMC) in second language (L2) learning has generated increasing interest among researchers in integrating SCMC with task-based language teaching (TBLT). This study examined the effects of task complexity on Chinese EFL learners' language production in SCMC modality to develop…

The use of new digital formats in language learning and testing improves both the learning and acquisition skills development process of language tests. The process of listening comprehension is considered one of the most complex in the field of Computer Aided Learning Language (CALL) because it relates to multimodal learning channels and brain…

The present study carried out a bibliometric analysis of L2 eye-tracking research. VOSviewer, CiteSpace, and CitNetExplorer were used for the analysis. The data were 245 articles indexed by Social Sciences Citation Index (SSCI). The study identified the research topics, trends, promising research directions, influential authors and documents, and…

Research in adults has shown that novel words are encoded rather swiftly but that their semantic integration occurs more slowly and that studying definitions presented in a written modality may benefit integration. It is unclear, however, how semantic integration proceeds in children, who (compared to adults) have more malleable brains and less…

Though previous research has shown a decreased sensitivity to emotionally-laden linguistic stimuli presented in the non-native (L2) compared to the native language (L1), studies conducted thus far have not examined how different modalities influence bilingual emotional language processing. The present experiment was therefore aimed at…

Purpose: There is a 40-year history of interest in the use of arm and hand gestures in treatments that target the reduction of aphasic linguistic impairment and compensatory methods of communication (Rose, 2006). Arguments for constraining aphasia treatment to the verbal modality have arisen from proponents of constraint-induced aphasia therapy…

New high-frequency multimodal data collection technologies and machine learning analysis techniques could offer new insights into learning, especially when students have the opportunity to generate unique, personalized artifacts, such as computer programs, robots, and solutions engineering challenges. To date most of the work on learning analytics…

The majority of studies in second-language (L2) speech processing have involved unimodal (i.e., auditory) input; however, in many instances, speech communication involves both visual and auditory sources of information. Some researchers have argued that multimodal speech is the primary mode of speech perception (e.g., Rosenblum 2005). Research on…

Universities are increasingly looking into self-service systems with intelligent digital agents to supplement or replace labor-intensive services, such as academic counseling. The Open University of Hong Kong has developed an intelligent online system that instantly responds to enquiries about career development, learning modes, program/course…

This research uses fMRI to understand the role of eight cortical regions in a relatively complex information-processing task. Modality of input (visual versus auditory) and modality of output (manual versus vocal) are manipulated. Two perceptual regions (auditory cortex and fusiform gyrus) only reflected perceptual encoding. Two motor regions were…