ERIC Number: ED619754
Record Type: Non-Journal
Publication Date: 2021
Pages: 6
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-
EISSN: N/A
Available Date: N/A
Exploring Dialogism Using Language Models
Ruseti, Stefan; Dascalu, Maria-Dorinela; Corlatescu, Dragos-Georgian; Dascalu, Mihai; Trausan-Matu, Stefan; McNamara, Danielle S.
Grantee Submission, Paper presented at the International Conference on Artificial Intelligence in Education (AIED) (2021)
Dialogism is a philosophical theory centered on the idea that life involves a dialogue among multiple voices in a continuous exchange and interaction. Considering human language, different ideas or points of view take the form of voices, which spread throughout any discourse and influence it. From a computational point of view, voices can be operationalized as semantic chains that contain related words. This study introduces and evaluates a novel method of identifying semantic chains using BERT, a state-of-the-art language model for computational linguistics. The resulting model generalizes to multiple relations including repetitions, semantically related concepts from WordNet (i.e., synonyms, hypernyms, hyponyms, and siblings), as well as pronominal resolutions. By combining the attention scores between words, word pairs are merged into connected components that denote emerging voices from the discourse. The introduced visualization argues for a more dense capturing of inner semantic links between words and even compound words in contrast to classical methods of building lexical chains. [This paper was published in: "AIED 2021," edited by I. Roll et al., Springer Nature Switzerland AG, 2021, pp. 296-301.]
Descriptors: Dialogs (Language), Computational Linguistics, Semantics, Models, Form Classes (Languages), Scores, Visual Aids
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); Office of Naval Research (ONR) (DOD)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A180144; R305A180261; N000141712300; N000142012623
Author Affiliations: N/A