The complex processes of collaborative knowledge construction require a multimodal approach to capture the interplay between learners, tools, and the environment. While existing studies have recognized the importance of considering multiple modalities, there remains a need for a comprehensive framework that explicitly models the dynamics of…