Purpose: The rising popularity of social software poses challenges to the design and evaluation of pedagogically sound cross-cultural online collaborative learning environments (OCLEs). In the literature of computer-mediated communications, there exist only a limited number of related empirical studies, indicating that it is still an emergent research area. The purpose of this paper is to describe an OCLE--iCamp Space--which addresses the challenges by integrating three pedagogical concepts--cross-cultural collaboration, self-directed learning (SDL) and social networking--with the aim to advance participants' competencies and by mixed-method approaches to evaluating the complex situations. Design/methodology/approach: A validation field study involving four European countries was conducted. Groups of students co-created a questionnaire, which was assessed to provide an indicator of task performance. Multi-source (surveys, blogs, emails, diaries, chats, videoconference and interviews) and multi-perspective data (facilitators, students and researchers) were studied with social network analysis, content analysis and conversation analysis. Findings: Motivation of learners as well as facilitators is the critical success factor for an OCLE; voluntary involvement is recommended. Participants should be provided with basic training on the use of selected social software tools. Other critical success factors include task selection that contributes to participants' sense of ownership and moderately structured setting that offers some guidance whilst leaving room for the development of SDL competence. Originality/value: The paper enhances a limited, albeit increasing, number of empirical studies deploying social software for educational purposes. It thus contributes to a body of applied knowledge that enables a coherent understanding of this specific research topic to be drawn. (Contains 3 figures and 2 tables.)