ERIC Number: ED665506
Record Type: Non-Journal
Publication Date: 2024
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Measuring Computational Thinking -- Developing a Short Performance Test for Higher Education
Josef Guggemos; Roman Rietsche; Stephan Aier; Jannis Strecker; Simon Mayer
International Association for Development of the Information Society, Paper presented at the International Association for Development of the Information Society (IADIS) International Conference on Cognition and Exploratory Learning in the Digital Age (CELDA) (21st, Zagreb, Croatia, Oct 26-28, 2024)
Technological advancements, particularly in artificial intelligence, significantly transform our society and work practices. Computational thinking (CT) has emerged as a crucial 21st-century skill, enabling individuals to solve problems more effectively through an automation-oriented perspective and fundamental concepts of computer science. To ensure the effective integration of CT into educational curricula, it is crucial to develop efficient assessment frameworks that allow teachers to measure and promote student CT proficiency. Therefore, our aim is to develop a short test to measure CT among undergraduate students. To this end, we consider two performance tests: the Computational Thinking test (CTt) and the Algorithmic Thinking Test for Adults (ATTA). We use items from both instruments to compile a short test. Based on a sample of 290 second-year non-computer science undergraduate students, we provide evidence on the quality of our test. Besides classical test theory, we apply item response theory, namely Rasch modeling, and confirmatory factor analysis. Our test shows favorable properties, e.g., Cronbach's alpha > 0.75, and may be suitable for the efficient assessment of CT across higher education programs. [For the full proceedings, see ED665357.]
Descriptors: Computation, Thinking Skills, 21st Century Skills, Test Construction, Undergraduate Students, Undergraduate Study, Factor Analysis, Computer Science, Foreign Countries, Business Education, Multiple Choice Tests, Psychometrics, Measures (Individuals), Test Validity, Performance Based Assessment
International Association for the Development of the Information Society. e-mail: secretariat@iadis.org; Web site: http://www.iadisportal.org
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Switzerland
Grant or Contract Numbers: N/A
Author Affiliations: N/A