NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: ED675610
Record Type: Non-Journal
Publication Date: 2024
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: 0000-00-00
Grading and Clustering Student Programs That Produce Probabilistic Output
Yunsung Kim; Jadon Geathers; Chris Piech
International Educational Data Mining Society, Paper presented at the International Conference on Educational Data Mining (EDM) (17th, Atlanta, GA, Jul 14-17, 2024)
"Stochastic programs," which are programs that produce probabilistic output, are a pivotal paradigm in various areas of CS education from introductory programming to machine learning and data science. Despite their importance, the problem of automatically grading such programs remains surprisingly unexplored. In this paper, we formalize the problem of assessing stochastic programs and develop an open-source assessment framework called StochasticGrade. Based on hypothesis testing, StochasticGrade offers an exponential speedup over standard two-sample hypothesis tests in identifying incorrect programs, enables control over the rate of grading errors, and allows users to select the measure of proximity to the solution that is most appropriate for the assignment. Moreover, the features calculated by StochasticGrade can be used for fast and accurate clustering of student programs by error type. We demonstrate the accuracy and efficiency of StochasticGrade using student data collected from 4 assignments in an introductory programming course and conclude with practical guidelines for practitioners who hope to use our framework. [For the complete proceedings, see ED675485.]
International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A