ERIC Number: ED594585
Record Type: Non-Journal
Publication Date: 2018-Dec
Pages: 31
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Using Feature Analysis to Examine Career Readiness in High School Assessments. CRESST Report 858
Kao, Jenny C.; Choi, Kilchan; Rivera, Nichole M.; Madni, Ayesha; Cai, Li
National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
This report is the second in a series considering career-readiness features within high school assessments. Experts in English language arts and math were trained to rate a selection of active Grade 8 and Grade 11 Smarter Balanced items using feature set lists that were refined within the items' respective content areas (30 features for ELA items; 22 features for math items). A total of 264 ELA items and 186 math items were rated. ELA items contained between three and 13 career-readiness features, with an average of 6.0. The most frequent features were importance of being exact or accurate, written comprehension, time sharing, deductive reasoning, and reading comprehension. Math items contained between two and 15 career-readiness features, with an average of 7.8. The most frequent features were deductive reasoning, analyzing data or information, reading comprehension, number facility, and processing information. Feature ratings of the target items were analyzed with item metadata difficulty parameters in order to explore relationships between features and item difficulty. A number of career-readiness features showed associations with item difficulty, notably, reading comprehension for Grade 8 math and deductive reasoning for Grade 11 ELA. Because career-readiness features can be used to explain item difficulty, results suggest that such features are prevalent in content-based assessments, and inferences for career readiness can thus be drawn from test performance.
Descriptors: Career Readiness, High School Students, Language Arts, Mathematics, Grade 8, Grade 11, Mathematics Skills, Writing Skills, Reading Skills, Logical Thinking, Test Items, Student Evaluation, Job Skills, Listening Skills, Problem Solving, Critical Thinking, Reading Comprehension, Attention
National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 300 Charles E Young Drive N, GSE&IS Building 3rd Floor, Mailbox 951522, Los Angeles, CA 90095-1522. Tel: 310-206-1532; Fax: 310-825-3883; Web site: http://www.cresst.org
Publication Type: Reports - Research
Education Level: High Schools; Secondary Education; Elementary Education; Grade 8; Junior High Schools; Middle Schools; Grade 11
Audience: N/A
Language: English
Sponsor: Department of Education (ED)
Authoring Institution: National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
Grant or Contract Numbers: S368A150011
Author Affiliations: N/A