ERIC Number: EJ959093
Record Type: Journal
Publication Date: 2012-Feb
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1568-4555
EISSN: N/A
Available Date: N/A
Examining the Validity of the Arizona English Language Learners Assessment Cut Scores
Florez, Ida Rose
Language Policy, v11 n1 p33-45 Feb 2012
The Arizona English Language Learners Assessment (AZELLA) is used by the Arizona Department of Education to determine which children should receive English support services. AZELLA results are used to determine if children are either proficient in English or have English language skills in one of four non-proficient categories (pre-emergent, emergent, basic, intermediate). Children who test at or above the proficient cut score in English are placed in mainstream classes without English language support. Children who obtain scores below the proficient cut scores receive English language support services in state-mandated Structured English Immersion classes. Whenever tests are used to make high-stakes decisions, especially about vulnerable populations (e.g., children), it is the test developers' responsibility to ensure the instrument yields fair and valid results. When cut scores are used as the primary interpretation of the test they are key to establishing the test's validity. This validation study found that cut scores for the AZELLA are of questionable validity. The procedure used to set the cut scores is criticized by national measurement experts as ineffective and obsolete. Further, the test developers do not adequately establish the expertise of the judges used to set the cut scores. Evidence from the cut-score-setting process indicates judges did not come to consensus at the kindergarten level. Analysis of empirical evidence suggests cut scores over-identify kindergarten children and under-identify older children. Finally, the test developers rejected 85% of the cut scores recommended by the standard-setting judges, setting cut scores higher than recommended for kindergarten and lower than recommended for older children, without describing their process or rationale.
Descriptors: Expertise, Test Validity, Second Language Learning, Cutting Scores, Kindergarten, Language Skills, English Language Learners, English (Second Language), Language Tests, Services, Language Proficiency, Immersion Programs, Test Construction, Identification, Standard Setting, High Stakes Tests
Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: service-ny@springer.com; Web site: http://www.springerlink.com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Elementary Education; Kindergarten
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Arizona
Grant or Contract Numbers: N/A
Author Affiliations: N/A