ERIC Number: ED603257
Record Type: Non-Journal
Publication Date: 2013
Pages: 12
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Alternate Destinies for Survey Items Destined for the Island of Misfit Toys: An Analysis of Teachers' Perceptions of NAPLAN
Harbaugh, Allen G.; Thompson, Greg
Australian Association for Research in Education, Paper presented at the Annual Meeting of the Australian Association for Research in Education (AARE) (Adelaide, Australia, 2013)
This is a methodological paper describing when and how manifest items dropped from a latent construct measurement model (e.g., factor analysis) can be retained for additional analysis. Presented are protocols for assessment for retention in the measurement model, evaluation of dropped items as potential items separate from the latent construct, and post hoc analyses that can be conducted using all retained (manifest or latent) variables. The protocols are then applied to data relating to the impact of the NAPLAN test. The variables examined are teachers' achievement goal orientations and teachers' perceptions of the impact of the test on curriculum and pedagogy. It is suggested that five attributes be considered before retaining dropped manifest items for additional analyses. (1) Items can be retained when employed in service of an established or hypothesized theoretical model. (2) Items should only be retained if sufficient variance is present in the data set. (3) Items can be retained when they provide a rational segregation of the data set into subsamples (e.g., a consensus measure). (4) The value of retaining items can be assessed using latent class analysis or latent mean analysis. (5) Items should be retained only when post hoc analyses with these items produced significant and substantive results. These suggested exploratory strategies are presented so that other researchers using survey instruments might explore their data in similar and more innovative ways. Finally, suggestions for future use are provided.
Descriptors: Teacher Surveys, Teacher Attitudes, National Curriculum, Item Analysis, Goal Orientation, Teaching Methods, Achievement Tests, Foreign Countries, Factor Analysis
Australian Association for Research in Education. AARE Secretariat, One Geils Court, Deakin ACT 2600, Australia. Tel: +61-2-6285-8388; e-mail: aare@aare.edu.au; Web site: http://www.aare.edu.au
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Australia
Grant or Contract Numbers: N/A
Author Affiliations: N/A