Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

Item response tree (IRTree) models are a flexible framework to control self-reported trait measurements for response styles. To this end, IRTree models decompose the responses to rating items into sub-decisions, which are assumed to be made on the basis of either the trait being measured or a response style, whereby the effects of such person…

Measuring cognitive load is important in virtual learning environments (VLE). Thus, valid and reliable measures of cognitive load are important to support instructional design in VLE. Through three studies, we investigated the validity and reliability of Leppink's Cognitive Load Scale (CLS) and developed the extraneous cognitive load (EL)…

This paper reports an investigation into the psychometric properties of the COR-Advantage1.5 (COR-Adv1.5) assessment tool, a criterion-referenced observation-based instrument designed to assess the developmental abilities of children from birth through kindergarten. Using data from 8534 children participating in a state-funded preschool program…

This study investigates the relationships among factor correlations, inter-item correlations, and the reliability estimates of subscores, providing a guideline with respect to psychometric properties of useful subscores. In addition, it compares subscore estimation methods with respect to reliability and distinctness. The subscore estimation…

The psychometric properties of a new, multidimensional measure of test anxiety, the Test Anxiety Measure for College Students (TAM-C), were examined in a sample of 720 undergraduate students. Results of confirmatory factor analyses provided support for a six-factor (Cognitive Interference, Physiological Hyperarousal, Social Concerns,…

Consultation is essential to the daily practice of school psychologists (National Association of School Psychologist, 2010). Successful consultation requires fidelity at both the consultant (implementation) and consultee (intervention) levels. We applied a multidimensional, multilevel conception of fidelity (Dunst, Trivette, & Raab, 2013) to a…

The purpose of this multistudy report was to adapt the Basic Psychological Need Satisfaction and Frustration Scale (BPNSFS) to the Italian context. Two studies were conducted. In Study 1, we investigated the dimensionality, reliability, and convergent and discriminant validity of the instrument in a sample of 544 participants (males = 41%) from 16…

The purpose of this study is to develop a multi-dimensional scale to measure students' awareness of key competencies for M-learning and to test its reliability and validity. The Key Competencies of Mobile Learning Scale (KCMLS) was determined via confirmatory factor analysis to have four dimensions: team collaboration, creative thinking, critical…

Appraisal of the readiness of teachers to accept and use mobile devices for classroom instruction is a critical step whenever an expectation exists that the devices will be used to enhance student learning. Designing professional development requires assessment of teachers' readiness and willingness to embrace mobile learning for their students.…

Disability scholars have recently highlighted social work professional organizations' lagging pace in adopting disability advocacy within diversity agendas and have questioned the adequacy of disability content within accredited social work curricula. Amid growing concerns, measures to assess attitudes of social workers toward disability and…

Accurately measuring levels of technology proficiency in current and future classroom teachers are an important first step toward enhancing comfort level and confidence in integrating technology into the educational environment. The original Technology Proficiency Self-Assessment (TPSA) survey has maintained respectable psychometric properties for…

The purpose of this study was to examine the impact of dimensionality, common-item set format, and different scale linking methods on preserving equity property with mixed-format test equating. Item response theory (IRT) true-score equating (TSE) and IRT observed-score equating (OSE) methods were used under common-item nonequivalent groups design.…

Principals and teachers do not use large-scale assessment results because the lack of distinct and reliable subtests prevents identifying strengths and weaknesses of students and instruction, the results arrive too late to be used, and principals and teachers need assistance to use the results to improve instruction so as to improve student…

This study investigated the reliability and validity of the Multidimensional Scale of Life Skills in Late Childhood, an instrument designed to measure a concept similar to "zest for living" in late childhood. A total of 1,888 elementary school students in the 4th, 5th, and 6th grades residing in urban and suburban areas as well as in…