Considering scoring validity as encompassing both reliable rating scale use and valid descriptor interpretation, this study reports on the validation of a CEFR-based scale that was co-constructed and used by novice raters. The research questions this paper wishes to answer are (a) whether it is possible to construct a CEFR-based rating scale with…

Researchers suggest that certain supportive behaviors of mentors could increase the benefits of school-based mentoring for youth. However, the literature contains few validated instruments to measure these behaviors. In our present study, we aimed to construct and validate a tool to measure the supportive behaviors of mentors participating in…

This study explored motivation and engagement among North American (the United States and Canada; n = 1,540), U.K. (n = 1,558), Australian (n = 2,283), and Chinese (n = 3,753) secondary school students. Motivation and engagement were assessed via students' responses to the Motivation and Engagement Scale-High School (MES-HS). Confirmatory factor…

Factor analysis can be a valuable tool for assessing validity; however, the reliabilities of identified factors must be attended to. This study examined the impacts of item variance on factor stability and structure. The attempt was to determine empirically whether unnumbered graphic scales scored using a larger number of scale steps produce more…

In research with children, there is a common problem which could reduce the reliability of a questionnaire for some children but not others: verbal comprehension. (Authors)

Special problems confront the researcher measuring the attitudes of young children who cannot readily make cognitive judgments associated with conventional psychometric scales, such as Likert scales. One measurement strategy, called the method of paired comparisons, can overcome these difficulties. The method is explained in this paper. A small…

This paper presents results of a generalizability assessment of two sets of scales designed to evaluate the quality of verbal and nonverbal interactions between parent and child. The Nursing Child Assessment Feeding Scale (NCAFS) and Nursing Child Assessment Teaching Scales (NCATS) were developed as part of a longitudinal study aimed at…

Research on teacher evaluation and teacher effectiveness indicates that there are serious problems with the reliability of presage, process, and product findings. Quality in teaching can best be assessed by measuring process in the classroom and by using observation instruments which record the occurrence of specific, well-defined behaviors. (PP)

Basically, two different forms of the sociometric technique for assessing children's peer status exist: peer-nomination and peer-rating. Although more popular, the peer-nomination technique has several psychometric deficiencies; these limit research efforts attempting to identify correlations between peer sociometric status and other social…