The present study evaluated the validity of the Online Learner Satisfaction Instrument (OLSI) in terms of construct and convergent validity, and measurement invariance across demographic groups. The study results revealed that the factor structures generally confirmed to the original factor structure proposed in the instrument. Also, some…

Recently, psychometricians and researchers have voiced their concern over the exploration of language test items in light of Messick's validation framework. Validity has been central to test development and use; however, it has not received due attention in language tests having grave consequences for test takers. The present study sought to…

Generative artificial intelligence (GenAI) has profoundly reshaped how graduate students conceptualise, design and conduct academic research in higher education. While current metrics predominantly focus on technology acceptance and usage patterns, they often neglect the diverse cognitive engagements in graduate students' integration of GenAI…

The present study was designed to examine the measurement of the Emotionally Intelligent Leadership (EIL) construct and to provide evidence of validation for the multidimensional Emotionally Intelligence Leadership for Students: Inventory 2.0 (EILS:I 2.0). The EILS:I 2.0 is a self-report assessment of emotionally intelligent leadership in the…

The present study was designed basically to develop a psycho-motor mechanism scale based on the theory of translation competence proposed by PACTE (2003), and then to assess the validity and reliability of the constructed scale. In this quantitative research, after designing the scale, two translation tasks were given to 90 M.A. students majoring…

The purpose of this study is to adapt the Mentoring Relationship Effectiveness Scale to Turkish, and to conduct validity and reliability tests regarding the scale. The study group consisted of 156 university science students receiving graduate education. Construct validity and factor structure of the scale was analyzed first through exploratory…

This study reports on the three-year development and validation of a new assessment tool--the Academic Spoken English Strategies Survey (ASESS). The questionnaire is the first of its kind to assess the listening and speaking strategy use of non-native English speaking (NNES) graduate students. A combination of sources was used to develop the…

Students need to learn how to engage in several scientific practices in order to be considered proficient in science. Many of these practices are needed to evaluate scientific claims made in the popular media. Yet, there are few instruments available that science educators can use to assess whether students can apply what they know about…

This study reports the development and validation of the Graduate Skills and Attributes Scale which was initially administered to a random sample of 272 third-year-level and postgraduate-level, distance-learning higher education students. The data were analysed using exploratory factor analysis. In a second study, the scale was administered to a…

Background: Worldwide speech-language therapy (SLT) students are educated in evidence-based practice (EBP). For students to use EBP in their future day-to-day clinical practice, they must value EBP as positive and must feel confident in using it. For curricula developers it is therefore important to know the impact their teaching has on these…

A teacher evaluation system can be threatening to faculty, especially if used for summative decisions. Therefore, it is important to obtain valid and pertinent information. Since students are extensively exposed to course elements, students' evaluation of instruction should be one of several components in the teacher evaluation system. Since…

This study examined the construct validity of the TOEFL iBT Speaking subsection for the purposes of international teaching assistant (ITA) certification, a purpose for which it was not specifically designed. The factor structure of the new TOEFL was compared with that of another language performance test in use at a major American research…

The primary purpose of this study was to provide preliminary validity evidence for a 140-item form of the Vocabulary Size Test, which is designed to measure written receptive knowledge of the first 14,000 words of English. Nineteen native speakers of English and 178 native speakers of Japanese participated in the study. Analyses based on the Rasch…

A sample of 79 individuals participated in the present study to evaluate the test score stability (8-week test-retest interval) and construct validity of the scores of the Adult Manifest Anxiety Scale-College Version, a new measure used to assess anxiety in college students, for application to graduate-level students. Results of the study…

This study, conducted at six southern universities, analyzed the validity and reliability of a researcher developed instrument designed to evaluate educational software in secondary mathematics. The instrument called the Instrument for Software Evaluation for Educators uses measurement scales, presents a summary section of the evaluation, and…