The method of Direct Behavior Rating (DBR) incorporates aspects of both systematic direct observation and behavior rating scales to provide an efficient means to collect time series data. This study extended the development and evaluation of DBR Single-Item Scales (DBR-SIS) as a behavior assessment tool. Eighty-eight undergraduate students used DBR-SIS to rate 2-min video clips of elementary student classroom behaviors across positive (e.g., academically engaged) and negative (e.g., academically "un"engaged) wording conditions. DBR-SIS outcomes were then compared against those obtained via systematic direct observation. Rater bias and error, as well as criterion-related validity of DBR-SIS, were evaluated with systematic direct observation serving as the criterion measure. Results provide support for using DBR-SIS to assess general outcome behaviors relevant to classroom behavior. (Contains 3 tables and 2 figures.)