The objective of this study was to employ a new tool for assessing pragmatic "proficiency" (over "performance") in L2 students and to determine if pragmatic lessons on compliment sequences had a positive impact on L2 Spanish students' intercultural competence. To this end, students at a Midwestern college engaged in live video chat pre-test conversations in Spanish in which a native speaker was instructed to compliment the student as to naturally assess the response. The student was not aware that s/he would be complimented; as such, this tool may be the most authentic way to assess student pragmatic proficiency within a classroom setting. For comparison purposes, a multiple choice test was also administered. After the pretests, pragmatic interventions on compliment sequences were presented in class, followed by a repeat of the pretests (now posttests). Growth between the tests was the main focus of the data analysis process. Statistical and anecdotal results indicate that the pragmatic lessons greatly increased the students' ability to recognise appropriate compliment sequences in Spanish, but not to produce them. While these findings are not groundbreaking, the innovative nature of the assessment method used should encourage future researchers to use similar assessment techniques for measuring pragmatic proficiency.