We report on the study of student difficulties regarding a heat engine in the context of a Stirling cycle by the method of measurement. An in-class test about a Stirling engine with a regenerator was taken by three classes, and the students were asked to perform one of the most basic activities--calculate the efficiency of the heat engine. Our data indicate that quite a few students have not developed a robust conceptual understanding of basic engineering knowledge of the heat engine. Notably, the error ratio of the class given a simple tutorial of engineering knowledge is smaller than those of the other two classes by more than 20%. In addition, both the written answers and post-test interviews show that most of the students cannot associate Carnot's theorem with a Stirling cycle. Our results suggest that both scientific and engineering knowledge are important and should be included in instructional approaches, especially in the thermodynamics course taught in the countries and regions with a tradition of not paying much attention to experimental education or engineering training.