As technology and education intersect, the potential of Artificial Intelligence (AI) to enhance learning and engagement via chatbots is notable and has been widely acclaimed, though with mixed reports. This study thus investigates AI chatbots' effectiveness in enhancing learning outcome and engagement, using a quasi-experimental design with three null hypotheses. Participants included 90 and 96 higher education students in experimental and control groups, respectively. Data were collected using Learning Outcome Tests and Student Engagement Scales. Analysis revealed no significant difference in learning outcomes or engagement between groups, suggesting a need for a balanced integration of AI and traditional teaching methods for optimal results.