Fighter jets are a critical national asset. Because of the high cost of their manufacture and that of their related equipment, both pilots and maintenance personnel must complete intensive training before coming into contact with a jet. Due to gradual military downsizing, one-on-one training is often impracticable, and the level of familiarization with procedures among personnel is difficult to measure. The US military introduced a chatbot as part of its digital training material to enhance training effectiveness and avoid equipment damage. In this study, the contribution of an artificial intelligence (AI) chatbot in training is explored. To evaluate the necessity of an AI chatbot, research samples were divided into two groups, namely an experimental and a control group, with 20 people in each group. A paired t test was employed for differentiation analysis of pretest and posttest average scores, revealing that the two groups exhibited a statistically significant improvement in their learning performance. In addition, the blend of analysis of variance results indicated significant differences between the two groups. The chatbot training was more effective than traditional instructor teaching in terms of trainee performance improvement.