The recent advancement in technology has attracted learners' attention worldwide to Generative Artificial Intelligence (GenAI) for educational purposes. While GenAI has shown promising results for general language purposes (Godwin-Jones, 2023; Xiao & Zhi, 2023), the potential of GenAI for language learning has not been fully explored. This paper, therefore, endeavors to decipher the potential of a GenAI app, Khanmigo, as a language learning tool, specifically for learning French. The app was analyzed by the researcher through her interactions of about 17.5 hours using Chapelle's (2001) Evaluation Framework for discerning the task appropriateness of a given Computer-Assisted Language Learning (CALL) tool. While the app does not show robust performance in all the six criteria suggested for evaluation, it still holds some promise.