Latent class analysis (LCA) is a widely used technique for detecting unobserved population heterogeneity in cross-sectional data. Despite its popularity, the performance of LCA is not well understood. In this study, we evaluate the performance of LCA with binary data by examining classification accuracy, parameter estimation accuracy, and coverage rates of confidence intervals (CIs) through Monte Carlo simulation studies. We address the issue of label switching with a distance-based relabeling approach and introduce an index to measure separation among latent classes. Our results show that classification accuracy, parameter estimation accuracy, and CI coverage rates are primarily influenced by class separation and the number of indicators used for LCA. We recommend using a large sample size to mitigate the effects of tiny class sizes. Additionally, the study finds that the parametric bootstrap CIs perform comparably well or better when compared with the CIs based on the standard maximum likelihood method.