In areas with high incidence of tuberculosis (TB), there are more infertile women who underwent in vitro fertilization (IVF) and have latent TB infection (LTBI), and thus, their potential risks should be paid enough attention. The purpose of our study aimed to analyze the relationship between LTBI and clinical pregnancy outcomes of IVF and fresh embryo transfer (IVF-FET). This was a retrospective study of 628 infertile women who had undergone IVF-FET in the Fourth Affiliated Hospital of Hebei Medical University from January 2019 to December 2021. The women experienced no clinical symptoms, negative imaging, and T-SPOT.TB-positive diagnosis of LTBI. We divided the study population into the LTBI group and the non-LTBI group. The clinical pregnancy rate in the LTBI group was significantly lower than that in the non-LTBI group (40.54% vs 49.51%, P = 0.031), and there was no significant difference in live birth rate and miscarriage rate between the two groups. Logistic regression analysis showed that LTBI was an independent risk factor for decreased clinical pregnancy rate in infertile women undergoing IVF-FET. In conclusion, LTBI affects clinical pregnancy rate of IVF-FET in infertile women, and therefore, clinicians (especially in countries with a high TB burden) need to pay attention to LTBI before IVF and embryo transfer.