Objective Rab11A is an important molecule for recycling endosomes and is closely related to the proliferation, invasion, and metastasis of tumors. This study investigated the prognostic and immune significance of Rab11A and validated its potential function and mechanism in breast cancer (BRCA). Methods RNA sequencing data for 33 tumors were downloaded from The Cancer Genome Atlas (TCGA) and Genotype-Tissue Expression databases. Correlation analysis was used to evaluate the relationship between Rab11A expression and immune characteristics. Potential pathways were identified using the Kyoto Encyclopedia of Genes and Genomes and Gene Ontology analysis. Immunohistochemical analysis, colony formation assay, bromodeoxyuridine incorporation assay, immunofluorescence, and Western blot were used to explore potential function and mechanism. Results Analysis of the TCGA database showed significant upregulation of Rab11A expression in a variety of cancers. Rab11A was up-regulated in 82.4% of BRCA. High Rab11A expression is associated with poor survival in cancer patients and is a predictor of poor prognosis. CIBERSORT analysis showed that Rab11A was negatively associated with almost all immune cycle activity scores pan-cancer. The results of the TCGA-BRCA cohort were further confirmed by using pathological samples from clinical BRCA patients. The results showed that Rab11A expression was correlated with estrogen receptor (ER) and progesterone receptor expression in BRCA (p < 0.05). Knockdown and overexpression of Rab11A affected the proliferation of BRCA cells. Further mechanistic studies revealed that down-regulation of ER alpha (ER alpha) and up-regulation of ER beta (ER beta) mediated Rab11A-induced inhibition of BRCA cell proliferation. Conclusion Rab11A expression in pan-cancer is associated with poor prognosis and immune profile. In particular, in BRCA, Rab11A expression regulates cell proliferation by targeting ER alpha and ER beta. High Rab11A expression is tightly associated with immune characteristics, tumor microenvironment, and genetic mutations. These results provide a reference for exploring the role of Rab11A in pan-cancer and provide a new perspective for revealing potential therapeutic targets in BRCA.