Colorectal cancer (CRC) is a multistage disease resulting from complex factors, including genetic mutations, epigenetic changes, chronic inflammation, diet, and lifestyle. Recent accumulating evidence suggests that the gut microbiota is a new and important player in the development of CRC. Imbalance of the gut microbiota, especially dysregulated gut bacteria, contributes to colon cancer through mechanisms of inflammation, host defense modulations, oxidative stress, and alterations in bacterial-derived metabolism. Gut commensal bacteria are anatomically defined as four populations: luminal commensal bacteria, mucus-resident bacteria, epithelium-resident bacteria, and lymphoid tissue-resident commental bacteria. The bacterial flora that are harbored in the gastrointestinal (GI) tract vary both longitudinally and cross-sectionally by different anatomical localization. It is notable that the translocation of colonic commensal bacteria is closely related to CRC progression. CRC-associated bacteria can serve as a non-invasive and accurate biomarker for CRC diagnosis. In this review, we summarize recent findings on the oncogenic roles of gut bacteria with different anatomical localization in CRC progression.