# robots.txt merged from multiple sources # Source 1: https://www.ditig.com/robots.txt # ---- # Additional rules from: https://raw.githubusercontent.com/ai-robots-txt/ai.robots.txt/refs/heads/main/robots.txt # ----