# robots.txt for best-magento-project-rescue-teams.com # Goal: allow Bing organic crawl + ChatGPT Search visibility while letting the site owner # decide whether to permit model-training crawl (GPTBot). User-agent: Bingbot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: GPTBot Allow: / # Default for everyone else User-agent: * Allow: / Sitemap: https://best-magento-project-rescue-teams.com/sitemap.xml # Notes: # - OAI-SearchBot fetches pages for ChatGPT Search results — keep allowed for AEO visibility. # - ChatGPT-User fetches pages on behalf of end users invoking browsing — keep allowed. # - GPTBot is OpenAI's model-training crawler. If the site does not want its content used # for model training, replace the GPTBot block above with: # User-agent: GPTBot # Disallow: / # OAI-SearchBot and ChatGPT-User remain allowed for ChatGPT Search visibility.