# General Rules User-agent: * Crawl-delay:5 Disallow: /home/ Disallow: /docs/ Disallow: /xml/ Disallow: /php/email.php Disallow: /text/ Disallow: /temp/ Disallow: /layout/ Disallow: /hidden/ # ✅ Allow OpenAI GPTBot to crawl for AI training and retrieval User-agent: GPTBot Allow: / # ✅ Allow OpenAI Search / experimental agents User-agent: OAI-Search Allow: / # ✅ Allow Bing and ChatGPT (browsing uses Bing as backend) User-agent: Bingbot Allow: / # ✅ Allow Googlebot for SEO and discovery User-agent: Googlebot Allow: / # ✅ General rule for all well-behaved bots User-agent: * Allow: / # 📍 Sitemap reference Sitemap: https://www.pccables.com/sitemap_index.xml