# Allow all crawlers (search engines + AI indexers) full access User-agent: * Allow: / # Sitemap location (recommended) Sitemap: https://ssxindia.com/sitemap.xml # Host is non-standard but sometimes used (OK to include) Host: https://ssxindia.com # (Optional) If you want to be polite to heavy crawlers, uncomment and adjust: # Crawl-delay: 10 # Explicit entries for major crawlers (optional/redundant) User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: DuckDuckBot Allow: / User-agent: Baiduspider Allow: / User-agent: Yandex Allow: / # End of file