# Contentry.ai Robots.txt # https://contentry.ai User-agent: * Allow: / # Sitemaps Sitemap: https://contentry.ai/sitemap.xml # Disallow admin/private areas Disallow: /api/ Disallow: /dashboard Disallow: /billing/ Disallow: /auth/ # Allow search engines to crawl public pages Allow: / Allow: /pricing Allow: /docs Allow: /blog Allow: /careers Allow: /contact Allow: /privacy Allow: /terms Allow: /security