# CareerPlane — robots.txt (Sprint-1.5, D-2026-04-24-04) # Open crawl on every learner-facing page; block only API + private routes. # Field/Career/Subject browse pages under /f/ and topic detail under /c/ are # explicitly allowed so crawlers pick up the full Category_Code lattice. User-agent: * Allow: / Allow: /f/ Allow: /c/ Allow: /portal Disallow: /api/ Disallow: /readyz Disallow: /healthz Sitemap: https://careerplane.ai/sitemap.xml