Technical SEO
robots.txt
A plain-text file at the site root that tells crawlers which paths they may or may not crawl.
Directives are advisory and not enforced. Use meta robots or HTTP headers for actual index control.
Never block CSS or JS in robots.txt — this breaks rendering and hurts rankings.
Need this applied to your site?
We turn concepts like these into shipped work every week.