robots.txt

Build a robots.txt.

User-agent

Disallow pathsrobots.txt

User-agent: *
Disallow: /admin
Disallow: /private
Sitemap: https://example.com/sitemap.xml