Get robots.txt
Retrieve the robots.txt configuration for various user agents.
<Warning title="Enterprise Only">This endpoint requires an Enterprise workspace.</Warning>
Required scope: `site_config:read`
Path parameters
site_id
Unique identifier for a Site
Headers
Authorization
Bearer authentication of the form Bearer <token>
, where token is your auth token.
Response
Request was successful
rules
List of rules for user agents.
sitemap
URL to the sitemap.