EnterpriseSite Configurationrobots.txt

Get robots.txt

Retrieve the robots.txt configuration for various user agents.

Enterprise Only
This endpoint requires an Enterprise workspace.

Required scope: site_config:read

Path parameters

site_idstringRequiredformat: "objectid"
Unique identifier for a Site

Headers

AuthorizationstringRequired

Bearer authentication of the form Bearer <token>, where token is your auth token.

Response

Request was successful
ruleslist of objects or null
List of rules for user agents.
sitemapstring or null
URL to the sitemap.

Errors