EnterpriseSite Configurationrobots.txt

Get robots.txt

Retrieve the robots.txt configuration for various user agents.

Enterprise Only
This endpoint requires an Enterprise workspace.

Required scope: site_config:read

Path parameters

site_idstringRequired

Unique identifier for a Site

Headers

AuthorizationstringRequired

Bearer authentication of the form Bearer <token>, where token is your auth token.

Response

Request was successful

ruleslist of objectsOptional

List of rules for user agents.

sitemapstringOptional

URL to the sitemap.

Errors