Skip to navigation

Delete robots.txt Content

Clears the robots.txt field under Site settings > SEO > Indexing and returns the empty value. Webflow ignores any request body.

Publish to apply changes

Clearing the field marks the site as having unpublished changes, unless the field is already empty. After the next site publish, the published robots.txt file contains only the lines that Webflow adds: the Traffic controls blocks and the Sitemap: line. When none of those lines apply, the published file is empty.

When Webflow subdomain indexing is turned off, the robots.txt file on the webflow.io subdomain blocks all crawlers, whatever the robots.txt field says.

Enterprise Only
This endpoint requires an Enterprise workspace.

Required scope | site_config:write

Authentication

AuthorizationBearer

Bearer authentication of the form Bearer <token>, where token is your auth token.

Path parameters

site_idstringRequiredformat: "objectid"
Unique identifier for a Site

Response

Request was successful
contentstring
The robots.txt text.

Errors

400
Bad Request Error
401
Unauthorized Error
403
Forbidden Error
404
Not Found Error
429
Too Many Requests Error
500
Internal Server Error