> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://developers.webflow.com/data/v2.0.0-beta/reference/enterprise/site-configuration/robots-txt/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://developers.webflow.com/_mcp/server. # robots.txt ## API Docs - robots.txt [Get robots.txt](https://developers.webflow.com/data/reference/enterprise/site-configuration/robots-txt/get.md) - robots.txt [Replace robots.txt](https://developers.webflow.com/data/reference/enterprise/site-configuration/robots-txt/put.md) - robots.txt [Update robots.txt](https://developers.webflow.com/data/reference/enterprise/site-configuration/robots-txt/patch.md) - robots.txt [Delete robots.txt](https://developers.webflow.com/data/reference/enterprise/site-configuration/robots-txt/delete.md) ## OpenAPI Specification The raw OpenAPI 3.1 specification for this API is available at: - [OpenAPI JSON](https://developers.webflow.com/data/v2.0.0-beta/reference/enterprise/site-configuration/robots-txt/openapi.json) - [OpenAPI YAML](https://developers.webflow.com/data/v2.0.0-beta/reference/enterprise/site-configuration/robots-txt/openapi.yaml)