> This page is for Home.

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://developers.webflow.com/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://developers.webflow.com/_mcp/server.

# Support for robots.txt

> Update: Added new endpoints to the Data API giving you more tools to access site configurations, and new methods to the Designer API, allowing you to determine a user's permissions and capabilities in the Webflow Designer.

In this latest release, we've added new endpoints to the Data API giving you more tools to access site configurations, and new methods to the Designer API, allowing you to determine a user's permissions and capabilities in the Webflow Designer.

### New endpoints

* **[Get robots.txt](/data/v2.0.0-beta/reference/enterprise/site-configuration/robots-txt/get):** Retrieve the robots.txt configuration for various user agents.