delete https://api.webflow.com/beta/sites//robots_txt
Remove specific rules for a user-agent in your robots.txt file. To delete all rules for a user-agent, provide an empty rule set. This will remove the user-agent's entry entirely, leaving it subject to your site's default crawling behavior.
Note: Deleting a user-agent with no rules will make the user-agent's access unrestricted unless other directives apply.
Required scope: site_config:write