Hello,
There's not an easy way to manage robots.txt in an OutSystems PaaS environment. While in on-premises environments you can simple add robots.txt to the root of your website, in the OS PaaS such configuration is not possible.
The most common approach I know of, is to create a module that includes a robots.txt file with the property "Deploy action" set to "Deploy to Target Directory". Then on service center you need to create a redirect rule: <your_domain>/robots.txt redirects to <your_domain>/<module_name>/<robots_file>
Although this works it is not very handy:
- If you want to update the rules you need to deploy a new version of your module
- If you want to have different rules per environment, you need to have multiple files
Similar to what we have for security rules in Lifetime, it would be great to have an option to configure the robots.txt file per environment. The file would be deployed to the root of the website.
IG