A free app for WordPress, by Pagup.

WordPress Robots.txt optimization is a handy extension for website owners who want to create their own robots.txt file for a better SEO experience.

A robots.txt file is a text file that is used to tell the robots what web pages to index. It contains a list of URLs, and the robots can visit them in order. This helps to boost the SEO of your website, especially if you have a lot of links on it.

But in order to make it work, you need to install it on your website. And to do that, you need to have your own domain name, or a subdomain name of your choice. The extension supports both subdomain and domain name matching.

In addition to that, it is possible to add a site map.