Or you may go with a Completely ready-made robots.txt template made up of a list of the most typical standard and CMS directives. You might also include a sitemap for the file. A sitemap that’s create the right way should contain just the URLs you need indexing in search engines. https://rankingseotoolz.com/robots-txt-generator