Discussions

Ask a Question
Back to All

Bug: Wrong robots.txt format

The current format is

Disallow: /edit/  
Disallow: /login  
Disallow: /reference-edit/  
Disallow: /logout  
Sitemap: /sitemap.xml

The correct format should be:

the full url/domain should be declared

Disallow: /edit/  
Disallow: /login  
Disallow: /reference-edit/  
Disallow: /logout  
Sitemap: https://readme.com/sitemap.xml