Screaming Frog в Twitter: „@RichTatum @MaeneSigne @Google @wordpressdotcom You can also check in a free tool like @maxxeight's robots.txt testing tool as well btw - https://t.co/blSV8buUFG. Again, they are seeing the older
Robots Exclusion Checker
Free SEO software to optimize your website | Productive Shop