-
when i am submitting my google webstories to google search console it is showing that the particular feed is being blocked by robot txt but when i am seeing it in rank math i am unable to get the fortunate solution to the problem after reading so many articles also i am facing this issue so please help me in this matter
link to index : https://www.thebusinesslife.in/web-stories/top-3-mba-colleges-in-pune-maharastra/
problem showing in google search console :
Crawl allowed?
error
No: blocked by robots.txt
Page fetch
error
Failed: Blocked by robots.txt
-
Hello,
Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.
We’ve checked your page and we can see that Google can crawl this page without any issues:
https://search.google.com/test/amp/result?id=Mcrfq6VSY6YhhPXv-BVDpgIf you’re still facing the issue, please try to clear your website cache including any server-level cache, and revalidate the issue in your Google Search Console account. Once done, give Google some time to recrawl your site.
Meanwhile, your robots.txt does not contain the Rank Math default and recommended robots.txt rules. You may try following our rules and see if it improves the situation:
https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/#default-rulesHope that helps.
Thank you.
The ticket ‘When i am indexing my web stories it is showing blocked by robot txt’ is closed to new replies.