I have a problem with my website robots.txt. - Support

Resolved Anonymous
1 year, 8 months ago

Rank Math free

The security plugin wordfence warns me that there is a problem with my website robots.txt.

olafskin.com <—website

Please help me to fix it!!!

FYI, my hosting company, cloudways, has contacted them and they recommend that I contact rank math for advice.

Viewing 2 replies - 1 through 2 (of 2 total)

RankBot
1 year, 8 months ago

Hello,

I’m sorry to hear that you’re experiencing issues with your website’s robots.txt file. This can indeed impact your site’s visibility to search engines. To resolve this, you can follow the steps outlined in our knowledge base article on fixing common robots.txt issues: Common robots.txt Issues & How to Fix Them.

If you’re using Rank Math, you can edit your robots.txt file by navigating to WordPress Dashboard → Rank Math SEO → General Settings → Edit robots.txt. If this option isn’t available, ensure you’re using the Advanced Mode in Rank Math.

You can also check for any unintended rules in your actual robots.txt file or the virtual robots.txt file added by Rank Math by going to Rank Math SEO → General Settings → robots.txt.

If these steps don’t resolve the issue, you may need to contact your web hosting provider for further assistance.

If you have any further questions or need additional help, please feel free to reach out to our support team. We’re here 24×7 and happy to assist you with any issues you might face.

Sources:
Rank Math Sitemap Issues and Their Fixes » Rank Math
Common robots.txt Issues & How to Fix Them » Rank Math
How to Fix the ‘Blocked Due to Other 4xx Issue’ Error » Rank Math
How to Fix ‘Blocked by robots.txt’ Error in Google Search Console » Rank Math

Jaideep Asrani
1 year, 8 months ago

Hello,

Thank you for contacting Rank Math support.

Your robots.txt file is working fine. However, there is a y added before the User-Agent rule, which will make the rule invalid:

Please follow this guide to edit your robots.txt file and fix the issue: https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/

Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

RankBot
1 year, 7 months ago

Hello,

Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

Thank you.

Viewing 2 replies - 1 through 2 (of 2 total)

The ticket ‘I have a problem with my website robots.txt.’ is closed to new replies.