Hello,
I understand the concern you are facing with the “Robots.txt Not Fetched – Redirect error” in Google Search Console. This issue can impact your site’s visibility on Google.
To address this problem, you can follow these steps:
-
Check Robots.txt File: Ensure that your robots.txt file is accessible and correctly configured. You can use tools like the Robots Testing Tool to verify your robots.txt file’s content.
-
Clear Cache: Clear your website cache to ensure that you are viewing the latest version of your robots.txt file.
-
Remove Blocking Rules: If your robots.txt file contains rules like Disallow: /, it might be blocking Googlebot from crawling your site. You can edit your robots.txt file to remove such rules. Here is a guide on how to edit robots.txt with Rank Math.
If after following these steps, the issue persists, please reply to this ticket, and a human agent from the Rank Math Support team will assist you further.
Thank you for bringing this to our attention.
Best regards.
Sources:
Common robots.txt Issues & How to Fix Them » Rank Math
How to Fix the “Indexed, though blocked by robots.txt” Error » Rank Math
How to Fix ‘Blocked by robots.txt’ Error in Google Search Console » Rank Math
Hello,
Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.
Could you please share the robots.txt URL so that we can check the issue further for you?
Looking forward to helping you.
Thank you.
Hello,
I have updated the sensitive data as requested. Can you please check further?
Thank you.
Hello,
We checked your robots.txt file and found a 307 redirection there. Please check the screenshot in the sensitive data section for reference.
If you don’t have any redirection on your .htaccess file then we might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.
Please do take a complete backup of your website before sharing the information with us.
It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:
https://wordpress.org/plugins/temporary-login-without-password/
You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):
https://wordpress.org/plugins/wp-security-audit-log/
Looking forward to helping you.
Thank you.
Hello,
I have updated the sensitive data as requested. Can you please check further?
Thank you.
Still waiting for your guidance. Please help me to restore my presence on google
Hello,
Can you please share your custom login URL? Your /wp-admin page is redirecting to /reviews and your /wp-login.php page is throwing 404.
We are looking forward to hearing back from you.
I have submitted everything in my sensitive data section. You can get my login details from their
Hello,
We’re requesting for your login URL, i.e. the URL you visit when you want to login to your website. /wp-admin and /wp-login.php are both not working, here’s a video: https://i.rankmath.com/v/WXCyuP
We are looking forward to hearing back from you.
Mr Great I already mentioned that as instructed by Mr Rakkibuzaman I uploaded every necessary information on my sensitive data section you cam get it from their.
Sorry for misunderstanding I have enter the Login URL in sensitive data section, Again sorry for misunderstanding
Hello,
We have investigated this issue and it looks like one of your plugins is causing the issue. From our troubleshooting, it looks like the Hostinger plugin is causing the issue.
When the Hostinger/Hostinger AI Assistant plugins are deactivated, your /robots.txt file is working properly. Here’s a screenshot:
To resolve this issue, please reach out to the Hostinger support team – as they’ll be in a better position to help with this.
Thank you for your patience and cooperation
Hello,
The screenshot you shared is not loading. Can you please reupload it using this tool? https://imgur.com/
Meanwhile, we checked your robots.txt file and it isn’t causing a redirection loop after disabling Hostinger Ai plugin.
Please clear your website and browser caches and check again.
Looking forward to helping you.
Hello,
Can you confirm what platform this is? Usually, when a change is made, you will need to wait a couple of days for the URL to be recrawled. You can confirm that the redirect is no longer active by deactivating the problematic plugin and then testing your website on https://httpstatus.io/.
We tested this again both via https://httpstatus.io/ and on https://view.hugo-decoded.be/ and the robots.txt file is working fine on both instances – here’s a video: https://i.rankmath.com/v/itYSLN
We hope this helps clarify the issue. Please let us know if you have any other questions or concerns.
Hello,
We’re not getting any redirects when we test your robots.txt. Please record a video/screencast that shows the Hostinger plugins deactivated and you testing the robots.txt file on https://httpstatus.io/.
You can use a tool like loom.com or screencastify.com to record the video. Share the video URL with us so we can assist you further.
Thank you for your patience and cooperation
