Robots.txt has too many redirects or redirect loop

#595240
  • Resolved Anonymous
    Rank Math free

    Our website keeps receiving this message, and We have contacted our server host, GoDaddy. But they mentioned this should be some error on the RankMath side. Any way you can help us to double-check?

    Error message:
    Robots.txt has too many redirects or redirect loop

Viewing 6 replies - 1 through 6 (of 6 total)
  • Hello,

    Thank you for contacting us. We are sorry to hear that you are having trouble with your robots.txt file.

    To help you with this issue, we need some information from you. Please provide us with the following:

    • The URL of the affected website.
    • A copy of your .htaccess file that contains the rules for your site. You can find this file in Rank Math > General Settings > Edit .htaccess File. Please paste the content of this file in the sensitive data section below. The sensitive data section is only visible to you and our support team. It allows you to share confidential information securely.

    Once we have this information, we will be able to investigate the issue further and provide you with a solution.

    We appreciate your cooperation and patience.

    Best regards,

    Anonymous
    Rank Math free

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Anonymous
    Rank Math free

    Hello,

    Thank you for getting back to us.

    We checked your .htaccess file and we didn’t find any rules that would cause a redirect issue. Also, we were able to access your /robots.txt file without any problems and it showed a Status code: 200, which means your robots.txt file is working fine (https://i.rankmath.com/i/0RXzUH, https://i.rankmath.com/i/jOgQoE).

    We are not sure why you are getting this error message. Could you please share a screenshot of the error with us? That would help us to investigate the issue further and provide you with a solution. You can upload the screenshots to imgur.com/upload and share the link here with u.

    Thank you for choosing Rank Math!

    Anonymous
    Rank Math free

    Thanks for your feedback and follow-up on this. I have attached the screen of where I received this issue notice. Image 1
    image 2

    Hello,

    Apologies for the delay as this ticket seems to have been stuck in our drafts section for some reason.

    We’ve checked your robots.txt, and the chain redirect is referring to the HTTP/WWW version of your site

    Http

    You can also use this tool to check: https://httpstatus.io/

    To fix this, you may need to only have one 301 for that version just like the rest of the version below. You may also get in touch with your web host for assistance with this redirect as they are in a better position to assist you with that kind of redirection.

    Regarding the timeout issue, please check these articles to whitelist the Ahref crawlers on your site:
    https://help.ahrefs.com/en/articles/1565233-how-do-i-enable-ahrefs-bot-to-crawl-my-website-and-index-its-pages
    https://help.ahrefs.com/en/articles/78658-what-is-the-list-of-your-ip-ranges

    Hope that helps.

    Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 6 replies - 1 through 6 (of 6 total)

The ticket ‘Robots.txt has too many redirects or redirect loop’ is closed to new replies.