Crawling Issues

#557058
  • Resolved Anonymous

    2 years, 6 months ago

    Rank Math free

    Hello!

    Unfortunately, I have had a strange problem for a few days now.

    Somehow, Googlebot and other crawlers (e.g., Ahrefs) get a 502 error when crawling my Website.

    I contacted my CDN provider Bunny.net, and they told me that the connection to the origin (Hostinger) is not getting thought, and there is a Timeout 502 error. But Hostinger said to me that they couldn’t find any issues.

    Now my only hope is you. I have no other idea what can cause this. Somewhere the connection gets blocked. Or the robots.txt not found and a 502 error.

    In the Bunny error log, I see the Google IP getting a 502 error. Bot, no one knows why. Maybe there are some options in RankMath that I should consider changing?

    It worked perfectly before a week or so.

    One article isn’t indexed yet for over four weeks. The error is “Server error 5xx” (A server error means that Googlebot couldn’t access your URL, the request timed out, or your site was busy. As a result, Googlebot was forced to abandon the proposal.)

    I hope you can help me.

    Kindest Regards,
    Mike Roth

Viewing 1 replies (of 1 total)
  • Md. Sakib Khandaker

    2 years, 6 months ago

    Rank Math agency

    Hello,

    Thanks for contacting us, and sorry for any inconvenience that might have been caused due to that.

    Server errors can occur temporarily sometimes. They can be transients. I can see that Google is crawling your site perfectly fine.

    Please refer to the URL attached in the sensitive data section.

    If the issue persists on the next crawl, you may check your server error log to determine what causing the issue.

    Hope that helps, and please do not hesitate to let us know if you need our assistance with anything else.

    Thank you.

    RankBot

    2 years, 5 months ago

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 1 replies (of 1 total)

The ticket ‘Crawling Issues’ is closed to new replies.