Robots.txt Problem

#632235
  • Resolved Anonymous

    2 years ago

    Rank Math free

    Dear Sir/Madam,

    I am using rankmath on two of my websites and both are using different themes. Since few day google bots could not fetch my websites sitemaps or could not crawl any link or any content. Only the common thing between both websites is rankmath. Is there any known bug in rankmath? I have also third site and google can crawl that site without any Problem and of that site i am not using rankmath.

    Can you please advise me, what should i do? Even robots.txt option in plugin is locked. I could not edit it.

    Thanks in advance

    Kind regards
    Shafiq Rehman

Viewing 5 replies - 1 through 5 (of 5 total)
  • Reinelle

    2 years ago

    Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.

    Please share the sitemap URL of the affected websites so we can check and advise accordingly.

    Meanwhile, here’s a guide you can check to ensure that your site is already set to index:
    https://rankmath.com/kb/google-index/

    Regarding the robots.txt that is locked, please follow our guide here to fix it on your site:
    https://rankmath.com/kb/cant-edit-robots-txt/#num-1-presence-of-a-physical-file

    Hope that helps.

    Thank you.

    Anonymous

    2 years ago

    Rank Math free

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Reinelle

    2 years ago

    Hello,

    Thank you for your patience.

    We’ve checked the robots.txt of your websites, and it is working fine without any rule to block search engines from crawling.

    However, your robots.txt is returning a connection timed-out error when visiting it as a Googlebot. You can also verify it using this tool:
    https://technicalseo.com/tools/robots-txt/

    In this case, you may need to get in touch with your web host as they will be able to help you resolve this.

    Let us know how this goes.

    Anonymous

    2 years ago

    Rank Math free

    Hi Reinelle,

    Thank you very much for your assistance, You are right, it was webhost problem.

    kind regards
    Shafiq Rehman

    Ike

    2 years ago

    Hello,

    We’re delighted to hear that this issue has been resolved. We appreciate your feedback.

    This ticket will be closed now, but if you ever have another question or need any help in the future, please don’t hesitate to create a new forum topic. We’ll be more than happy to assist you again.

    Thank you for choosing Rank Math and have a wonderful day!

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘Robots.txt Problem’ is closed to new replies.