Indexing Problem: URL is not available to Google, Failed: Robots.txt unreachable

#757837
  • Resolved Anonymous

    1 year, 6 months ago

    Rank Math free

    My URL is showing that it is indexed on Google, but it’s not showing on Google, and while Live Testing the URL, it is showing this error: “Failed: Robots.txt unreachable”. This is also happening with the homepage of my URL. So now I am unable to submit my URLs and the sitemap is also not getting fetched. So, please tell me what to do and how to solve this as I have created both sitemap and robots.txt from Rankmath and my hosting provider Hostinger support also said that the problem is with Rankmath, so please help me and provide me a solution as I am very frustrated.
    You can also check this for yourself here with Google:
    { https://search.google.com/test/rich-results }

Viewing 2 replies - 1 through 2 (of 2 total)
  • RankBot

    1 year, 6 months ago

    Hello,

    I apologize for the issue you are facing with your URL not being available to Google and showing a “Failed: Robots.txt unreachable” error during Live Testing. This can indeed be frustrating, but we are here to help you resolve it.

    Based on the error message you provided, it seems like there might be an issue with the robots.txt file on your website that is preventing Google from accessing your URLs. To troubleshoot and fix this issue, please follow these steps:

    1. Check Robots.txt File:

      • Verify if there are any blocking directives in your robots.txt file that might be causing the issue. You can refer to our guide on how to edit robots.txt with Rank Math for assistance.

    2. Use Robots Testing Tool:

      • You can use the Robots Testing Tool to check if Google is blocked from crawling your specific URL. Simply paste your URL in the tool and click TEST. If Google is blocked, the tool will highlight the blocking rule. You can access the tool here.

    3. Contact Rank Math Support:

      • If you are unable to resolve the issue following the above steps, please assign this ticket to our human support team by clicking on the available buttons. They will further investigate and assist you in resolving the problem.

    By following these steps, you should be able to identify and fix the issue with your robots.txt file, allowing Google to access your URLs and sitemap correctly.

    Thank you for bringing this matter to our attention, and we appreciate your patience as we work towards a solution.

    If you have any more questions or need further assistance, feel free to let us know.

    Sources:
    No Information is Available for This Page » Rank Math
    Common robots.txt Issues & How to Fix Them » Rank Math
    How to Fix ‘Blocked by robots.txt’ Error in Google Search Console » Rank Math
    Why Did My Website Disappear From Google Search? » Rank Math
    How to Fix Submitted URL Marked ‘NoIndex’ Error » Rank Math

    Rakibuzzaman Siam

    1 year, 6 months ago

    Hello,

    Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.

    We checked your website and we can see you’re currently using the Yoast SEO plugin on your site. Could you please try to install the Rank Math plugin again so that we can check the issue further for you?

    Looking forward to helping you.

    Thank you.

    RankBot

    1 year, 5 months ago

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 2 replies - 1 through 2 (of 2 total)

The ticket ‘Indexing Problem: URL is not available to Google, Failed: Robots.txt unreachable’ is closed to new replies.