Indexing And Robot.txt Issues

#596745
  • Resolved Anonymous
    Rank Math free

    Good day Support!

    Please could you assist me in checking my website https://ridersstage.com? I am worried that it could be having robot.txt and indexing issues. Pls, help fix the issue. Thanks

    My site login details are below. Big Thanks!

Viewing 10 replies - 16 through 25 (of 25 total)
  • Anonymous
    Rank Math free

    Hello, I think the issue is now resolved. The robots.txt shows on my mobile device but not showing on my laptop. I think I have to clear the cache on my laptop device.

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Sitemap: https://ridersstage.com/sitemap_index.xml

    Hello,

    Sure, let us know how this goes.

    Meanwhile, please don’t hesitate to contact us anytime if you have other questions to assist you further.

    Looking forward to helping you.

    Thank you.

    Anonymous
    Rank Math free

    The robots.txt file is now showing on laptop. https:/ridersstage.com/robots.txt
    Does it mean that it’s working well now or that the issues have been fixed.

    Hello,

    Thank you for getting back to us.

    Unfortunately, your robots.txt file is still not working properly on our end. Can you confirm if your host has added the rewrite rule that would tell your server how to handle requests for your robots.txt file?

    The robots.txt file should look like this:

    # START of Rank Math Robots.txt Rewrite Rules
    RewriteEngine On
    RewriteBase /
    RewriteRule ^robots.txt$ /index.php?robots=1 [L]
    # END of Rank Math Robots.txt Rewrite Rules

    Once your hosting company has added this or a similar rule to your website’s .htaccess file, then you can clear your browser and site cache and try accessing your robots.txt file via a private (incognito) browser.

    We hope this helps you resolve the issue and make your robots.txt file work properly. If you have any further questions or issues, please let us know and we’ll be glad to assist you.

    Thank you for your cooperation and patience.

    Anonymous
    Rank Math free

    You are right Great! One of your the Rankmath Support staff (Reinelle) added some rewrite rules to my Hosting Cpanel and for sometime the page was displaying this:

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Sitemap: https://ridersstage.com/sitemap_index.xml

    However, it is no longer showing anymore.

    ARE YOU SAYING I SHOULD REPLACE THE REWRITE RULES WITH YOUR REWRITE RULES? ON .htaccess file?

    I don’t know if you can assist me by adding it yourself. Pls, check the sensitive section for LOGIN DETAILS.

    Hello,

    Thank you for getting back to us.

    The code I shared is the same as the one my colleague shared. We have tried adding it for you but for some reason it not working properly as it should, which is why we advise you to reach out to your hosting provider for help with this.

    Please contact your hosting provider and explain the issue to them. You can also share the code with them and ask them to check if there is anything on your website or server that is preventing it from working properly. This ticket is also accessible to the public, so you can share the ticket with them so they can understand the issue properly.

    I hope this helps you fix the issue. If you have any further questions or issues, please let me know and I’ll be glad to assist you.

    Thank you for your cooperation and patience.

    Anonymous
    Rank Math free

    Please check to see if it’s now working. Thanks

    Hello,

    Thank you for getting back to us.

    Sweet, your robots.txt is now working fine. We’re glad that you were able to resolve this issue and get your robots.txt working fine again.

    Is there anything else that we can assist you with today? Or are you all set for now?

    Thank you for choosing Rank Math and trusting us with your SEO needs.

    Anonymous
    Rank Math free

    All good Sir. Thanks for your support.

    Hello,
    
    We are super happy that this issue is already resolved. If you have any other questions in the future, know that we are here to help you.
    
    If you don’t mind me asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.
    
    If you do have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.
    
    Thank you.

Viewing 10 replies - 16 through 25 (of 25 total)

The ticket ‘Indexing And Robot.txt Issues’ is closed to new replies.