-
Good day Support!
Please could you assist me in checking my website https://ridersstage.com? I am worried that it could be having robot.txt and indexing issues. Pls, help fix the issue. Thanks
My site login details are below. Big Thanks!
-
Hello, I think the issue is now resolved. The robots.txt shows on my mobile device but not showing on my laptop. I think I have to clear the cache on my laptop device.
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://ridersstage.com/sitemap_index.xmlHello,
Sure, let us know how this goes.
Meanwhile, please don’t hesitate to contact us anytime if you have other questions to assist you further.
Looking forward to helping you.
Thank you.
The robots.txt file is now showing on laptop. https:/ridersstage.com/robots.txt
Does it mean that it’s working well now or that the issues have been fixed.Hello,
Thank you for getting back to us.
Unfortunately, your robots.txt file is still not working properly on our end. Can you confirm if your host has added the rewrite rule that would tell your server how to handle requests for your robots.txt file?
The robots.txt file should look like this:
# START of Rank Math Robots.txt Rewrite Rules RewriteEngine On RewriteBase / RewriteRule ^robots.txt$ /index.php?robots=1 [L] # END of Rank Math Robots.txt Rewrite Rules
Once your hosting company has added this or a similar rule to your website’s .htaccess file, then you can clear your browser and site cache and try accessing your robots.txt file via a private (incognito) browser.
We hope this helps you resolve the issue and make your robots.txt file work properly. If you have any further questions or issues, please let us know and we’ll be glad to assist you.
Thank you for your cooperation and patience.
You are right Great! One of your the Rankmath Support staff (Reinelle) added some rewrite rules to my Hosting Cpanel and for sometime the page was displaying this:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://ridersstage.com/sitemap_index.xmlHowever, it is no longer showing anymore.
ARE YOU SAYING I SHOULD REPLACE THE REWRITE RULES WITH YOUR REWRITE RULES? ON .htaccess file?
I don’t know if you can assist me by adding it yourself. Pls, check the sensitive section for LOGIN DETAILS.
Hello,
Thank you for getting back to us.
The code I shared is the same as the one my colleague shared. We have tried adding it for you but for some reason it not working properly as it should, which is why we advise you to reach out to your hosting provider for help with this.
Please contact your hosting provider and explain the issue to them. You can also share the code with them and ask them to check if there is anything on your website or server that is preventing it from working properly. This ticket is also accessible to the public, so you can share the ticket with them so they can understand the issue properly.
I hope this helps you fix the issue. If you have any further questions or issues, please let me know and I’ll be glad to assist you.
Thank you for your cooperation and patience.
Please check to see if it’s now working. Thanks
Hello,
Thank you for getting back to us.
Sweet, your robots.txt is now working fine. We’re glad that you were able to resolve this issue and get your robots.txt working fine again.
Is there anything else that we can assist you with today? Or are you all set for now?
Thank you for choosing Rank Math and trusting us with your SEO needs.
All good Sir. Thanks for your support.
Hello,
We are super happy that this issue is already resolved. If you have any other questions in the future, know that we are here to help you.
If you don’t mind me asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.
If you do have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.
Thank you.
The ticket ‘Indexing And Robot.txt Issues’ is closed to new replies.