Robots.txt

#576323
  • Resolved Anonymous
    Rank Math free

    Hi there.
    I’m using Rankmath on both

    https://powerquery.how/

    and https://gorilla.bi.

    The plugin supposedly created a robots.txt file. However, it’s not doing so on my sites. I’ve tried the steps laid out here:

    https://rankmath.com/kb/cant-edit-robots-txt/

    Meaning, I deleted the file from my root folder, also deleted the cache. After a little while, the file would appear again – but completely empty.

    I’ve also made sure (with the host) that the files are writable.

    Do you have any other suggestions to fix this?

    Regards,
    Rick de Groot

Viewing 9 replies - 1 through 9 (of 9 total)
  • Hello,

    Thanks for contacting us, and sorry for any inconvenience that might have been caused due to that.

    I can see the robots.txt file is available here for your site:
    https://gorilla.bi/robots.txt

    And for the other site, the robots.txt file can be found here:
    https://powerquery.how/?robots=1

    Please try clearing your site, plugin, or any server-level cache to see if the works for you.

    Looking forward to helping you.

    Thank you.

    Anonymous
    Rank Math free

    Hi there. You are correct, I managed to fix the one on gorilla.bi.

    And thanks for pointing me to the one from powerquery.how.

    Do you know why it created a version at:

    https://powerquery.how/?robots=1

    instead of

    https://powerquery.how/robots.txt

    Hello,

    It seems that the robots.txt not being generated as expected that’s why it’s working with /?robots=1. In this case, please do the following:

    Check your website FTP or file manager for a robots.txt file and delete it. Rank Math uses a virtual robot.txt which cannot be generated if you have a physical file.

    Next, please add the following rewrite rules to your .htaccess file:

    # START Apache Rewrites for Rank Math Robots.txt File
    RewriteRule ^/robots.txt$ /?robots=1 [L] 
    RewriteRule /([/]+?)-robots([0-9]+)?.txt$ /?robots=$1&robots_n=$2 [L]
    # END Apache Rewrites for Rank Math Robots.txt File

    You can get in touch with your web host for assistance modifying your .htaccess since it’s a sensitive file.

    Hope that helps.

    Thank you.

    Anonymous
    Rank Math free

    To troubleshoot this problem, you can try the following suggestions:
    1) Check file permissions: Ensure that the robots.txt file has the correct permissions set, allowing write access. You can verify this with your hosting provider or through a file manager in your hosting control panel.
    2) Clear plugin cache: Clear the cache of the Rankmath plugin. Sometimes, cached data can cause issues. Look for a “Clear Cache” option within the plugin settings and try clearing it.
    3) Deactivate other plugins: Temporarily deactivate other plugins on your websites, as conflicts between plugins can sometimes interfere with the proper functioning of Rankmath. Check if the robots.txt file is being created correctly after deactivating other plugins.
    4) Theme compatibility: Switch to a default WordPress theme temporarily to check if the issue is related to your current theme. Sometimes, certain themes can conflict with plugins and cause unexpected behavior.
    5) Contact plugin support: Reach out to the Rankmath support team directly for further assistance. They should be able to provide more specific guidance and help troubleshoot the issue with the robots.txt file not being generated correctly.
    By following these suggestions, you should be able to identify and resolve the issue with the robots.txt file not being created correctly on your websites.

    Nigel
    Rank Math business

    Hello,

    Thank you @rachel-casey for the contribution. The steps you suggested are a good way to go about solving the issue. Hopefully, one of those tips will lead to a solution.

    Thank you.

    Anonymous
    Rank Math free

    Hi,
    Nigel, you’re most welcome! I’m glad you found the suggested steps helpful. Hopefully, one of those tips will indeed lead to a solution for the issue you’re facing. If you have any more questions feel free to ask. I’m here to help!

    Hello,

    We appreciate you sharing those steps for fixing this issue.

    @BI Gorilla Let us know how that goes as well on your site.

    If you have any other concerns, please don’t hesitate to contact us anytime to assist you further.

    Looking forward to helping you.

    Thank you.

    Anonymous
    Rank Math free

    This topic is closed. I manually added a file on the right location so google can read it.

    Thanks 🙂

    Hello again,

    We are glad to hear that this issue has been resolved. Thank you for letting us know. This ticket will be closed now, but you can always open a new one if you have any other questions or concerns. We are here to help you with anything related to Rank Math.

    We appreciate your patience and cooperation throughout this process.

    Thank you for choosing Rank Math.

Viewing 9 replies - 1 through 9 (of 9 total)

The ticket ‘Robots.txt’ is closed to new replies.