robots.txt errors in GPSI

#649721
  • Resolved Anonymous

    1 year, 11 months ago

    Rank Math free

    How do I fix these?

    robots.txt is not valid 3 errors found
    If your robots.txt file is malformed, crawlers may not be able to understand how you want your website to be crawled or indexed. Learn more about robots.txt.
    Line #
    Content
    Error
    1
    <!DOCTYPE html PUBLIC “-//W3C//DTD HTML 4.0 Transitional//EN” “http://www.w3.org/TR/REC-html40/loose.dtd”><html><body><p>User-agent: *
    Unknown directive
    2
    Disallow: /wp-admin/
    No user-agent specified
    3
    Allow: /wp-admin/admin-ajax.php
    No user-agent specified

Viewing 1 replies (of 1 total)
  • Reinelle

    1 year, 11 months ago

    Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for the delay and for any inconvenience this issue may have caused you.

    Could you please share the affected website URL so we can check?

    Meanwhile, you should update the robots.txt to add the user-agent and remove the HTML tag. Here are the default robots.txt that Rank Math creates on your site:
    https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/#default-rules

    Also, ensure that there’s no physical robots.txt file in your website root directory so Rank Math can handle /generate it on your site.

    Looking forward to helping you.

    Thank you.

    RankBot

    1 year, 10 months ago

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 1 replies (of 1 total)

The ticket ‘robots.txt errors in GPSI’ is closed to new replies.