Urgent Help Needed – ‘X-Robots-Tag: noindex’ in Sitemap HTTP Header

#795157
  • Resolved Anonymous
    Rank Math free

    Dear Rank Math Support Team,

    I am writing to seek urgent assistance with an issue I am encountering with my sitemap as generated by the Rank Math SEO plugin. Despite all configurations being set to index my sitemap, it is being served with an ‘X-Robots-Tag: noindex’ HTTP header, which prevents search engines from indexing it.

    I have meticulously reviewed the settings in the Rank Math plugin, confirmed that the ‘Index’ option is selected under Global Meta, and there are no apparent settings that would apply a ‘noindex’ directive to my sitemap. Additionally, the robots.txt is correctly pointing to the sitemap without disallowing any important directories. My hosting provider has confirmed that there are no server-side configurations causing this issue.

    Here are the steps I have taken so far:

    Confirmed that my .htaccess file does not contain any ‘noindex’ directives.
    Checked the WordPress theme and plugin files to rule out any conflicts.
    Utilized the WordPress Site Health tool, which did not indicate any issues related to sitemap indexing.
    Temporarily deactivated all plugins and switched to a default WordPress theme to see if the issue persists (it does).

    I am attaching screenshots of my Rank Math sitemap settings, the robots.txt file, and the Site Health status for your reference. [Attach screenshots]

    Could you please help me identify what might be causing the sitemap to be served with a ‘noindex’ tag and how I might resolve this? This issue is affecting my website’s SEO, and I would greatly appreciate your prompt and detailed assistance.

    Thank you for your time and help.

    Best regards,
    wasi khuhro
    j*************@g********
    https://workoutinfo.fit/

Viewing 5 replies - 1 through 5 (of 5 total)
  • Hello,

    Thank you for reaching out to us with your concern about the ‘X-Robots-Tag: noindex’ issue in your Rank Math SEO plugin-generated sitemap. I understand the urgency of resolving this matter promptly to ensure your website’s SEO performance.

    Based on the information provided, it seems you have already taken several troubleshooting steps to address the problem. Since you have ruled out common causes like incorrect settings, conflicts, and server-side configurations, we may need to delve deeper into the issue to identify the root cause.

    Given the complexity of the matter, I recommend assigning this ticket to our human support team for further investigation. Please use the available buttons to assign the ticket to a human agent who will thoroughly analyze the screenshots you provided and assist you in resolving the ‘X-Robots-Tag: noindex’ matter affecting your sitemap.

    Thank you for your patience and cooperation as we work to resolve this issue promptly for you.

    Best regards.

    Sources:
    Rank Math Sitemap Issues and Their Fixes » Rank Math
    Why Google Hasn’t Indexed Your Post, Page, and/or Website? » Rank Math
    Why Isn’t My URL Included in the Sitemap? » Rank Math
    How to Fix Submitted URL Marked ‘NoIndex’ Error » Rank Math
    Can I NoIndex PDF Files Using an SEO Plugin? » Rank Math

    Anonymous
    Rank Math free

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hello,

    Thank you for contacting Rank Math support and bringing your inquiry to us.

    We understand your concern about the sitemap being set as ‘noindex’, but we assure you that this is how it should be.

    The reason is that we don’t want Google to index the sitemap itself, we only want them to index the pages and posts that are listed on the sitemap. The sitemap is just a way to tell Google what pages and posts you have on your website, not a page that you want to show up in search results.

    The important thing is that your pages and posts are set to ‘index’, which means that they are eligible to appear in Google search results.

    You can check this by looking at the Rank Math settings on each page or post, or by using the Google URL Inspection tool.

    To make sure that Google knows about your sitemap and can crawl your pages and posts, you need to submit your sitemap to Google Search Console.

    This is a simple process that you can follow by using our tutorial: https://rankmath.com/kb/submit-sitemap-to-google/

    Hope that helps, and please do not hesitate to let us know if you need our assistance with anything else.

    Anonymous
    Rank Math free

    When I submit the sitemap I get and error sitemap could not be read, this is the reason I contacted you that why Google can’t fetch.

    Hello,

    Your sitemaps are already validating fine upon checking. You can also validate them using this tool:
    https://www.xml-sitemaps.com/validate-xml-sitemap.html

    In this case, please follow these steps to flush your sitemap cache:

    1. Flush the Sitemap cache by following this video screencast:
    https://i.rankmath.com/pipRDp

    2. Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server. For plugins or Cloudflare, please follow this article:
    https://rankmath.com/kb/exclude-sitemaps-from-caching/

    3. Disable the transient cache for the sitemap by applying this filter. This will make sure that your XML sitemap always reflects the latest changes on your site:

    /** 
     * Filter if XML sitemap transient cache is enabled.
     *
     * @param boolean $unsigned Enable cache or not, defaults to true
     */
    add_filter( 'rank_math/sitemap/enable_caching', '__return_false');

    If you’re not sure how to add this code, you can follow this guide:
    https://rankmath.com/kb/wordpress-hooks-actions-filters/

    If the issue persists, then you may follow our guide here:
    https://rankmath.com/kb/couldnt-fetch-error-google-search-console/

    Looking forward to helping you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘Urgent Help Needed – ‘X-Robots-Tag: noindex’ in Sitemap HTTP Header’ is closed to new replies.