Pages not being indexed for the past 6 months

#607006
  • Resolved Anonymous
    Rank Math free

    Worldwide-news.org is the website in question, I have instant indexing enabled and even if I try to index manually using Google search console, none of my latest posts for the last 6 months have been indexed. And fyi, my sitemaps are all successful and being fetched.

Viewing 15 replies - 1 through 15 (of 15 total)
  • Hello,

    Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.

    Can you please share some affected post URLs with us so that we can check the issue further for you?

    Meanwhile, you can check your Google Search Console coverage section to determine any issues reported on your site: https://support.artlogic.net/hc/en-gb/articles/360016851260-Google-Search-Console-errors-and-coverage-issues

    You can share the error message or take a screenshot using this tool and add the link here so we can check as well.

    Looking forward to helping you.

    Thank you.

    Anonymous
    Rank Math free

    Hello,

    We’ve checked the page you’ve shared but didn’t find any issue which will prevent this from being indexed on Google.

    In this case, please test this page in the URL Inspection Tool to see if you find any errors there.
    https://support.google.com/webmasters/answer/9012289?hl=en

    If you see any error there please share it with us so that we can check the issue further for you.

    Let us know how it goes. Looking forward to helping you.

    Thank you.

    Anonymous
    Rank Math free

    These are the errors I have been getting with Instant Indexing for the past few months including Google Search Console. https://imgur.com/a/YzZKbKQ

    Hello,

    The error 429 means that the IP address exceeded the daily quota of requests and you should slow down a little bit and retry later. However, the 429 error doesn’t mean that Google will not index the URL.

    As for the report you shared in the URL Inspection tool, it seems that Google is not showing any reason why the post is not indexed. Please note that it is completely upto Google if they want to index or not index your website. So, if you haven’t willingly or accidentally made your posts noindex and Google still isn’t indexing your page – it means that either Google doesn’t want to index or hasn’t crawled your page yet because it hasn’t allocated that much crawl budget to your website.

    Please check this website for more details.

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

    Anonymous
    Rank Math free

    Thank you for the assistance, I appreicate it dearly, however; I haven’t made any updates on my site for the past few months but I’m still getting the 429 error. Which is strange. And; on Google Search Console it states: “No referring sitemaps detected.” Is there a fix for this? I have also requested indexing using Google Search Console and Instant Indexing yet my posts from the last few weeks haven’t been indexed.

    Hello,

    Thank you for sharing the errors you have been getting with Instant Indexing and Google Search Console. I’m sorry for the inconvenience this has caused you. Let me try to explain what’s going on and how you can fix it.

    As we explained before, the 429 error means that the IndexNow API has received too many requests from your IP address to index your pages. This can happen if you have the auto-submit option enabled in Rank Math and you update your pages frequently. When you do that, Rank Math will automatically send a request to the IndexNow API every time you save a change on your page. The IndexNow API has a limit on how many requests it can handle from one IP address per day, so if you exceed that limit, you will get the 429 error.

    That said, this error does not mean that search engines will not index your pages at all. It just means that you cannot send requests to the IndexNow API for the remainder of the day, i.e. you’ll have to wait until the next day to send more requests. However, if you want to avoid this error in the future, you have two options:

    • You can change your API key in Rank Math. This should typically resolve the issue, if it does not, it might mean that another website on your server (that you share an IP with) has been sending a lot of URLs to the IndexNow API. This is especially true if you use a shared hosting server.
    • You can disable the auto-submit option in Rank Math. This will stop Rank Math from sending requests to the IndexNow API every time you update your pages/pages, or create new ones. You can still manually request indexing from Rank Math > Instant Indexing > Submit URLs or Rank Math > Instant Indexing > Console (if you have the Google Indexing API plugin installed).

    Either of the options should resolve the 429 error issue for you. You can learn more about these options here: https://rankmath.com/kb/how-to-fix-429-error-with-indexnow-api/

    Please note: the IndexNow API is different from the Google Indexing API. The IndexNow API submits your posts to Bing and Yandex and comes prepacked with the Rank Math plugin, you just have to enable it from Rank Math > Dashboard > Modules > Instant Indexing but to use the Google Indexing API you have download an additional addon plugin.


    Now, regarding the issue of your page not getting indexed by Google, I checked the screenshot you shared and I noticed that Google says “URL is unknown to Google”. This means that Google is unaware of your page, to investigate this, you can check your sitemap status in Google Search Console under Sitemaps. If you see any errors or warnings there, please fix them and resubmit your sitemap. If you don’t see any issues there, please share a screenshot of your sitemap page with us so we can check it further. It also looks like the example post you shared was published a few days ago, depending on your Google crawl budget, Google might have not crawled your site yet which could explain why Google is reporting the URL as “Unknown to Google”.

    Something else you can do is to use the URL Inspection Tool in Google Search Console to request indexing for your page manually. Just enter your page URL in the tool and click on Request Indexing. This will tell Google to crawl and index your page as soon as possible. If there are any problems with your page that prevent it from being indexed, Google will show them to you in the tool.

    I hope this helps you understand what’s happening with your site and how you can improve it. Please let us know if you have any questions or concerns. We’re always here to assist you.

    Thank you for choosing Rank Math. Have a great day! 😊

    Anonymous
    Rank Math free

    Thank you for the reply! My pages previously were indexed on Google within the first 10 minutes of my post being published. However; many of my latest posts haven’t been indexed and aren’t showing up on Google search. Even posts published a few months ago aren’t being indexed by Google. My sitemaps’ status shows up as success, and even when I have manually requested for my pages to be indexed via Google Search Console, my posts fail to be indexed. My site is crawled by Google thus some of my posts show up on Google search but these are posts from January to March. I haven’t updated my site since around mid March and started updating my site again beginning of July, yet my posts aren’t being indexed.
    Site map screenshot: https://imgur.com/a/QUaI27x

    Hello,

    Please check your GSC coverage section for issues there that might determine why your posts are not indexed on Google.

    Looking forward to helping you with this one.

    Anonymous
    Rank Math free

    This is what shows up on GSC coverage: https://imgur.com/a/P8f7JUN
    It has been like this for a while, none of my latest posts are being indexed even if I manually select them to be indexed via GSC.

    Hello,

    Thank you for sharing that screenshot. It’s helped quite a lot.

    Crawled – currently not indexed means Google has crawled your page but has not indexed it yet. As we already know, Google does not index all the URLs we submit, and finding a certain number of URLs under this status is completely normal. And to make it clear, this isn’t an error but more of a reason why Google has excluded the page(s) from its index.

    A more detailed explanation and a few troubleshooting tips can be found here:
    https://rankmath.com/kb/crawled-currently-not-indexed/

    Hopefully, that helps and let us know if you’ve got further questions.

    Anonymous
    Rank Math free

    Thank you for the help! I’ll look into it!

    Anonymous
    Rank Math free

    I also faced difficuly in indexing while i working on this site, its all due to “discourage search engines to crawl” om wordpress CMS.

    Hi @mohammadshayan1,

    You’re welcome. If you need help with anything – please do not hesitate to reach out again.

    Cheers!

    Hello @naininetwork,

    Thank you for contacting Rank Math support and we apologize for the inconvenience.

    Can you please share more details about the issue you’re facing, also please share the URL where you’re having this problem.

    Thank you for choosing Rank Math!

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 15 replies - 1 through 15 (of 15 total)

The ticket ‘Pages not being indexed for the past 6 months’ is closed to new replies.