Help! My site is not being crawled by Google

#612180
  • Resolved Anonymous
    Rank Math free

    My site is not being crawled by Google and I need help.

    In my WordPress and I go to Settings>>Reading, I have this UNCHECKED – search engine visibility discourage search engines from indexing the site.

    I also went into Google Search Console. I checked URLs – both my homepage (purelypetcare.com) and a few pages and I’m getting an error indicating that my URL is not on google It’s saying It looks like it could be caused by 2 reasons: 1) no sitemaps detected, and 2) ‘noindex’ detected in ‘robots meta’ tag.

    When I go to the Sitemaps section of GSC, it appears that the sitemap index was successfully submitted and when I go into my RankMath settings it shows that I have sitemaps on .

    With regards to the “noindex” robot meta, I’m seeing that on each Article that I try to publish, it’s showing that ‘noindex’ robots meta is enabled by default. Do I have to manually change this to “index” for each specific Article? What about for the home page (I only see this section for each Article Page)

    Can you please help me in figuring out what other configurations I need to set up so I can get my site to be index by google ASAP?

Viewing 5 replies - 1 through 5 (of 5 total)
  • Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.

    First, your website’s SSL certificate is returning an error at the moment. In this case, we recommend getting in touch with your web host to fix it.

    Also, your post sitemap is redirecting to your homepage only.

    Upon checking your site, it only contains 1 post with noindex enabled. I have set it to index and your post sitemap is already opening fine.

    Regarding the noindex meta enabled by default, I have set it to index in Rank Math > Titles & Meta > Pages / Post > Robots Meta to index so your new articles will be set to index by default.

    Your pages and posts are now set to index.

    Hope that helps.

    Thank you.

    Anonymous
    Rank Math free

    Hi there – I have some questions. It sounds like you listed 3 issues below. Sounds like 3 is resolved, and I still need to do 1, what about issue 2? What is my action step I need to take to fix 2? Or is 2 resolved because 3 is now resolved?

    1) website’s SSL certificate is returning an error at the moment. In this case, we recommend getting in touch with your web host to fix it.

    2) Also, your post sitemap is redirecting to your homepage only.

    3) Upon checking your site, it only contains 1 post with noindex enabled. I have set it to index and your post sitemap is already opening fine.

    Regarding the noindex meta enabled by default, I have set it to index in Rank Math > Titles & Meta > Pages / Post > Robots Meta to index so your new articles will be set to index by default.

    Your pages and posts are now set to index.

    Hope that helps.

    Anonymous
    Rank Math free

    here are some steps you can take to resolve the issue:

    Remove ‘noindex’ from Robots Meta Tag: The fact that the ‘noindex’ robots meta tag is enabled by default for each article is likely causing Google not to index your pages. You should ensure that this default setting is changed to “index” for each article you publish. Additionally, check if the same ‘noindex’ tag is applied to your homepage or any other important pages, and change it to “index” as well.

    Check Sitemap Submission: Although you mentioned that the sitemap index was successfully submitted in Google Search Console, it’s worth double-checking to ensure that all relevant pages are included in the sitemap. Sometimes, certain pages might be excluded accidentally. You can also submit the sitemap again in the Google Search Console to make sure it’s up to date.

    Inspect URLs in Google Search Console: Use the “Inspect URL” tool in Google Search Console to check if there are any issues with your website pages. It will provide insights into how Google sees your pages and whether there are any crawling or indexing errors.

    Check WordPress SEO Plugins: You mentioned using RankMath for SEO on your WordPress site. Verify that there are no settings in RankMath that could inadvertently block search engine indexing. Review the settings and make sure they are optimized for SEO and indexation.

    Review Robots.txt File: Ensure that your website’s robots.txt file is not blocking Googlebot from crawling your website. The robots.txt file might contain directives that restrict search engines from accessing certain areas of your site.

    Check for Manual Actions: Sometimes, Google may apply manual actions to a website if it violates Google’s guidelines. Check your Google Search Console for any notifications about manual actions and take appropriate action to resolve them.

    Create Quality Content: Ensure that your website has high-quality, valuable, and original content. Google is more likely to index and rank websites with valuable and relevant content.

    Build External Backlinks: Get links from other reputable websites to your site. Quality backlinks can help search engines discover and crawl your site more effectively.

    Be Patient: After making the necessary changes, give Google some time to recrawl your site and index the updated content. Indexing may not happen instantly, so be patient and monitor your progress over time.

    By following these steps, you should be able to resolve the issues preventing Google from indexing your site. If you encounter any specific errors or need further assistance, you can always refer to Google’s documentation or seek help from SEO experts. Good luck with getting your site indexed!

    Anonymous
    Rank Math free

    I need help with this:

    Check Sitemap Submission: Although you mentioned that the sitemap index was successfully submitted in Google Search Console, it’s worth double-checking to ensure that all relevant pages are included in the sitemap. Sometimes, certain pages might be excluded accidentally. You can also submit the sitemap again in the Google Search Console to make sure it’s up to date.

    Specifically, is this the only sitemap I need to submit? https://purelypetcare.com/sitemap_index.xml?

    I also see specific PAGE and POST sitemaps…do i need to submit these as well? SUCH as:

    https://purelypetcare.com/page-sitemap.xml

    I just want to make sure I understand what you mean when you say” it’s worth double-checking to ensure that all relevant pages are included in the sitemap. Sometimes, certain pages might be excluded accidentally.”

    Hello,

    Thank you for your patience.

    From your previous reply, all of them are already resolved as your website’s SSL seems working now. Also, your post sitemap is already working as you mentioned before because of step 3.

    Regarding your sitemap submission, you’ll need to submit your main sitemap only /sitemap_index.xml to your Google Search Console.

    Here’s our guide you can follow:
    https://rankmath.com/kb/submit-sitemap-to-google/

    Hope that helps.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘Help! My site is not being crawled by Google’ is closed to new replies.