-
I’m having problems with web crawler I believe, when you google my business the sub links that go to different pages on my site go to pages that aren’t up. I called google and they said I need to ask WordPress to enable web crawler and now WordPress says it’s a rank math problem.
-
Hello,
I’m sorry to hear about the issue you’re facing with your website’s sublinks not directing to the correct pages. It seems like there might be a misunderstanding regarding the web crawling process and indexing of your website.
To address this issue, it’s important to ensure that your website is properly crawled and indexed by search engines like Google. Since you mentioned that Google advised enabling web crawling, it’s essential to check if your website is accessible for crawling and indexing.
Here are a few steps you can take to resolve this issue:
-
Check Robots.txt File: Ensure that your website’s robots.txt file is not blocking search engine crawlers from accessing your site. You can use tools like the robots.txt testing tool to verify this.
-
Submit a Sitemap: Submitting a sitemap to Google can help search engines discover and index all the pages on your website efficiently. If you are using Rank Math, it automatically creates a sitemap index for your website.
-
Check for Duplicate Content: Duplicate content can confuse search engines and affect indexing. Ensure that your content is original and not duplicated across multiple pages.
-
Internal Linking Structure: Make sure your important pages have internal links from relevant pages on your website. This helps search engines understand the hierarchy and importance of your content.
If after checking these aspects, the issue persists, please provide more details or screenshots of the specific problem areas so we can assist you further. Feel free to reach out if you need additional help.
We’re here to support you!
Sources:
Why Did My Website Disappear From Google Search? » Rank Math
Discovered – Currently Not Indexed in Google Search Console » Rank Math
Why Google Hasn’t Indexed Your Post, Page, and/or Website? » Rank MathHello,
Thank you for contacting Rank Math support.
We have investigated this and we can see that your website is working correctly and is actually accessible to Google and other crawlers.
We can also see that a lot of your website pages are actually indexed by Google already. If there’s a specific page that should be indexed but isn’t please share the direct URL for that page and we’ll be happy to help take a look.
We are looking forward to hearing back from you.
The issue that I’m having is with the fourth link, Special Occassions – Nutrition Thyme RD, the text is correct but the link goes to a webpage that isn’t active, the /menu, it should be going to https://nutritionthymerd.com/special-occasions/
Also looking at this image the text under FAQ is from the old page of FAQ and I’ve updated.
Hello,
The /special-occasions page is actually already indexed so there’s nothing to worry about. On the next crawl when Google realize that the /menu page does not exist, it will delist it from its index.
Regarding your FAQ page, we can also see that the correct meta is showing on your page source, so when next Google crawls the page, it will update the information.
If you do not want to wait, you can use the Google URL Inspection Tool to request the crawling of both /menu and /faq, so the the index will be updated.
Thank you for your patience and cooperation
So I’ve tried updating the web index and I’ve waited for google to update. Now, the links that go to webpages that arn’t created still show up when I google Nutrition Thyme RD
Hello,
You can block the URL from Google Search (This is a quick fix) immediately. Here is how you can go about it. Go to your Google search console
https://search.google.com/search-console/
The URL must be in a Search Console property that you own (select the correct domain property)- Open the Removals tool.
https://search.google.com/search-console/removals?utm_medium=referral&utm_campaign=1663419 - Select the Temporary Removals tab.
- Click
NEW REQUEST
. - Select Temporarily remove URL
- Enter the URL
- Select Next to complete the process.
The request usually takes up to a day to process and is not guaranteed to be accepted. Check back to see the status of the request. If your request has been denied, click Learn more to learn why.
Please refer to this article to learn more about this temporary removal: https://support.google.com/webmasters/answer/9689846?hl=en#zippy=%2Cclear-cached-url%2Ctemporarily-remove-url
Hope this helps and please don’t hesitate to let us know if you have any other questions.
Thanks.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
-
The ticket ‘URLs that go to not created webpages’ is closed to new replies.