How to set a category to Disallow (Robot TXT) when URL is shortened.

#59777
  • Resolved Anonymous

    5 years ago

    Rank Math free

    Hey,

    I have chosen the option to shorten my post URL’s by removing the category breadcrumb. However, I now want to set a specific category to Disallow in the robot.txt… Will this work as the URL’s for posts in this category does not have /category/? Alternatively, what’s the difference between setting a no index for a category vs Disallow. Will a no index still negatively affect my SEO ranking if the content is duplicated (RSS feed with conical tag)? Does reverting the Posts URL’s to have category tags cause 301 errors?

    Any help is much appreciated.

Viewing 1 replies (of 1 total)
  • Alberto

    5 years ago

    Rank Math business

    Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    To disallow URLs (like posts inside a category) you should have the same URL for both or add two disallows, one per URL, like:

    Disallow: /category/my-category/*
Disallow: /mycategory/*

    You can use no-index or disallow as you prefer, they work equal. No, they won’t affect negatively your SEO since Google won’t index them.

    301 codes are not errors, they are just redirections and they let Google know what is the new URL to check (the one where you redirect) so they are safe to use if you apply the redirections after changing your posts’ URLs.

    Looking forward to helping you. Thank you.

    ​​​​​​​

    RankBot

    4 years, 11 months ago

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 1 replies (of 1 total)

The ticket ‘How to set a category to Disallow (Robot TXT) when URL is shortened.’ is closed to new replies.