Hello,
Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.
Please note that it may take some time for Google and search engines to deindex old URLs if they are already showing on the search results pages.
In this case, since they are old URLs, you can utilize the page removal tool in your Google Search Console account to remove them

Here’s a link for more information:
https://support.google.com/webmasters/answer/9689846?hl=en
Hope that helps.
Thank you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.