Robots.txt filed maleformed

Hello,

I’m sorry to hear that you’re facing issues with your robots.txt file being malformed. When PageSpeed Insights reports that your site’s robots.txt file is malformed, it usually means that there might be an error in the structure or content of the robots.txt file that could prevent search engines from properly crawling your site.

To address this issue, you can follow these steps:

1. Check Your Robots.txt File: Ensure that your robots.txt file is correctly formatted and does not contain any errors. You can access your robots.txt file by visiting https://yourdomain.com/robots.txt.

2. Use the Robots Testing Tool: You can use tools like the Robots Testing Tool to check your robots.txt file for any issues. Make sure to test it with the “All (robots.txt)” option selected as the User Agent.

3. Clear Website Cache: If you have updated your robots.txt file recently, clear your website cache to ensure that you are viewing the latest version of the file.

4. Contact Support: If you are still facing issues after checking and updating your robots.txt file, feel free to reach out to our dedicated support team here for further assistance.

I hope this helps you resolve the robots.txt file issue on your site. Thank you for bringing this to our attention.

If you need any further assistance, please let us know.

Sources:
Common robots.txt Issues & How to Fix Them » Rank Math
Analyzing Your Site’s SEO with Rank Math’s SEO Analysis Tool

Hello,

This can happen when you use a content delivery network (CDN) like Cloudflare. Rank Math does not create a physical robots.txt file on your site. Instead, the file is created and displayed when a user visits your robots.txt URL. So you can safely ignore this error if your robots.txt file is available.

Here’s a link for more information:
https://rankmath.com/kb/fix-common-robots-txt-issues/#robots-txt-is-not-valid-in-pagespeed-insights

Looking forward to helping you.