Your server returned a 5xx (unreachable) error when we tried to retrieve your robots.txt file

My website is wordpress running on cyberpanel server using litespeedcache.

I submitted the sitemap to the google console and edited the robot file, opening the robot file on the browser is normal.

Robot.txt
User-agent: *
Disallow: /wp-admin/
Disallow: /readme.html
Disallow: /license.txt
Disallow: /?s=*
Allow: /wp-admin/admin-ajax.php
Allow: /wp-admin/images/*
Sitemap: https://abc.com/sitemap.xml
Sitemap: https://abc.com/news-sitemap.xml

But check: Your server returned a 5xx (unreachable) error when we tried to retrieve your robots.txt file.

Please help me fix this problem.

Thank you.
Sign In or Register to comment.
Support CyberPanel CyberPanel Discord

Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!