A note on unsupported rules in robots.txt

Tuesday, July 02, 2019<