# Banish as many bandwidth-suckers as we can. # Some of these bots are rude enough to ignore robots.txt # but we list them here anyway. # First some controls over 'friendlier' bots User-Agent: * Disallow: Disallow: /.cache Disallow: /wp-admin Disallow: /wp-includes # Google supports the non-RFC 'Noindex:' directive. # Google ignores global directives, so list any explicit exclusions # again under the Googlebot section. # User-agent: Googlebot Disallow: /.cache Disallow: /wp-admin Disallow: /wp-includes # Now for the list of outright bans user-agent: Vegi bot (we follow your robots.txt settings before crawling, you can slow down the bot by change the Crawl-Delay parameter in the settings.if you have an enquiry, please email to: abuse-report@terrykyleseoagency.com) Disallow: /