# Robots.txt file from http://dthosit.com # All robots will spider the domain User-agent: * Allow: / Disallow: /wp-admin/ Sitemap:http://dthosit.com/sitemap.xml