# WWW Robots (also called wanderers or spiders) are programs that traverse # many pages in the World Wide Web by recursively retrieving linked pages. # This file prevents them from accessing your data. User-agent: * Disallow: /bt/ Disallow: /cs/ Disallow: /hd/ Disallow: /log/ Disallow: /images/ Disallow: /Backup of hd - 2005-12-08/ Disallow: /Backup of hd - 2005-12-09/ Disallow: /Backup of hd - 2006-04-11/