# All robots will spider the domain User-agent: * Disallow: Disallow: /cgi-bin/ Disallow: /images/ Disallow: /album/ Disallow: /tree/ User-agent: searchpreview Disallow: / User-agent: Googlebot-Image Disallow: /