# All robots will spider the domain User-agent: * Disallow: # Disallow directory /backup/ User-agent: * Disallow: /backup/ # Disallow directory /data/ User-agent: * Disallow: /data/ # Disallow directory /images/ User-agent: * Disallow: /images/ # Disallow directory /wa/ User-agent: * Disallow: /wa/ # Disallow directory /webstat/ User-agent: * Disallow: /webstat/ # Disallow directory /214.html User-agent: * Disallow: /214.html