#User-agent: webcrawler #Disallow: User-agent: * Disallow: /all Disallow: /temp