Start robots.txt file -----> User-agent: * Disallow: /images/ Disallow: /trea-only/ Disallow: /yf/ Disallow: /landscaping-directory/ Disallow: /book-images/ Disallow: /agent-image-upload/ Disallow: /agent-updated-banner-images/ Disallow: /rea/ User-agent: msnbot Crawl-delay: 10 User-agent: Googlebot Crawl-delay: 10 User-agent: Teoma Crawl-delay: 10 User-agent: Slurp Crawl-delay: 10 User-agent: aipbot Disallow: / User-agent: BecomeBot Disallow: / User-agent: psbot Disallow: / --------> End of robots.txt file