# All robots will spider the domain User-agent:* Disallow: # Disallow directories Disallow:/cgi-bin/ Disallow:/images/ Disallow:/devel/ Disallow:/postcards/images/