User-agent: * 
# directed to all robots

#############################################################
#
# How-to Robots.txt
#
#############################################################
# If you want to exclude all the search engine spiders from
# your entire domain, you would write just the following into
# the robots.txt file: 
# Disallow: / 
#
# If you want to do this for multiple directories, you add on
# more Disallow lines: 
# Disallow: /aboutme/ 
# Disallow: /stats/ 

# If you want to exclude certain files, then type in the rest
# of the path to the files you want to exclude: 
# Disallow: /aboutme/album.html 
# Disallow: /stats/refer.htm 

# If you want to keep a specific search engine spider from
# indexing your site, do this: 
# User-agent: Robot_Name 
# Disallow: /zine/spam1.htm 
# You'll need to know the name of the search engine spider or
# robot, and place it where Robot_Name is above. You can find
# these names from the web sites of the various search
# engines.