User-agent: *# list folders robots are not allowed to indexDisallow: /cgi-bin/Disallow: /family/# list specific files robots are not allowed to index#Disallow: /someFolder/some.html#Disallow: /something.html