User-agent: * Disallow: *.xml Disallow: *.php Disallow: *.html Disallow: /dir/