# All agents User-agent: * # Live on CMS so block specific folders Disallow: /admin/ Disallow: /contrib/ Disallow: /doc/ Disallow: /lib/ Disallow: /modules/ Disallow: /plugins/ Disallow: /scripts/ Disallow: /tmp/