User-agent: CCBOT/1.0 (+HTTP://WWW.COMMONCRAWL.ORG/BOT.HTML) Disallow: /DADOS/ Disallow: /SCRIPTS/ Disallow: /DESIGN/ Disallow: /PLUGINS/ Disallow: /SCHEMAS/ Allow: /HTMLS/