User-agent: * Disallow: # Exclude the includes path (this is where parser templates are created and other pages that should not be crawled by searchbots User-agent: * Disallow: /en/inc/