User-agent: * Disallow: Disallow: /login/ Disallow: /web/ Disallow: /index/ Disallow: /app/ Disallow: /faq/