User-Agent: * Allow: / Disallow: /admin/ Disallow: /admin-v2/ Disallow: /api/ Disallow: /auth/