User-agent: * Allow: / Disallow: /api/ Disallow: /admin/ User-agent: MJ12bot Disallow: / User-agent: BLEXBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: LinkpadBot Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailCollector Disallow: /