User-agent: AhrefsBot Allow: / User-agent: rogerbot Allow: / User-agent: dotbot Allow: / User-agent: SemrushBot Disallow: /