User-Agent: * Disallow: /*?* User-agent: AhrefsBot User-agent: AhrefsSiteAudit User-agent: SEMrushBot User-agent: SemrushBot User-agent: SemrushBot-SA User-agent: MJ12bot Disallow: /