Posted on Leave a comment

User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: PetalBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: dotbot Disallow: / User-agent: SemrushBot Disallow: / User-agent: coccocbot-web Disallow: / User-agent: Yandex Disallow: / User-agent: Mail.RU_Bot Disallow: / User-agent: spider Disallow: / User-agent: Quantcastbot Disallow: / User-agent: PaperLiBot Disallow: /

Source

Leave a Reply

Your email address will not be published.