User-Agent: * Allow: / Disallow: /api/ User-Agent: Bytespider Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: DotBot Disallow: / Host: https://threat-watch.com Sitemap: https://threat-watch.com/sitemap.xml