user-agent: AhrefsBot User-Agent: Baiduspider User-Agent: Aport User-Agent: ia_archiver User-agent: ia_archiver-web.archive.org User-agent: DomainCrawler User-Agent: Lycos User-Agent: MJ12bot User-Agent: grapeshot User-Agent: proximic User-Agent: Scooter User-agent: Amazonbot User-Agent: Slurp User-Agent: WebAlta User-agent: weborama-fetcher User-agent: SemrushBot User-agent: SemrushBot-SA Disallow: / User-agent: Mediapartners-Google Disallow: /js/ User-Agent: * Disallow: /js/ Disallow: /search/inn/?val= Disallow: /search/*&page= Disallow: /arbitrage/*/page Disallow: /contract/*/page Host: www.find-man.com