I decided to put domain names of web crawlers that don't comply with the restrictions I put in my robots.txt file: * looksmart.com * search.msn.com