Does Anyone know anything about a spider bot called "yacybot":<br><br><a href="http://www.yacy.net">http://www.yacy.net</a><br><br>It's a German host where you download the code from. <br><br>They claim to be affiliated with the Karlsrueh Institute of Technology. <br>
They're really killing our database performace. <br><br>The IP address used in the request is invalid. Since this is the case, this may be a denial-of-service attack. I was unable to access the system for over a minute a few hours ago. The database has been timing out because of the level of activity.<br>
<br>One indicator of how intrusive they are is that when I search for them, I'm coming up with logfile entries for hosts all over the net that this bot is also hitting. <br><br>This caims to be a peer-to-peer search engine.<br>
<br>They're now in the 'deny 'list in robots.txt. They do appear to read the file when they start. If I see them continuing to hit us, we'll take the next step and treat any system running this bot as a spammer.<br>
<br>Before we take further measure to throttle them, I just want to know if anyone has experience with them.<br><br>Thanks.<br><br>Bill<br><br>