Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Another incorrect assumption in the article is to assume that every bot with the Google UA is originating from Google. There are plenty of other (often malicious) bot sources that simply copy Google's signature to make themselves less obvious. He needs to check the IP block to make sure the bot with the observed behavior was really from Google.


I just took a look at the last offending Googlebot IP and it seems to originate from Google.

http://www.ip-adress.com/ip_tracer/66.249.71.203




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: