wget connection reset by peer

Question

I try to access www.indeed.com from our web server by using wget but it raises "Connection reset by peer" error.

wget www.indeed.com

--2013-02-05 03:03:12--  (try: 3)  http://www.indeed.com/
Connecting to www.indeed.com|208.43.224.140|:80... connected.
HTTP request sent, awaiting response... Read error (Connection reset by peer) in headers.
Retrying.

It was working before cause I'm using their API for a while but now I'm not even reach their public website.

What could it be the problem? Could Indeed add to their blacklist the server's IP or is this related with my firewall etc.?

Is there a way to debug/trace where the problem is?

Solution

You should use with user-agent like following sample

wget "http://www.indeed.com/" --user-agent="Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6"