Re: Trouble downloading pages



James Fox wrote:
I've been writing and testing a program in Delphi 6 that is intended to
search through a huge fan-fiction archive (www.fanfiction.net), because
the search function there is no good. I've been using the Synapse TCP/IP
library to fetch pages before parsing the data.

Some servers block spiders which are doing the same thing you are doing (Basically indexing the whole site), since they chew through expensive bandwidth. This may be the problem.


Cheers,
Nicholas Sherlock
.