Re: Trouble downloading pages
- From: Nicholas Sherlock <n_sherlock@xxxxxxxxxxx>
- Date: Mon, 30 May 2005 07:24:26 +1200
James Fox wrote:
I've been writing and testing a program in Delphi 6 that is intended to search through a huge fan-fiction archive (www.fanfiction.net), because the search function there is no good. I've been using the Synapse TCP/IP library to fetch pages before parsing the data.
Some servers block spiders which are doing the same thing you are doing (Basically indexing the whole site), since they chew through expensive bandwidth. This may be the problem.
Cheers, Nicholas Sherlock .
- Follow-Ups:
- Re: Trouble downloading pages
- From: James Fox
- Re: Trouble downloading pages
- References:
- Trouble downloading pages
- From: James Fox
- Trouble downloading pages
- Prev by Date: Re: checking arbitrary bounds
- Next by Date: Re: distance between lats and lons
- Previous by thread: Trouble downloading pages
- Next by thread: Re: Trouble downloading pages
- Index(es):