Reading all results from an HTTP server

From: Martin (intersity_at_hotmail.com)
Date: 04/22/04


Date: Wed, 21 Apr 2004 23:55:04 +0100

Dear all,

I need to read data from an HTTP server that returns more than one pages of
results and retrieve all the data through Prolog. For instance, suppose I'm
looking for a short phrase on Google and need to have all the results
(documents it appears) read in a file. I'm using SWI-Prolog and made
experiments with the build-in http_open/3 predicate. It works fine but, what
I really need, is after this(?) predicate succeeds to get the data of *all*
pages and not of the first page only. Is it possible to do it and, if yes,
how? I would appreciate, if you can provide an example code to help me
start.

Thanks for your time!

-- Martin