Re: Retrieving many RSS feeds fast?

On Mar 30, 8:29 pm, Duke of Hazard <squ...@xxxxxxxxxxxxxxxxxxx> wrote:
I have a simple scripts using magpie to retrieve upto 200 RSS feeds.
Unfortunately it takes forever as the script has to sequentially get
each feeds, wait for the response, then move on. Is it possible to
retrieve them all at once or do them in parrallel?

Multithreading is not built in PHP, but you can emulate it using two
scripts and requesting one script through the other one using the
Apache ( like fopen('http://localhost/path/to/file/
second_script.php') ) and giving it the RSS feed as a parameter and
then fgets-ing the output of the script. Sorry i don't have the time
to give you more details, i'll get back to this in about an hour.
.

Relevant Pages

  • Re: Why data could not be committed into table?
    ... I ran your repro script to recreate the tables and fill them ... select * from Feeds ... The data in markets and marketdef remained unchanged throughout the ... tables and execute the exact same update statement. ...
    (microsoft.public.sqlserver.programming)
  • FW: Google Reader "preview" and "lens" script improper feed validation
    ... Google Reader "preview" and "lens" script improper feed validation ... contents of only those feeds to which an authenticated user has subscribed ...
    (Vuln-Dev)
  • Unicode characters, XML/RSS
    ... So I wrote a little video podcast downloading script that checks a ... list of RSS feeds and downloads any new videos. ... it find a character that is out of the 128 range in the feed and my ...
    (comp.lang.python)
  • Re: xml parsing script dying with "Premature end of script headers" error
    ... feeds and return relevant results to a database. ... The script has worked well for a couple of years, despite having very crude error-trapping (if it finds an error in one of the xml files, the script stops). ... You should not parse your RSS data until you're finished collecting all the data. ...
    (comp.lang.php)
  • xml parsing script dying with "Premature end of script headers" error
    ... I have been using an xml parsing script to parse a number of rss feeds and return relevant results to a database. ... The script has worked well for a couple of years, despite having very crude error-trapping (if it finds an error in one of the xml files, the script stops). ...
    (comp.lang.php)