Re: PHP CLI & Forking children

On Sep 29, 7:51 pm, Jerry Stuckle <jstuck...@xxxxxxxxxxxxx> wrote:
Just wondering - why do you need to fork processes, anyway? There's a
lot of overhead in doing it, and if they're all CPU bound anyway you
aren't going to gain anything (unless you have a potload of CPU's).

Forking is good if you have different processes using different
resources. But when they have to contend for the same resource,
performance often goes down.

Instead of writing a PHP script that downloads 2 million headers from
a newsgroup in a single connection (which will cause PHP to crash
anyway as it'll reach 500MB+ memory usage), I thought it would be
better to launch 4 processes do download it in chunks of 50,000
headers - with 4 connections to the same NNTP server.

.

Relevant Pages

  • Re: [X-NEWS] - missing headers in download
    ... headers, with incremental retrieval set at only 25000, then f5'ed till the ... start reading articles at number 23561770. ... think the block accounts dont count headers to your limit but not sure on ... geting his downloads you will see the same posting name over and over again ...
    (news.software.readers)
  • Re: Stopping long posts with Agent
    ... How and why do these posts get around my set 200-line limit? ... He said he downloads messages and headers all at the same ... marking read any that match the filters. ...
    (rec.outdoors.rv-travel)
  • Two Questions About OE 6.0 !!
    ... and downloads new message headers in the NEWS groups. ... When I compose an email, I like to use regular font, not ...
    (microsoft.public.windows.inetexplorer.ie6.outlookexpress)
  • Re: Outlook only downloads headers in email, not full message
    ... The junk filter doesn't work on spam until the full message is downloaded, so headers only makes more work. ... When I'm on the road I work on a cellular connection, my exchange acct downloads headers, then bodies. ... Diane Poremsky [MVP - Outlook] ...
    (microsoft.public.outlook)
  • Re: pan vs slrn differences?
    ... doesn't slrnpull have some facility that it ... probably pointed to by one of his sigs or/and headers. ... Bottom line is that you can not *prove* that he downloads bodies/ ... Many people have *claimed* that he is lying, but, ...
    (news.software.readers)