Re: perl multithreading performance

On Wed, 27 Aug 2008 23:53:09 +0200 Martijn Lievaart <m@xxxxxxxxxxxxxxxx> wrote:

ML> On Wed, 27 Aug 2008 14:15:34 -0700, dniq00 wrote:
Nope, it doesn't :( I already have the single-threaded script, which has
been working for years now, but the amount of logs it needs to process
keeps growing, and I'm basically at the point where it can only keep up
with the speed with which logs are being written, so if there's back-log
for whatever reason - it might not catch up, so I'm looking into how I
can improve its performance.

ML> Perl threading, well frankly, sucks. You may want to switch to another
ML> language with re support that meets your needs. I would go for C++ (with
ML> boost), but then I know that language very well.

Hadoop is a nice non-Perl framework for this kind of work.

Ted
.

Relevant Pages

  • Re: Exchange 2007 Undeliverable messages not in English
    ... If a MAPI agent logs on to a user's mailbox, ... the language used by the agent is different than the language used by ...
    (microsoft.public.exchange.admin)
  • Re: History of French
    ... Peter T. Daniels writes: ... > language (unless said infant is very, very, very severely mentally ... I didn't know that you had access to logs. ...
    (sci.lang)
  • Re: What is up with the attitude to priest
    ... They keep logs. ... While you can report him and they will "Check into it.", ... and anyone who turns those filters off can't complain. ... If you told people they couldn't use profane language ...
    (alt.games.warcraft)
  • How does AS 4.0 handle languages?
    ... If somebody changes the default language on a 4.0 system from English to ... another language during the install does this change the language in the ... logs such as the messages file? ...
    (linux.redhat.misc)
  • Re: NTDS directory
    ... The reference below to ntbackup not truncating ... logs is the one you want to pursue. ... Active Directory Development ... >>>with EDBxxxx.log files, and it is growing and growing and growing, in ...
    (microsoft.public.win2000.active_directory)