Re: A question of speed



Robert Hicks wrote:
anno4...@xxxxxxxxxxxxxxxx wrote:
Robert Hicks <sigzero@xxxxxxxxx> wrote in comp.lang.perl.misc:
I have some co-workers that are writing an email parser (not sure of
the specifics) that is going to process around 5000 emails a day. I
suggested that they go a pure Perl route but they are leary about Perl
being "fast" enough to parse that many emails.

I have no definitive experience with something on this scale but I am
sure someone on the Perl group does.
5000 emails per day, that's 17 seconds per message. You can do a lot
of parsing in 17 seconds, even in Perl.

That is what I was thinking, even if it was an 8 hour business day that
is still 5 seconds per message. Granted I don't know if that is a
steady influx or a deluge.

I'm doing email filtering on a number of servers with roughly the same
amount of traffic, and even on old systems (P3-class) this runs
quite smoothly, even though there's a number of scripts and
external programs involved which pipe the mail content back and
forth. If your co-workers are still worried (maybe they expect
traffic to grow fast) they could build a threaded solution, which
would rid them of the most expensive part, which will be loading
of configuration items and the compilation and startup of the
script itself.

-Chris
.



Relevant Pages

  • Re: HTML parsing
    ... I hope you wont be offend by saying that I know nothing of Perl and I ... grabbed this script from www.keith-howlette.com - I was going to put a note ... >> all the auction links and emails the list to me. ... > You are suffering from preature declaration again. ...
    (comp.lang.perl.modules)
  • Re: redirect without meta
    ... >> program written in Perl. ... >> system interaction, emails, database communication etc. politely ... There was nothing wrong with your response; ... Gunnar Hjalmarsson ...
    (comp.lang.perl.misc)
  • Re: [PHP] PHP / Procmail / MIME decoder, Imagemagick, MySQL, PDF fax management system
    ... I have seen procmail and PERL, and some MIME handling scripts...but I ... I have a Fax to Email service that sends me emails with all my faxes. ... system) along with main message stored in MySQL, ...
    (php.general)
  • Re: A question of speed
    ... the specifics) that is going to process around 5000 emails a day. ... suggested that they go a pure Perl route but they are leary about Perl ...
    (comp.lang.perl.misc)
  • PHP / Procmail / MIME decoder, Imagemagick, MySQL, PDF fax management system
    ... I have seen procmail and PERL, and some MIME handling scripts...but I ... I have a Fax to Email service that sends me emails with all my faxes. ... system) along with main message stored in MySQL, ...
    (php.general)