Re: Any python scripts to do parallel downloading?

Michele Simionato wrote:
On Jan 31, 5:23 pm, "Frank Potter" <could....@xxxxxxxxx> wrote:
I want to find a multithreaded downloading lib in python,
can someone recommend one for me, please?
Thanks~

Why do you want to use threads for that? Twisted is the
obvious solution for your problem,

Overkill? Just to download a few web pages? You've got to be
kidding.

but you may use any
asynchronous framework, as for instance the good ol
Tkinter:

Well, of all the things you can use threads for, this is probably the
simplest, so I don't see any reason to prefer asynchronous method
unless you're used to it. One Queue for dispatching should be enough
to synchronize everything; maybe a Queue or simple lock at end as well
depending on the need.

The OP might not even care whether it's threaded or asynchronous.


Carl Banks

.

Relevant Pages

  • Re: how do you implement a reactor without a select?
    ... Michele Simionato wrote: ... advice is well appreciated. ... Queue (so that other threads, by putting an event on the Queue in ... question, immediately wake up the scheduler, etc, etc). ...
    (comp.lang.python)
  • Re: Help - Our SMTP queue is being flooded
    ... The utility you recommend is correct. ... >> can enable Exchange to only accept mail for valid AD recipients. ... >> danger here of course is that you open yourself to a potential directory ... >>> prevent someone from trying and filling up the queue). ...
    (microsoft.public.exchange.admin)
  • Re: Terminating the London - Birmingham HSL (was London-Birmingham rail link...)
    ... but a delay at a single security check queue ... before with online checkin when travelling by car/taxi. ... the check-in for flights to London City Airport closes 40 minutes ... recommend two to two and half hours. ...
    (uk.railway)
  • Re: lisper learning python, ... could you please comment my first python program?
    ... to extend my skills, I am learning python. ... Could some fellow experienced pythonista give me some ... BTW, since you are familiar with Lisp, I would recommend you ... Michele Simionato ...
    (comp.lang.python)
  • Re: Ryanair refund
    ... is get yourself to the departure gate with your carry-on wheelie case ... they close the aircraft doors. ... They recommend 30 minutes before, ... The biggest hold-up can often be the queue at the security checkpoint, ...
    (uk.legal)