Re: Web Scraping Login Required


Mike Labedz wrote:
I'm trying to scrape my play list off of Yahoo Music and store it.

I've read http://wiki.tcl.tk/2915 and understand the retrieval/parsing
side of a web page. What I'm missing is whether this is possible for
a site that requires a login? If so does anyone have any examples or
recommended packages to look at.

Thank you in advance
Usually this uses http authentication. http://wiki.tcl.tk/6087 is
relevant here, but you might need some cookie support too and if the
site uses vast amounts of javascript to handle login (ajax style) you
might be left with a mess like scripting IE or firefox to do the
download.

Michael

.

Relevant Pages

  • Re: severe login problem
    ... you won't know what you're missing. ... Cancelling the login, won't let you on the network. ... > I still have BO SBS 4.0 and Win98se clients. ... > logon with this userid & password just fine on any other ...
    (microsoft.public.backoffice.smallbiz)
  • WinXP Pro Login Issues
    ... Last night I updated windows media player. ... message about a missing "login ui" file and a missing .dll. ... the exact "login ui" name and I dont remember the missing dll name. ...
    (microsoft.public.windowsxp.general)
  • Re: Active Directory for Ubuntu 7.10
    ... and the only task that is missing is authenticating against Active ... avoid the situation to login in as a local user then log in with the AD ...
    (Ubuntu)
  • Active Directory for Ubuntu 7.10
    ... I have been testing Ubuntu on my laptop for the past couple of months ... and the only task that is missing is authenticating against Active ... avoid the situation to login in as a local user then log in with the AD ...
    (Ubuntu)
  • Re: Logon Problem
    ... That may allow you to login, but that doesn't solve your problem ... missing or corrupted and needs to be replaced. ... If you don't know the name of your account, go into Safe Mode (if ...
    (microsoft.public.windowsxp.basics)