Re: loading a url using urllib2



On Mar 31, 7:21 am, "ying...@xxxxxxxxx" <ying...@xxxxxxxxx> wrote:
I have the following code to load a url (address).

When I have a url like this,

http://www.testcom.co.uk/dev_12345/www.cnn.com

i get an error "Failed to openhttp://www.testcom.co.uk/dev_12345/www.cnn.com";.
Is there something wrong with my URL? or something wrong with my code?


With the URL.
See http://www.dnsstuff.com/tools/dnsreport.ch?domain=www.testcom.co.uk

Thank you for any help.

cj = cookielib.LWPCookieJar()

opener = urllib2.build_opener(urllib2.HTTPCookieProcessor(cj))
urllib2.install_opener(opener)

txheaders = {'User-agent': 'Mozilla/4.0 (compatible; MSIE 5.5;
Windows NT)'}
try:
print "address", address
print "txdata", txdata
print "txheaders", txheaders
req = Request(address, txdata, txheaders)
handle = urlopen(req)

I suppose you've added the appropriate imports for Request and
urlopen.

except IOError, e:
print address
print 'Failed to open %s' % address
data = ""

--
Kushal

.



Relevant Pages

  • loading a url using urllib2
    ... I have the following code to load a url. ... print "txdata", txdata ... print "txheaders", txheaders ... except IOError, e: ...
    (comp.lang.python)
  • Re: ClientCookie
    ... fuzzyman@gmail.com (Michael Foord) writes: ... > req = ClientCookie.Request(theurl, txdata, txheaders) ...
    (comp.lang.python)