Re: URL Programming

From: Josh Sebastian (curien_at_cox.net)
Date: 11/05/03

  • Next message: Rotes Sapiens: "Re: MOST USEFUL Computer Language"
    Date: Tue, 04 Nov 2003 19:24:49 -0500
    
    

    On Tue, 04 Nov 2003 11:54:40 -0800, Pradnya Rodge wrote:

    > Hello All,
    > I need to write a program which interacts with a search site. It can
    > be divided into two parts.
    > Part1: I am given a list of words (in a text file) that I need to
    > search in a search site. I need to extract a word from the text file,
    > modify the URL according to the word and then insert it in a browser
    > and search.
    > Part2: When the search is done I direct the output to a text file.
    > I dont have any web programming experience so if anybody can help me
    > with this it would be of great help.
    > Thank You

    Forget the "insert it in a browser" bit. All a browser is is a program
    that sends HTTP requests, gets responses, and displays the response
    prettily. You can do the same thing: submit an HTTP request, get the
    response, and then format and display the "interesting" data in the
    response.

    Most search engines utilize the querystring from a GET request to receive
    the search criteria. Experiment with the search engine you want to use (or
    read the doc, if available), and figure out how to construct the
    querystring yourself.

    Figure out the format of the response from the search engine, and devise
    an algorithm to extract the interesting data from that response.

    This isn't "web programming", btw.

    Josh


  • Next message: Rotes Sapiens: "Re: MOST USEFUL Computer Language"

    Relevant Pages

    • Re: PR: Bass Burglar Alarms.com - Abbreviated Product List [long post]
      ... If the purpose of the two 3+ meg files he uploaded to the server was in fact for "better search engine positioning", then why doesn't he post the same messages in this Newsgroup? ... Your "objection" to my response is noted. ...
      (comp.home.automation)
    • Re: Looking for PHP behaviour similar to a servlet
      ... His response was an apoplectic fit 'you are paid to solve problems. ... That's a political solution, not an engineering one. ... He has bought a server system and a search engine that are mutually and irrevocably incompatible. ...
      (comp.lang.php)
    • Re: Mobile Application goes offline
      ... in one another problem the namespace of the webservice was troubling. ... We are running into some strange scenarios related to HTTP Web Requests ... This is because the response to the HTTP ... the application cannot make any HTTP Requests to the ...
      (microsoft.public.dotnet.framework.compactframework)
    • Re: tcpdump
      ... This approach only captures the HTTP requests. ... It will not capture the ... response since the response will not be through port 80; ...
      (Fedora)
    • Re: Quoting relevant material for response (was: Re: python vs perl lines of code)
      ... I mark messages as read when I have read them, so without a context I have ... Also, due to how Usenet works, not everybody sees the messages in the same ... Finally, since Google provides a search engine for Usenet, it might be ... response to 1 specific statement or another. ...
      (comp.lang.python)