Working with large number of search results in struts/jsp application



I'm developing a struts/jsp web application that returns upwards of
30000 results obtained from a very complex schema and multiple queries
to the database.
We want the user to be able to paginate through the results, sort by
several fields, add/drop columns and download in several formats. We
don't expect heavy traffic but we do want it to be scalable.
Up to now, I have been storing the results in a session ArrayList
which can eat up a lot of memory. The queries take long to perform so
I do not want to repeat them with every request.
I would like to store in a single mysql temp table but I have read
that when the connection ends, the table is dropped. I understand that
creating a database Connection as a session variable is not a good
practice.
This is not a unique problem - I was hoping someone else has some
insight into the best way to proceed.
Thanks
.



Relevant Pages

  • Re: Help ! -> Distributed BL and Database Access
    ... I have one server located in a remote part of the country ... method the data within the object will be comitted to the database. ... reference to the database connection and then send it to the client (by ... value - to move the work off onto the client). ...
    (microsoft.public.dotnet.framework.remoting)
  • Re: [PHP] uh oh, I defined a resoruce
    ... I don't agree that "Global variables are evil." ... going to use only for a database connection, IMO, is perfectly fine. ... By specific globals I mean that I have a "namespaced" entry such as ...
    (php.general)
  • Re: [PHP] uh oh, I defined a resoruce
    ... I don't agree that "Global variables are evil." ... going to use only for a database connection, IMO, is perfectly fine. ... By specific globals I mean that I have a "namespaced" entry such as ...
    (php.general)
  • Re: Database connections and try catch finally?
    ... You never know when you'll get an exception doing database IO. ... > finally statement when opening a database connection, ... > conn = new SqlConnection; ... > SqlConnection conn = new SqlConnection; ...
    (microsoft.public.dotnet.framework.adonet)
  • Why Opening a Database Connection Is Very Slow?
    ... I would like to know why this takes a long time to open a database ... connection to a SQL Server 2000 database in a server. ... I find that I may take 2 minutes or so to open a database connection. ... Dim sConnString As String ...
    (microsoft.public.pocketpc.developer)