Re: Using JMS to transfer large volumes of data

marlow.andrew@xxxxxxxxxxxxxx wrote:
Has anyone used JMS to transfer very large volumes of data? I am
thinking about several gigs per day, every day. Phew. Whilst it is
possible to write all this data to a logfile and then FTP it, the
events of interest are occuring in several servers at the same time.
FTPing all these server logs is very time consuming. I have in mind
that the data could be trickled over using several queues. Any
thoughts? I wonder if anyone has done this sort of thing before..

I am aware of production systems in use today that use IBM WebSphere and their MQ implementation of JMS to transfer up to gigabytes per transaction, tens of millions per day. Use of multiple servers in that scenario, along with a whole shi--, er, cartload of additional infrastructure, is /de rigueur/ in such a scenario.

I suspect that this is not the only such installation.

I know there are alternatives, as you scale up to this kind of distributed architecture, and that JMS is not the only option. Regardless of the software layer involved, the physical infrastructure and the balanced deployment of multiple disparate components will dominate your considerations.

We speak not yet of redundant systems, uptime, failover, clustering and other technology matters, much less of the human-resource considerations of obtaining the services of competent operations personnel and the concomitant costs.

--
Lew
.

Relevant Pages

  • Re: XFS: inode with st_mode == 0
    ... >> So apart from the general well known instability problems that will ... Scenario 1: Mailservers: ... Resolution to the mailserver problem: ... Mentioned errors seen on a total of 17 servers. ...
    (Linux-Kernel)
  • Re: fault tolerant setup SBS2003
    ... Can I ask a dumb question why you have to have a persistent VPN rather than a wired connection? ... Another issue is that the two servers are in the same building but on different locations in the building without a possibility to have them connected via a LAN. ... Is there any builtin functionality in SBS which can facilitate the connections between the two servers and keep authentication and file servers in-synch with the WIndows built in replication for both AD and Files services. ... Exchange and SQL fault tolerancy is out of scope in this scenarion. ...
    (microsoft.public.windows.server.sbs)
  • Re: DFS / FRS Replication Using Member Servers
    ... > servers. ... > demonstrates that clients are being directed to their local server and are ... > In the DFS/FRS scenario that is all hosted on Domain Controllers, ... > understanding is that, member servers do not get listed ...
    (microsoft.public.windows.server.active_directory)
  • Re: IMF on NLB front end servers?
    ... That scenario should work just fine for you. ... > We run Exchange with a clustered back-end and a pair of front end servers ... > - install Exchange Intelligent Message Filter on both FE servers. ...
    (microsoft.public.exchange.admin)
Loading