Re: CL Scaling for High Traffic Web Sites

(message (Hello 'bob)
(you :wrote :on '(28 Apr 2007 12:26:48 -0700))
(

b> 1) Scaling out: have a distributed in-memory cache (eg. memcached)
b> that sits between the app and the db.

personally i have no experience with building high traffic web sites yet,
but i strongly believe that it would be better to use in-memory simple
cache, like just some hash table.

recently there was a question on Y Combinator news: "What are the best
non-database solutions you've seen? What did Viaweb use?" --
http://news.ycombinator.com/comments?id=14605

Paul Graham replied: "Keep everything in memory in the usual sort of data
structures (e.g. hash tables). Save changes to disk, but never read from
disk except at startup." then he also made a note that it's was easy to
scale this solution to multiple servers simply partitioning servers among
clients.
Paul Graham seems to have experience with high-traffic web sites :)

memcached thing is actually PHP style -- PHP is very limited, so it needs an
external entity for caching.
with Common Lisp you can just use internal data structures for it, and you
can make it easily scalable w/o complex 'distibuted hash table' thing (that
introduces some overhead by the way) if you'll analyse your data processing.

b> I remember Marco Baringer mentioned in an old thread that he was going
b> to implement fast session serialization,
b> which could eventually lead to these things. Is it available in UCW
b> already? Is it done in other servers/frameworks?

most likely Marco Baringer was going to implement CONTIUNATION
serialization, that's kinda much more complex that session serialization if
you are not useing continuations.
are there really any problems with session serialization?

and actually i don't think there's really any need in session serialization.
simply do not keep anything important in the session. if you'll have a
hardware failure and sesssion will be lost, person using it will need to
re-login, for example. i don't think it's a big deal, web applications were
never meant to be anyhow reliable.. and actually do you really have hardware
failures each day, so it's an issue?

)
(With-best-regards '(Alex Mizrahi) :aka 'killer_storm)
"I am everything you want and I am everything you need")


.