Hi Peter,
Thanks for the response.
> This may not be what you are looking for, but here is an example note
> on high rate I/O disk server benchmarks
Any such information is useful, so thanks for the link.
> 25GB isn't actually a lot over 8 hours
:-) I'm obviously asking in the right place then. 26GB a day is
considered rather large for the groups in question.
> sounds like you are more interested in very high transaction rates for very
> small reads/writes, is that correct?
Yes. The writes in particular can be very high rate and bursty (and the
sequence of the messages is very important, so its critical that they
are appended in the right order). Currently up to 125,000 messages to be
written a second, with another doubling in the next 12 months not
entirely out of the question. Each message is pretty small (fits in an
ethernet frame..).
The reads are a mix of 'realtime' which are reasonable small as well,
say a few hundred kB, and 'historical' which may stream through a TB or
more. One critical aspect which your applications do not appear to have
is that the time between a message arriving and being available to data
readers must be as small as possible. Preferably milliseconds.
> (Could you tell us a bit more about your application? ;-)
Very little I'm afraid. The data are stock market 'ticks' - quotes for
equity options for example, or foreign exchange. Some trading
applications need to respond within a second to messages, and can take
profitably take advantage of sophisticated data analyses.
Other applications are more batch in nature, but these are easier to
scale with existing techniques.
niall
|