what hardware for mogilefs

[Krzysztof Kulicki]

Hi,
Presently, I'm having 3 600 000 fotos in average 50KB per one, and 5 000 000
thubms in average 3KB per one, so its occupy in total disk storage about
200GB.
I in peak hours traffic is about 5500 queries per second.
Below is statistic of traffic from one domain :
domain2.com: (queries for file per hour)

2007-01-07 13:00 2007-01-07 14:00 8 877 219
2007-01-07 14:00 2007-01-07 15:00 8 586 457
2007-01-07 15:00 2007-01-07 16:00 8 479 585
2007-01-07 16:00 2007-01-07 17:00 8 438 471
2007-01-07 17:00 2007-01-07 18:00 8 802 175
2007-01-07 18:00 2007-01-07 19:00 9 299 118
2007-01-07 19:00 2007-01-07 20:00 10 334 540
2007-01-07 20:00 2007-01-07 21:00 11 069 773
2007-01-07 21:00 2007-01-07 22:00 9 642 031
2007-01-07 22:00 2007-01-07 23:00 5 635 150
2007-01-07 23:00 2007-02-07 00:00 2 498 822
2007-02-07 00:00 2007-02-07 01:00 1 077 072

I would be able to obtain 20 units of sun x2100 M2, which each of other has
2 SATA disks, two processors Opteron dual core. And such unit is able to
have max 64 GB ram. So, my question is how many units I'll need? and what
how many ram per one? The main purpose is to increase the traffic from 5500
q/s to 10000 q/s (q/s  - queries per second)

Thanks for all solutions from you

Krzysztof


2007/7/2, Robin H. Johnson <robbat2 at gentoo.org>:
> On Mon, Jul 02, 2007 at 09:14:37AM +0200, Krzysztof Kulicki wrote:
> >  Hi,
> >  I will have  6.000.000.000 queries about foto, transfer 36000GB per
> >  month. How much servers I need and what kind ? I will need more disk
> >  storage or more ram storage?  I would use mogilefs for it.
> Could you state how many photos you have in total and what quantity of
> disk they presently occupy? Also look at what your peak traffic is
> weekly, as that will figure into your IO requirements.
>
> As a general formula to work out the requirement amount of storage for
> the objects in a given class, take the amount of storage that a single
> copy requires, and multiply it by your desired mindevcount.
> Eg: 20GiB of data with mindevcount=3, requires 60GiB of storage.
>
> So work out your storage classes, say 100Gb of photos with a of
> mindevcount=6, 5Gb of thumbnails with mindevcount=3. That's 615Gb in
> total.
>
> If you use the default MultipleHosts replication policy, you should have
> at least as many separate machines as your mindevcount. (Having two
> hosts, one with 1 device, and the other with 4 devices, things really
> suck if you temporarily lose the host that has 4 devices).
>
> --
> Robin Hugh Johnson
> Gentoo Linux Developer & Council Member
> E-Mail     : robbat2 at gentoo.org
> GnuPG FP   : 11AC BA4F 4778 E3F6 E4ED  F38E B27B 944E 3488 4E85
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.danga.com/pipermail/mogilefs/attachments/20070705/1904e7e5/attachment.html