[From nobody Thu Feb 22 19:53:34 2007 Return-Path: <jshirley@gmail.com> Delivered-To: brandon@cafeid.com Received: (qmail 22457 invoked from network); 22 Feb 2007 16:58:35 -0000 Received: from unknown (HELO localhost) (192.168.77.135) by mail00.priv.sitebuildingsystem.com with SMTP; 22 Feb 2007 16:58:35 -0000 X-Virus-Scanned: Debian amavisd-new at sitebuildingsystem.com X-Spam-Score: -2.284 X-Spam-Level: X-Spam-Status: No, score=-2.284 tagged_above=-999 required=6 tests=[BAYES_00=-2.599, SARE_MILLIONSOF=0.315] Received: from smtp00.sitebuildingsystem.com ([127.0.0.1]) by localhost (smtp00.sitebuildingsystem.com [127.0.0.1]) (amavisd-new, port 25) with ESMTP id x0cUtNKs1hnF for <brandon@cafeid.com>; Thu, 22 Feb 2007 12:02:43 -0500 (EST) Received: from nf-out-0910.google.com ([64.233.182.184]) by smtp00.sitebuildingsystem.com with esmtp (Exim 3.36 #1 (Debian)) id 1HKHKw-0005Es-00 for <brandon@cafeid.com>; Thu, 22 Feb 2007 12:02:30 -0500 Received: by nf-out-0910.google.com with SMTP id m18so290041nfc for <brandon@cafeid.com>; Thu, 22 Feb 2007 08:57:36 -0800 (PST) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=Kbov3tjVV6M+hB5dZNDbraOZba5VIOkfxuMY3vhE1tCGU3x1Vum5CxxCBVyamdA/50IpBFNMfQIkSxPzO6ljkyfRfLLeEamwgIZVuzfcM3pGMYZi08N8hucGHgf73r44d9JlRMj0HOjv6h6nAdUn4/7/frdRh+Pl3UDpAShIM7U= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=aefwXdmK9qyhXOsMilGN32V3rC23g37ZWaaXOqIOQurrhqmOuA0pmY4zJs7R9aQnK3UsRt3cBFv8Wn7OLwARS64Bk0IBBhvgTtfxgDvMN/eADtmNXZQCP6AtISyx98lhXe6W4X7g1Powz5+zTgvP3ACwmGeZjp78RW9Vgp/VID8= Received: by 10.82.175.2 with SMTP id x2mr210703bue.1172163455877; Thu, 22 Feb 2007 08:57:35 -0800 (PST) Received: by 10.82.147.7 with HTTP; Thu, 22 Feb 2007 08:57:35 -0800 (PST) Message-ID: <756703690702220857o4c70f542of8ef5adad51cebfd@mail.gmail.com> Date: Thu, 22 Feb 2007 08:57:35 -0800 From: "J. Shirley" <jshirley@gmail.com> To: "Brandon Barkley" <brandon@cafeid.com> Subject: Re: Some questions abt MogileFS In-Reply-To: <45DD8507.7020501@cafeid.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <b66ddc900702212241v3b821ebfm3c5a2cbf6dabda6a@mail.gmail.com> <E003720B-FB8D-4D14-84F9-C0AEC865371C@jbyers.com> <b66ddc900702220107wd2da0dci47b2a1249e094d@mail.gmail.com> <45DD8507.7020501@cafeid.com> On 2/22/07, Brandon Barkley <brandon@cafeid.com> wrote: > howard chen wrote: > >> MogileFS is not a cache. See its cousin, memcached. > >> > > > > I refer to page cache, not object cache, usually size is larger, > > containing a lot of duplicated information (i.e. HTML tags) - which > > you never want to store them in memory. > You'd be surprised whatpeople store in memory if they have a lot of > extra (which is easily possible if you have a bunch of machines with > gigabytes of RAM that otherwise are only mogile storage nodes :) ) > > > > > >> Tens to hundreds of servers, tens to hundreds of millions of files, > >> many TB. We've got several million small files stored, a few hundred > >> GB. > >> > > > > What will be the bottomneck of MogileFS in your site? > > > > CPU? Disk? Network? > > > > > > > > Thanks. > > I'm still a new-comer to MogileFS, but I can speak about using memcached to store generated HTML files. We have a 2-node 22GB memcached cluster and it is used to store many generated HTML files -- with compression enabled they are quite small, and it has reduced reliance on disk-based caching. Even though there is a lot of redundant data in the cache, it has been working fine. I definitely would recommend this over a disk-based cache (or something like mogileFS) -- if the lookup time is greater than the generation time (including IO overhead) you're just hurting your overall performance. -Jay -- J. Shirley :: jshirley@gmail.com :: Killing two stones with one bird... ]