Spreading key/value pairs across multiple memcached servers

[Brad Fitzpatrick]

Note that memcached has no authentication and no namespaces.  (yet?)

So a shared memcached box is asking for trouble.


On Thu, 2 Dec 2004, Chris Hartjes wrote:

> Greg,
>
> I didn't get a long, invovled e-mail from you about it (but would love
> to see it anyway).  All my questions have been answered so far thanks
> to all the obivously-smarter-than-me people on this list.
>
> I've at least got memcached up and running on my development box and
> have written a bunch of unit tests to demonstrate it's work.  Next
> step is convincing our always-skeptical systems department to
> configure a server for everyone else to use
>
>
> On Wed, 01 Dec 2004 16:51:21 -0500, Greg Whalin <gwhalin at meetup.com> wrote:
> > This request is in the client.  I sent you a fairly heavy email
> > yesterday explaining how this works.  Did you not receive it?
> >
> >
> >
> > Chris Hartjes wrote:
> > > I had a chat about this with my boss, and his concern is not that we
> > > distribute the keys evenly, his concern is distributing the request to
> > > find out what server a key is sitting on.  I figure he doesn't want
> > > the first memcached server getting constantly pounded with requests
> > > for the location of a key, while the second server could be helping
> > > out in that regards.
> > >
> > >
> > > On Wed, 01 Dec 2004 11:21:59 -0500, Greg Whalin <gwhalin at meetup.com> wrote:
> > >
> > >>A good hashing algorithm should take care of this for you.  I am under
> > >>the impression that the currently used default for the perl and php
> > >>clients is using a new alg based on a crc32 checksum that gets very even
> > >>key distribution, so I don't see this as being an issue.
> > >>
> > >>
> > >>
> > >>Chris Hartjes wrote:
> > >>
> > >>>My boss has requested that if we are to implement the use of memcached
> > >>>for our site, that we need to "load balance" the data we place in
> > >>>multiple memcached servers.  I guess the concern is that we would be
> > >>>overtaxing one memcached server while other memcached servers are
> > >>>being underutilized.
> > >>>
> > >>>Thoughts?  Comments?
> > >>>
> > >>
> > >
> > >
> >
>
>
> --
> Chris Hartjes
>
> "I know monkeys, and monkeys are good people!"
>
>