mogilefs + WAN

Will Lowe harpo at thebackrow.net
Thu Jul 19 18:44:36 UTC 2007


Has anyone looked at using mogilefs to run a cluster that's
distributed across a WAN?  TCP latency is usually the biggest issue in
a situation like this.  Usually the workarounds involve custom UDP
protocols or multistreaming over TCP -- but MogileFS already has the
multi-stream thing solved.

Seems like it'd be possible to build something that's NUMA-like, where
a tracker could know that some storage nodes are further away than
others, arrange to transfer data only once to the remote cluster,
etc. ...  at some point I'd think replicating the mySQL end of things
would be the hardest part, although mySQL seems to handle
master-master pretty well.

-- 
Will


More information about the mogilefs mailing list