mogilefs + WAN

Brad Fitzpatrick brad at
Tue Aug 7 20:00:08 UTC 2007

With a custom ReplicationPolicy, MogileFS can already do this.  There
might be one more hook needed in the get_paths code to alter the selection
of paths returned, but the replication part is already extensible enough
for this.

On Thu, 19 Jul 2007, Will Lowe wrote:

> Has anyone looked at using mogilefs to run a cluster that's
> distributed across a WAN?  TCP latency is usually the biggest issue in
> a situation like this.  Usually the workarounds involve custom UDP
> protocols or multistreaming over TCP -- but MogileFS already has the
> multi-stream thing solved.
> Seems like it'd be possible to build something that's NUMA-like, where
> a tracker could know that some storage nodes are further away than
> others, arrange to transfer data only once to the remote cluster,
> etc. ...  at some point I'd think replicating the mySQL end of things
> would be the hardest part, although mySQL seems to handle
> master-master pretty well.
> --
> Will

More information about the mogilefs mailing list