mogilefs + WAN

[Brad Fitzpatrick]

With a custom ReplicationPolicy, MogileFS can already do this.  There
might be one more hook needed in the get_paths code to alter the selection
of paths returned, but the replication part is already extensible enough
for this.


On Thu, 19 Jul 2007, Will Lowe wrote:

> Has anyone looked at using mogilefs to run a cluster that's
> distributed across a WAN?  TCP latency is usually the biggest issue in
> a situation like this.  Usually the workarounds involve custom UDP
> protocols or multistreaming over TCP -- but MogileFS already has the
> multi-stream thing solved.
>
> Seems like it'd be possible to build something that's NUMA-like, where
> a tracker could know that some storage nodes are further away than
> others, arrange to transfer data only once to the remote cluster,
> etc. ...  at some point I'd think replicating the mySQL end of things
> would be the hardest part, although mySQL seems to handle
> master-master pretty well.
>
> --
> Will
>
>