Large-scale production installations, and another question

[mike]

On 6/29/08, dormando <dormando at rydia.net> wrote:
>
> > so if no_verify=0, then it issues a HEAD to see if the file exists, if
> > so, it replies back "yes, i have the file" to the tracker, which
> > combines those replies from the various storage nodes marked as the
> > ones that have it, and then sends that to the client?
> >
> > couldn't there be a process which runs constantly and knocks out nodes
> > with invalid HEAD replies as being out of date/needing fixed (i'm sure
> > those tools exist and i just don't have enough experience with
> > mogilefs yet...)
>
> fsck. the verify option is for more realtime fun. I try to let fsck do
> its thing and take a minor hit for the speed increase.
>

yeah that sounds right. i would expect fsck to take care of removing
stale links etc.

okay, so i set no_verify in the params passed to get_paths?