[PATCH 3/3] Open files only once

[Ed W]

> Our plan was to do rsnapshots overnight to a local backup server, and then
> rsync the resultant backup offsite during the day. The rsnapshot leg worked
> ok (typically an 8-10 hour backup), but we found that rsync (at least with 
> -H to preserve the hard-links, required to keep the storage size manageable)
> simply couldn't walk trees of that size fast enough to get the sync done. I
> guess if you've got 10 hardlinked copies of a 2.5m file tree, you've got to
> check 25m inodes before you can start the sync.
>   

I don't want to spend too long talking about rsync on a brackup mailing 
list, but I think if you try the incremental option of rsync v3 then it 
will start to sync much faster at the expense that it may transfer files 
that it doesn't need to once it discovers later on that they are 
hardlinks.  Possibly your choice of options is currently disabling 
incremental mode?

I'm interested in brackup for backing up some large maildir folders so 
I'm quite interested in these memory reduction patches

Cheers

Ed W