How large should a mogilefsd process become?

komtanoo.pinpimai at livetext.com komtanoo.pinpimai at livetext.com
Mon Jul 31 17:15:57 UTC 2006


you can see what really eat memory are the replicate processes. It
happened to me when they replicate large files, ie. if a replicator
replicates a 500M file, the process eats 500M memory. You might want to
try this patch.

-kem

On Mon, July 31, 2006 11:24 am, Andreas J. Koenig wrote:
> My mogilefsd processes on 4 machines are about to reach 1 GB size.
>
>
> This seems a bit gready to me and I'm worried if I hit a memory leak
> somewhere.
>
> It's happening on a Debian box and I do not yet have an idea where to
> start investigating. I'd also be grateful for a suggestion how to work
> around the growth without disturbing the boxes too much.
>
> Did I probably forget to configure some equivalent to
> maxrequestperchild? :-)
>
> # ps auxww|grep mogilefsd
> www-data  3999  0.0  1.2  46376 40264 ?        S    May19  62:10
> /usr/bin/perl /usr/bin/mogilefsd --daemon
> www-data  4008  0.1  5.6 979784 175232 ?       S    May19 121:36
> /usr/bin/mogilefsd [replicate]
> www-data  4009  0.1  5.5 979012 174120 ?       S    May19 121:39
> /usr/bin/mogilefsd [replicate]
> www-data  4010  0.1  5.6 979368 174576 ?       S    May19 121:41
> /usr/bin/mogilefsd [replicate]
> www-data  4011  0.0  0.2  33608  8940 ?        S    May19  12:30
> /usr/bin/mogilefsd [delete]
> www-data  4012  0.0  0.6  38756 19500 ?        S    May19   6:33
> /usr/bin/mogilefsd [queryworker]
> www-data  4013  0.0  0.9  41908 28848 ?        S    May19   6:32
> /usr/bin/mogilefsd [queryworker]
> www-data  4014  0.0  0.9  42332 29220 ?        S    May19   6:32
> /usr/bin/mogilefsd [queryworker]
> www-data  4015  0.0  0.8  39816 26032 ?        S    May19   6:33
> /usr/bin/mogilefsd [queryworker]
> www-data  4016  0.0  0.8  39512 25844 ?        S    May19   6:32
> /usr/bin/mogilefsd [queryworker]
> www-data  4017  0.0  0.9  42108 28548 ?        S    May19   6:32
> /usr/bin/mogilefsd [queryworker]
> www-data  4018  0.0  0.8  39248 25216 ?        S    May19   6:32
> /usr/bin/mogilefsd [queryworker]
> www-data  4019  0.0  0.8  39276 25312 ?        S    May19   6:33
> /usr/bin/mogilefsd [queryworker]
> www-data  4020  0.0  0.8  39328 25176 ?        S    May19   6:32
> /usr/bin/mogilefsd [queryworker]
> www-data  4021  0.0  0.7  38024 23220 ?        S    May19   6:31
> /usr/bin/mogilefsd [queryworker]
> www-data  4022  0.0  0.5  37988 16152 ?        S    May19   6:34
> /usr/bin/mogilefsd [queryworker]
> www-data  4023  0.0  0.8  39120 25452 ?        S    May19   6:32
> /usr/bin/mogilefsd [queryworker]
> www-data  4024  0.0  0.5  38804 18564 ?        S    May19   6:32
> /usr/bin/mogilefsd [queryworker]
> www-data  4025  0.0  0.8  40016 25708 ?        S    May19   6:34
> /usr/bin/mogilefsd [queryworker]
> www-data  4026  0.0  0.9  41952 29552 ?        S    May19   6:32
> /usr/bin/mogilefsd [queryworker]
> www-data  4027  0.0  0.8  39500 25848 ?        S    May19   6:34
> /usr/bin/mogilefsd [queryworker]
> www-data  4028  0.0  0.7  37920 23400 ?        S    May19   6:30
> /usr/bin/mogilefsd [queryworker]
> www-data  4029  0.0  0.7  38240 23468 ?        S    May19   6:34
> /usr/bin/mogilefsd [queryworker]
> www-data  4030  0.0  0.8  39248 25724 ?        S    May19   6:32
> /usr/bin/mogilefsd [queryworker]
> www-data  4031  0.0  0.8  39376 25520 ?        S    May19   6:30
> /usr/bin/mogilefsd [queryworker]
> www-data  4032  0.0  0.2  35772  8832 ?        S    May19  18:16
> /usr/bin/mogilefsd [monitor]
> www-data  4006  0.1  5.5 977928 173016 ?       S    May19 121:42
> /usr/bin/mogilefsd [replicate]
> www-data  4007  0.1  5.6 979600 175188 ?       S    May19 121:54
> /usr/bin/mogilefsd [replicate]
>
>
>
> Thanks for any pointers,
> --
> andreas
>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: mogilefsdpatch
Type: application/octet-stream
Size: 2858 bytes
Desc: not available
Url : http://lists.danga.com/pipermail/mogilefs/attachments/20060731/78bc530c/mogilefsdpatch.obj


More information about the mogilefs mailing list