How large should a mogilefsd process become?

Jay Buffington jaybuffington at gmail.com
Mon Jul 31 17:12:21 UTC 2006


You could use GTop and monitor the memory usage before and after the
replicator does a task to determine where the leak is.

This example is for mod_perl, but you could apply it to mogile:
http://perl.apache.org/docs/1.0/guide/performance.html#Measuring_the_Memory_of_the_Process

This only happens when you insert large files?

Jay

On 7/31/06, Andreas J. Koenig <andreas.koenig.gmwojprw at franz.ak.mind.de> wrote:
> My mogilefsd processes on 4 machines are about to reach 1 GB size.
>
> This seems a bit gready to me and I'm worried if I hit a memory leak
> somewhere.
>
> It's happening on a Debian box and I do not yet have an idea where to
> start investigating. I'd also be grateful for a suggestion how to work
> around the growth without disturbing the boxes too much.
>
> Did I probably forget to configure some equivalent to
> maxrequestperchild? :-)
>
> # ps auxww|grep mogilefsd
> www-data  3999  0.0  1.2  46376 40264 ?        S    May19  62:10 /usr/bin/perl /usr/bin/mogilefsd --daemon
> www-data  4008  0.1  5.6 979784 175232 ?       S    May19 121:36 /usr/bin/mogilefsd [replicate]
> www-data  4009  0.1  5.5 979012 174120 ?       S    May19 121:39 /usr/bin/mogilefsd [replicate]
> www-data  4010  0.1  5.6 979368 174576 ?       S    May19 121:41 /usr/bin/mogilefsd [replicate]
> www-data  4011  0.0  0.2  33608  8940 ?        S    May19  12:30 /usr/bin/mogilefsd [delete]
> www-data  4012  0.0  0.6  38756 19500 ?        S    May19   6:33 /usr/bin/mogilefsd [queryworker]
> www-data  4013  0.0  0.9  41908 28848 ?        S    May19   6:32 /usr/bin/mogilefsd [queryworker]
> www-data  4014  0.0  0.9  42332 29220 ?        S    May19   6:32 /usr/bin/mogilefsd [queryworker]
> www-data  4015  0.0  0.8  39816 26032 ?        S    May19   6:33 /usr/bin/mogilefsd [queryworker]
> www-data  4016  0.0  0.8  39512 25844 ?        S    May19   6:32 /usr/bin/mogilefsd [queryworker]
> www-data  4017  0.0  0.9  42108 28548 ?        S    May19   6:32 /usr/bin/mogilefsd [queryworker]
> www-data  4018  0.0  0.8  39248 25216 ?        S    May19   6:32 /usr/bin/mogilefsd [queryworker]
> www-data  4019  0.0  0.8  39276 25312 ?        S    May19   6:33 /usr/bin/mogilefsd [queryworker]
> www-data  4020  0.0  0.8  39328 25176 ?        S    May19   6:32 /usr/bin/mogilefsd [queryworker]
> www-data  4021  0.0  0.7  38024 23220 ?        S    May19   6:31 /usr/bin/mogilefsd [queryworker]
> www-data  4022  0.0  0.5  37988 16152 ?        S    May19   6:34 /usr/bin/mogilefsd [queryworker]
> www-data  4023  0.0  0.8  39120 25452 ?        S    May19   6:32 /usr/bin/mogilefsd [queryworker]
> www-data  4024  0.0  0.5  38804 18564 ?        S    May19   6:32 /usr/bin/mogilefsd [queryworker]
> www-data  4025  0.0  0.8  40016 25708 ?        S    May19   6:34 /usr/bin/mogilefsd [queryworker]
> www-data  4026  0.0  0.9  41952 29552 ?        S    May19   6:32 /usr/bin/mogilefsd [queryworker]
> www-data  4027  0.0  0.8  39500 25848 ?        S    May19   6:34 /usr/bin/mogilefsd [queryworker]
> www-data  4028  0.0  0.7  37920 23400 ?        S    May19   6:30 /usr/bin/mogilefsd [queryworker]
> www-data  4029  0.0  0.7  38240 23468 ?        S    May19   6:34 /usr/bin/mogilefsd [queryworker]
> www-data  4030  0.0  0.8  39248 25724 ?        S    May19   6:32 /usr/bin/mogilefsd [queryworker]
> www-data  4031  0.0  0.8  39376 25520 ?        S    May19   6:30 /usr/bin/mogilefsd [queryworker]
> www-data  4032  0.0  0.2  35772  8832 ?        S    May19  18:16 /usr/bin/mogilefsd [monitor]
> www-data  4006  0.1  5.5 977928 173016 ?       S    May19 121:42 /usr/bin/mogilefsd [replicate]
> www-data  4007  0.1  5.6 979600 175188 ?       S    May19 121:54 /usr/bin/mogilefsd [replicate]
>
>
> Thanks for any pointers,
> --
> andreas
>


More information about the mogilefs mailing list