Mogstored eating 10Gb of virtual memory
Robin H. Johnson
robbat2 at gentoo.org
Wed Jun 27 00:50:02 UTC 2007
On Wed, Jun 27, 2007 at 12:34:16AM +0000, Brad Fitzpatrick wrote:
> All Linux? Same versions? Distro?
Yup, all Linux.
All on r1066 of SVN, but the plain 2.16 release produces the same results.
The problem system is:
Portage 2.1.2.7 (default-linux/amd64/2006.1, gcc-4.1.2, glibc-2.5-r2, 2.6.20-pmp-g2763f27c x86_64)
System uname: 2.6.20-pmp-g2763f27c x86_64 Intel(R) Core(TM)2 CPU 6400 @ 2.13GHz
> Does it grow over time, or look like that right after start?
It grows very fast (less than 30 seconds), and then it sits at whatever point
it go to, reasonably constant.
> What's /proc/<pid>/maps look like?
Here's a round with it at 2.4Gb.
root 19083 3.6 3.4 2423792 88428 ? Sl 17:23 0:43 mogstored
root 19084 0.0 0.0 11096 2168 ? S 17:23 0:00 \_ mogstored [diskusage]
root 19085 0.0 0.0 11100 2188 ? S 17:23 0:00 \_ mogstored [iostat]
root 20974 0.0 0.0 2644 652 ? S 17:42 0:00 | \_ iostat -dx 1 30
root 19088 0.0 0.2 22664 5464 ? S 17:23 0:00 \_ mogstored [fidsizes]
grubbs-int mogilefs-server # cat /proc/19083/maps
00400000-004fc000 r-xp 00000000 fe:01 181398 /usr/bin/perl5.8.8
005fb000-00602000 rw-p 000fb000 fe:01 181398 /usr/bin/perl5.8.8
00602000-3ffff000 rw-p 00602000 00:00 0 [heap]
40000000-40001000 ---p 40000000 00:00 0
40001000-40004000 rw-p 40001000 00:00 0
40004000-40005000 ---p 40004000 00:00 0
40005000-40008000 rw-p 40005000 00:00 0
40008000-40009000 ---p 40008000 00:00 0
40009000-4000c000 rw-p 40009000 00:00 0
2aaaaaaab000-2aaaabefd000 rw-p 2aaaaaaab000 00:00 0
2aaaac000000-2aaaac56f000 rw-p 2aaaac000000 00:00 0
2aaaac56f000-2aaab0000000 ---p 2aaaac56f000 00:00 0
2aaab0000000-2aaac6e4f000 rw-p 2aaab0000000 00:00 0
2aaac702a000-2aaafd42b000 rw-p 2aaac702a000 00:00 0
2aaafd42b000-2aaafd7dc000 rw-p 2aaac6e4f000 00:00 0
2b2db96b4000-2b2db96cf000 r-xp 00000000 fe:00 37001 /lib64/ld-2.5.so
2b2db96cf000-2b2db96d0000 rw-p 2b2db96cf000 00:00 0
2b2db96df000-2b2db96e0000 rw-p 2b2db96df000 00:00 0
2b2db97ce000-2b2db97d0000 rw-p 0001a000 fe:00 37001 /lib64/ld-2.5.so
2b2db97d0000-2b2db97e4000 r-xp 00000000 fe:00 35295 /lib64/libpthread-2.5.so
2b2db97e4000-2b2db98e3000 ---p 00014000 fe:00 35295 /lib64/libpthread-2.5.so
2b2db98e3000-2b2db98e5000 rw-p 00013000 fe:00 35295 /lib64/libpthread-2.5.so
2b2db98e5000-2b2db98e9000 rw-p 2b2db98e5000 00:00 0
2b2db98e9000-2b2db98fc000 r-xp 00000000 fe:00 34972 /lib64/libnsl-2.5.so
2b2db98fc000-2b2db99fb000 ---p 00013000 fe:00 34972 /lib64/libnsl-2.5.so
2b2db99fb000-2b2db99fd000 rw-p 00012000 fe:00 34972 /lib64/libnsl-2.5.so
2b2db99fd000-2b2db99ff000 rw-p 2b2db99fd000 00:00 0
2b2db99ff000-2b2db9a01000 r-xp 00000000 fe:00 34961 /lib64/libdl-2.5.so
2b2db9a01000-2b2db9b01000 ---p 00002000 fe:00 34961 /lib64/libdl-2.5.so
2b2db9b01000-2b2db9b03000 rw-p 00002000 fe:00 34961 /lib64/libdl-2.5.so
2b2db9b03000-2b2db9b04000 rw-p 2b2db9b03000 00:00 0
2b2db9b04000-2b2db9b57000 r-xp 00000000 fe:00 32915 /lib64/libm-2.5.so
2b2db9b57000-2b2db9c56000 ---p 00053000 fe:00 32915 /lib64/libm-2.5.so
2b2db9c56000-2b2db9c58000 rw-p 00052000 fe:00 32915 /lib64/libm-2.5.so
2b2db9c58000-2b2db9c5d000 r-xp 00000000 fe:00 35083 /lib64/libcrypt-2.5.so
2b2db9c5d000-2b2db9d5c000 ---p 00005000 fe:00 35083 /lib64/libcrypt-2.5.so
2b2db9d5c000-2b2db9d5e000 rw-p 00004000 fe:00 35083 /lib64/libcrypt-2.5.so
2b2db9d5e000-2b2db9d8c000 rw-p 2b2db9d5e000 00:00 0
2b2db9d8c000-2b2db9d8e000 r-xp 00000000 fe:00 37000 /lib64/libutil-2.5.so
2b2db9d8e000-2b2db9e8d000 ---p 00002000 fe:00 37000 /lib64/libutil-2.5.so
2b2db9e8d000-2b2db9e8f000 rw-p 00001000 fe:00 37000 /lib64/libutil-2.5.so
2b2db9e8f000-2b2db9e90000 rw-p 2b2db9e8f000 00:00 0
2b2db9e90000-2b2db9fbc000 r-xp 00000000 fe:00 37002 /lib64/libc-2.5.so
2b2db9fbc000-2b2dba0bb000 ---p 0012c000 fe:00 37002 /lib64/libc-2.5.so
2b2dba0bb000-2b2dba0be000 r--p 0012b000 fe:00 37002 /lib64/libc-2.5.so
2b2dba0be000-2b2dba0c0000 rw-p 0012e000 fe:00 37002 /lib64/libc-2.5.so
2b2dba0c0000-2b2dba0c7000 rw-p 2b2dba0c0000 00:00 0
2b2dba0c7000-2b2dba0cb000 r-xp 00000000 fe:01 246996 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/IO/IO.so
2b2dba0cb000-2b2dba1ca000 ---p 00004000 fe:01 246996 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/IO/IO.so
2b2dba1ca000-2b2dba1cb000 rw-p 00003000 fe:01 246996 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/IO/IO.so
2b2dba1cb000-2b2dba1d0000 r-xp 00000000 fe:01 246998 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Socket/Socket.so
2b2dba1d0000-2b2dba2cf000 ---p 00005000 fe:01 246998 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Socket/Socket.so
2b2dba2cf000-2b2dba2d0000 rw-p 00004000 fe:01 246998 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Socket/Socket.so
2b2dba2d0000-2b2dba2e8000 r-xp 00000000 fe:01 246853 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/POSIX/POSIX.so
2b2dba2e8000-2b2dba3e8000 ---p 00018000 fe:01 246853 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/POSIX/POSIX.so
2b2dba3e8000-2b2dba3e9000 rw-p 00018000 fe:01 246853 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/POSIX/POSIX.so
2b2dba3e9000-2b2dba3ed000 r-xp 00000000 fe:01 247024 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Devel/Peek/Peek.so
2b2dba3ed000-2b2dba4ec000 ---p 00004000 fe:01 247024 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Devel/Peek/Peek.so
2b2dba4ec000-2b2dba4ed000 rw-p 00003000 fe:01 247024 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Devel/Peek/Peek.so
2b2dba4ed000-2b2dba4f0000 r-xp 00000000 fe:01 246778 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Fcntl/Fcntl.so
2b2dba4f0000-2b2dba5ef000 ---p 00003000 fe:01 246778 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Fcntl/Fcntl.so
2b2dba5ef000-2b2dba5f0000 rw-p 00002000 fe:01 246778 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Fcntl/Fcntl.so
2b2dba5f0000-2b2dba601000 r-xp 00000000 fe:01 363259 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/Storable/Storable.so
2b2dba601000-2b2dba701000 ---p 00011000 fe:01 363259 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/Storable/Storable.so
2b2dba701000-2b2dba702000 rw-p 00011000 fe:01 363259 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/Storable/Storable.so
2b2dba702000-2b2dba70e000 r-xp 00000000 fe:01 344760 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/IO/AIO/AIO.so
2b2dba70e000-2b2dba80d000 ---p 0000c000 fe:01 344760 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/IO/AIO/AIO.so
2b2dba80d000-2b2dba80e000 rw-p 0000b000 fe:01 344760 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/IO/AIO/AIO.so
2b2dba81d000-2b2dba824000 r-xp 00000000 fe:00 36996 /lib64/librt-2.5.so
2b2dba824000-2b2dba923000 ---p 00007000 fe:00 36996 /lib64/librt-2.5.so
2b2dba923000-2b2dba925000 rw-p 00006000 fe:00 36996 /lib64/librt-2.5.so
2b2dba925000-2b2dba92a000 r-xp 00000000 fe:01 249148 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/Time/HiRes/HiRes.so
2b2dba92a000-2b2dbaa2a000 ---p 00005000 fe:01 249148 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/Time/HiRes/HiRes.so
2b2dbaa2a000-2b2dbaa2b000 rw-p 00005000 fe:01 249148 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/Time/HiRes/HiRes.so
2b2dbaa2b000-2b2dbaa2e000 r-xp 00000000 fe:01 344647 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/BSD/Resource/Resource.so
2b2dbaa2e000-2b2dbab2d000 ---p 00003000 fe:01 344647 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/BSD/Resource/Resource.so
2b2dbab2d000-2b2dbab2e000 rw-p 00002000 fe:01 344647 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/BSD/Resource/Resource.so
2b2dbab2e000-2b2dbab34000 r-xp 00000000 fe:01 360731 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/List/Util/Util.so
2b2dbab34000-2b2dbac33000 ---p 00006000 fe:01 360731 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/List/Util/Util.so
2b2dbac33000-2b2dbac34000 rw-p 00005000 fe:01 360731 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/List/Util/Util.so
2b2dbac34000-2b2dbac36000 r-xp 00000000 fe:01 247039 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Cwd/Cwd.so
2b2dbac36000-2b2dbad35000 ---p 00002000 fe:01 247039 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Cwd/Cwd.so
2b2dbad35000-2b2dbad36000 rw-p 00001000 fe:01 247039 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Cwd/Cwd.so
2b2dbad36000-2b2dbad39000 r-xp 00000000 fe:01 247391 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/Sys/Syslog/Syslog.so
2b2dbad39000-2b2dbae39000 ---p 00003000 fe:01 247391 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/Sys/Syslog/Syslog.so
2b2dbae39000-2b2dbae3a000 rw-p 00003000 fe:01 247391 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/Sys/Syslog/Syslog.so
2b2dbae3a000-2b2dbae3c000 r-xp 00000000 fe:01 246804 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Sys/Hostname/Hostname.so
2b2dbae3c000-2b2dbaf3b000 ---p 00002000 fe:01 246804 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Sys/Hostname/Hostname.so
2b2dbaf3b000-2b2dbaf3c000 rw-p 00001000 fe:01 246804 /usr/lib64/perl5/5.8.8/x86_64-linux/auto/Sys/Hostname/Hostname.so
2b2dbaf3c000-2b2dbaf3e000 r-xp 00000000 fe:01 248658 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/String/CRC32/CRC32.so
2b2dbaf3e000-2b2dbb03d000 ---p 00002000 fe:01 248658 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/String/CRC32/CRC32.so
2b2dbb03d000-2b2dbb03e000 rw-p 00001000 fe:01 248658 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux/auto/String/CRC32/CRC32.so
2b2dbb04d000-2b2dbb056000 r-xp 00000000 fe:00 35303 /lib64/libnss_files-2.5.so
2b2dbb056000-2b2dbb155000 ---p 00009000 fe:00 35303 /lib64/libnss_files-2.5.so
2b2dbb155000-2b2dbb157000 rw-p 00008000 fe:00 35303 /lib64/libnss_files-2.5.so
7ffff13e1000-7ffff13f6000 rw-p 7ffff13e1000 00:00 0 [stack]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vdso]
--
Robin Hugh Johnson
Gentoo Linux Developer & Council Member
E-Mail : robbat2 at gentoo.org
GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 321 bytes
Desc: not available
Url : http://lists.danga.com/pipermail/mogilefs/attachments/20070626/d4911482/attachment.pgp
More information about the mogilefs
mailing list