MogileFS Excessive CPU Utilization on Idle Server

Erik Osterman e at osterman.com
Mon Jun 11 19:12:42 UTC 2007


MogileFS has been consistently using an unusual amount of CPU. Even with 
our application entirely turned off, MogileFS is busy doing something. I 
am new to the whole MogileFS app, so it could be entirely likely that 
I've misconfigured something.

  837 mysql     15   0  142m  28m 4024 S   62  2.9   1804:36 mysqld
18268 mogile    16   0 21076  10m 1540 R   56  1.0   1034:28 mogilefsd
18216 mogile    15   0 21076  10m 1732 S   14  1.0 207:51.28 mogilefsd
26967 mogile    15   0 21076 9204 1364 R   14  0.9 680:22.23 mogilefsd


An strace shows..

poll([{fd=4, events=POLLIN|POLLPRI}], 1, 0) = 0
write(4, "1\0\0\0\3SELECT RELEASE_LOCK(\'mgfs:fid:288598:replicate\')", 
53) = 53
read(4, 
"\1\0\0\1\1?\0\0\2\3def\0\0\0)RELEASE_LOCK(\'mgfs:fid:288598:replicate\')\0\f?\0\1\0\0\0\10\200\0\0\0\0\5\0\0\3\376\0\0\2\0\2\0\0\4\0011\5\0\0\5\376\0\0\2\0", 
16384) = 96
time(NULL)                              = 1181588819
time(NULL)                              = 1181588819
time(NULL)                              = 1181588819
write(21, ":still_alive\r\n", 14)       = 14
poll([{fd=4, events=POLLIN|POLLPRI}], 1, 0) = 0
write(4, "i\0\0\0\3SELECT fid FROM file WHERE dmid=\'1\' AND 
classid=\'4\' AND devcount = \'1\' AND length IS NOT NULL LIMIT 1000", 
109) = 109
read(4, 
"\1\0\0\1\1,\0\0\2\3def\10mogilefs\4file\4file\3fid\3fid\f?\0\n\0\0\0\3#P\0\0\0\5\0\0\3\376\0\0\2\0\7\0\0\4\006252333\7\0\0\5\006252799\7\0\0\6\006255062\7\0\0\7\006341306\7\0\0\10\006341511\7\0\0\t\006342276\7\0\0\n\006342284\7\0\0\v\006342285\5\0\0\f\376\0\0\2\0", 
16384) = 159
time(NULL)                              = 1181588819
time(NULL)                              = 1181588819
poll([{fd=4, events=POLLIN|POLLPRI}], 1, 0) = 0
write(4, "i\0\0\0\3SELECT fid FROM file WHERE dmid=\'1\' AND 
classid=\'1\' AND devcount = \'1\' AND length IS NOT NULL LIMIT 1000", 
109) = 109
read(4, 
"\1\0\0\1\1,\0\0\2\3def\10mogilefs\4file\4file\3fid\3fid\f?\0\n\0\0\0\3#P\0\0\0\5\0\0\3\376\0\0\2\0\7\0\0\4\006250518\7\0\0\5\006250520\7\0\0\6\006250528\7\0\0\7\006250653\7\0\0\10\006250656\7\0\0\t\006250777\7\0\0\n\006250778\7\0\0\v\006250780\7\0\0\f\006250781\7\0\0\r\006250789\7\0\0\16\006250790\7\0\0\17\006250791\7\0\0\20\0062"..., 
16384) = 11071
time(NULL)                              = 1181588819
time(NULL)                              = 1181588819
poll([{fd=4, events=POLLIN|POLLPRI}], 1, 0) = 0
write(4, "i\0\0\0\3SELECT fid FROM file WHERE dmid=\'1\' AND 
classid=\'0\' AND devcount = \'1\' AND length IS NOT NULL LIMIT 1000", 
109) = 109
read(4, 
"\1\0\0\1\1,\0\0\2\3def\10mogilefs\4file\4file\3fid\3fid\f?\0\n\0\0\0\3#P\0\0\0\5\0\0\3\376\0\0\2\0\5\0\0\4\376\0\0\2\0", 
16384) = 71
time(NULL)                              = 1181588819
time(NULL)                              = 1181588819
poll([{fd=4, events=POLLIN|POLLPRI}], 1, 0) = 0
write(4, "i\0\0\0\3SELECT fid FROM file WHERE dmid=\'1\' AND 
classid=\'3\' AND devcount = \'1\' AND length IS NOT NULL LIMIT 1000", 
109) = 109
read(4, 
"\1\0\0\1\1,\0\0\2\3def\10mogilefs\4file\4file\3fid\3fid\f?\0\n\0\0\0\3#P\0\0\0\5\0\0\3\376\0\0\2\0\7\0\0\4\006250902\7\0\0\5\006251006\7\0\0\6\006251020\7\0\0\7\006251220\7\0\0\10\006251222\7\0\0\t\006251223\7\0\0\n\006251224\7\0\0\v\006251227\7\0\0\f\006251229\7\0\0\r\006251230\7\0\0\16\006251231\7\0\0\17\006251233\7\0\0\20\0062"..., 
16384) = 951
time(NULL)                              = 1181588819
time(NULL)                              = 1181588819
poll([{fd=4, events=POLLIN|POLLPRI}], 1, 0) = 0
write(4, "i\0\0\0\3SELECT fid FROM file WHERE dmid=\'1\' AND 
classid=\'2\' AND devcount = \'1\' AND length IS NOT NULL LIMIT 1000", 
109) = 109
read(4, 
"\1\0\0\1\1,\0\0\2\3def\10mogilefs\4file\4file\3fid\3fid\f?\0\n\0\0\0\3#P\0\0\0\5\0\0\3\376\0\0\2\0\7\0\0\4\006250965\7\0\0\5\006251499\7\0\0\6\006251510\7\0\0\7\006251511\7\0\0\10\006251512\7\0\0\t\006251513\7\0\0\n\006251524\7\0\0\v\006251525\7\0\0\f\006251526\7\0\0\r\006251572\7\0\0\16\006251613\7\0\0\17\006251627\7\0\0\20\0062"..., 
16384) = 11071



Is this to be expected?

FYI, I am running a relatively recent svn version, as of about 2 weeks ago.


Best,

Erik Osterman





More information about the mogilefs mailing list