Hi,<br><br>I wasn't having trouble with the creation of the /0/000/000 dirs, but with the creation of the /var/mogdata/dev$nr<br>After I created the following, the /0/000/000 came automaticly, so that wasn't the case with me.
<br><br>I agree that the documentation is spread very thin, that's a mayor bottleneck for such a great project.<br>I'd love to contribute to the documentation, but I don't have time to be the main cheerleader sorry :)<br>
<br>Thanks for your help.<br><br>Arnoud Vermeer<br><br><div><span class="gmail_quote">On 1/29/06, <b class="gmail_sendername">Brad Fitzpatrick</b> <<a href="mailto:brad@danga.com">brad@danga.com</a>> wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
The problem that Paul Hurley was having here,<br><a href="http://lists.danga.com/pipermail/mogilefs/2006-January/000244.html">http://lists.danga.com/pipermail/mogilefs/2006-January/000244.html</a><br><br>, with the missing 0/000/000 directories, is a broken Linux::AIO.
<br><br>But you always have to create the /var/mogdata/dev$n directories.<br><br>Use this script to auto-create/mount all your /var/mogdata directories:<br><a href="http://cvs.danga.com/browse.cgi/wcmtools/mogilefs/server/mogautomount?rev=1.2">
http://cvs.danga.com/browse.cgi/wcmtools/mogilefs/server/mogautomount?rev=1.2</a><br><br>(see the docs at bottom, or run "perldoc" on it)<br><br>It works if you put labels on your Mogile filesystems, which is *highly
<br>recommended*.<br><br>Is anybody on this list passionate/energetic/bored enough to take up<br>maintenance of MogileFS docs and lead cheerleading? I'm doing a terrible<br>job. We are trying to get it into Debian here, and are making progress on
<br>everything required for that, but our website, for instance, is pretty<br>bad. In particular, we need a high-level overview and installation guide.<br><br>- Brad<br><br><br>On Sun, 29 Jan 2006, Arnoud Vermeer wrote:<br>
<br>> I've got Linux:AIO installed via cpan install Linux::AIO, but I've still had<br>> the error, that's why I guessed there was something wrong :)<br>><br>> test results Debian Sarge (i386)<br>> IO-AIO-1.71#
make test<br>> cp <a href="http://autoconf.pm">autoconf.pm</a> blib/lib/IO/autoconf.pm<br>> cp AIO.pm blib/lib/IO/AIO.pm<br>> /usr/bin/perl /usr/share/perl/5.8/ExtUtils/xsubpp -typemap<br>> /usr/share/perl/5.8/ExtUtils/typemap
AIO.xs > AIO.xsc && mv AIO.xsc AIO.c<br>> cc -c -D_REENTRANT -D_GNU_SOURCE -DTHREADS_HAVE_PIDS -DDEBIAN<br>> -fno-strict-aliasing -I/usr/local/include -D_LARGEFILE_SOURCE<br>> -D_FILE_OFFSET_BITS=64 -O2 -DVERSION=\"
1.71\" -DXS_VERSION=\"1.71\" -fPIC<br>> "-I/usr/lib/perl/5.8/CORE" AIO.c<br>> Running Mkbootstrap for IO::AIO ()<br>> chmod 644 AIO.bs<br>> rm -f blib/arch/auto/IO/AIO/AIO.so<br>> LD_RUN_PATH="" cc -shared -L/usr/local/lib
AIO.o -o<br>> blib/arch/auto/IO/AIO/AIO.so -lpthread -lrt<br>> chmod 755 blib/arch/auto/IO/AIO/AIO.so<br>> cp AIO.bs blib/arch/auto/IO/AIO/AIO.bs<br>> chmod 644 blib/arch/auto/IO/AIO/AIO.bs<br>> PERL_DL_NONLAZY=1 /usr/bin/perl "-MExtUtils::Command::MM" "-e"
<br>> "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t<br>> t/00_load.......ok<br>> t/01_stat.......ok<br>> t/02_read.......ok<br>> t/03_errors.....ok<br>> t/04_fork.......ok<br>> t/05_readdir....ok
<br>> All tests successful.<br>> Files=6, Tests=44, 1 wallclock secs ( 0.45 cusr + 0.05 csys = 0.50 CPU)<br>><br>> Linux-AIO-1.8# make test<br>> PERL_DL_NONLAZY=1 /usr/bin/perl "-MExtUtils::Command::MM" "-e"
<br>> "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t<br>> t/00_load......ok<br>> t/01_stat......ok<br>> t/02_read......ok<br>> t/03_errors....ok<br>> All tests successful.<br>> Files=4, Tests=26, 1 wallclock secs (
0.42 cusr + 0.04 csys = 0.46 CPU)<br>><br>> -------<br>> IO-AIO under FreeBSD amd64<br>><br>> make test<br>> cp <a href="http://autoconf.pm">autoconf.pm</a> blib/lib/IO/autoconf.pm<br>> cp AIO.pm blib/lib/IO/AIO.pm
<br>> /usr/bin/perl /usr/local/lib/perl5/5.8.7/ExtUtils/xsubpp -typemap<br>> /usr/local/lib/perl5/5.8.7/ExtUtils/typemap AIO.xs > AIO.xsc && mv AIO.xsc<br>> AIO.c<br>> cc -c -DAPPLLIB_EXP="/usr/local/lib/perl5/5.8.7/BSDPAN" -DHAS_FPSETMASK
<br>> -DHAS_FLOATINGPOINT_H -fno-strict-aliasing -pipe -I/usr/local/include -O<br>> -pipe -DVERSION=\"1.71\" -DXS_VERSION=\"1.71\" -DPIC -fPIC<br>> "-I/usr/local/lib/perl5/5.8.7/mach/CORE"
AIO.c<br>> Running Mkbootstrap for IO::AIO ()<br>> chmod 644 AIO.bs<br>> rm -f blib/arch/auto/IO/AIO/AIO.so<br>> LD_RUN_PATH="/usr/lib" cc -shared -L/usr/local/lib AIO.o -o<br>> blib/arch/auto/IO/AIO/AIO.so -lpthread
<br>> chmod 755 blib/arch/auto/IO/AIO/AIO.so<br>> cp AIO.bs blib/arch/auto/IO/AIO/AIO.bs<br>> chmod 644 blib/arch/auto/IO/AIO/AIO.bs<br>> PERL_DL_NONLAZY=1 /usr/bin/perl "-MExtUtils::Command::MM" "-e"
<br>> "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t<br>> t/00_load.......ok<br>> t/01_stat.......ok<br>> t/02_read.......ok<br>> t/03_errors.....ok<br>> t/04_fork.......ok<br>> t/05_readdir....ok
<br>> All tests successful.<br>> Files=6, Tests=44, 0 wallclock secs ( 0.24 cusr + 0.09 csys = 0.33 CPU)<br>><br>> I hope you find this usefull :)<br>><br>> Arnoud<br>><br>> On 1/29/06, Brad Fitzpatrick <
<a href="mailto:brad@danga.com">brad@danga.com</a>> wrote:<br>> ><br>> > Are you using Linux::AIO or IO::AIO? My guess is you installed Linux::AIO<br>> > but the test suite didn't pass. Go download it,
<br>> ><br>> > <a href="http://search.cpan.org/CPAN/authors/id/M/ML/MLEHMANN/Linux-AIO-1.8.tar.gz">http://search.cpan.org/CPAN/authors/id/M/ML/MLEHMANN/Linux-AIO-1.8.tar.gz</a><br>> ><br>> > and then:
<br>> ><br>> > $ perl Makefile.PL<br>> > $ make test<br>> ><br>> > What does it say?<br>> ><br>> > If it fails, could you also try IO::AIO and let me know what that test<br>> > suite says. I may have to change the default preference to use IO::AIO
<br>> > instead of Linux::AIO.<br>> ><br>> > <a href="http://search.cpan.org/CPAN/authors/id/M/ML/MLEHMANN/IO-AIO-1.71.tar.gz">http://search.cpan.org/CPAN/authors/id/M/ML/MLEHMANN/IO-AIO-1.71.tar.gz</a><br>
> ><br>> > (Anybody reading this that wants to test both, I'm interested in hearing<br>> > your results....)<br>> ><br>> > - Brad<br>> ><br>> ><br>> > On Sun, 29 Jan 2006, Arnoud Vermeer wrote:
<br>> ><br>> > > I fixed the problem by manually creating the dir dev[456] in<br>> > /var/mogdata.<br>> > > It seems like there is a problem with the mogstored demon (I think?)<br>> > >
<a href="http://lists.danga.com/pipermail/mogilefs/2006-January/000244.html">http://lists.danga.com/pipermail/mogilefs/2006-January/000244.html</a> is<br>> > having<br>> > > the same problem as I am.<br>> > >
<br>> > > I hope this problem can get fixed.<br>> > ><br>> > > Thanks,<br>> > ><br>> > > Arnoud Vermeer<br>> > ><br>> > > On 1/29/06, Arnoud Vermeer <<a href="mailto:a.vermeer@freshway.biz">
a.vermeer@freshway.biz</a>> wrote:<br>> > > ><br>> > > > Thanks for your replies.<br>> > > ><br>> > > > Regarding Joshua:<br>> > > > mfs1:# df -l<br>> > > > Filesystem 1K-blocks Used Available Use% Mounted on
<br>> > > > /dev/hda1 37776652 555432 35302260 2% /<br>> > > > tmpfs 124472 0 124472 0% /dev/shm<br>> > > ><br>> > > > mfs2:# df -l
<br>> > > > Filesystem 1K-blocks Used Available Use% Mounted on<br>> > > > /dev/hda1 37136300 501176 34748696 2% /<br>> > > > tmpfs 225764 0 225764 0% /dev/shm
<br>> > > ><br>> > > > mfs3:# df -l<br>> > > > Filesystem 1K-blocks Used Available Use% Mounted on<br>> > > > /dev/hda1 37744520 510772 35316392 2% /
<br>> > > > tmpfs 128520 0 128520 0% /dev/shm<br>> > > ><br>> > > > I didn't map any device to the devicenames in mogilefs, should I ? and<br>> > > > how?
<br>> > > ><br>> > > > Regarding brad:<br>> > > ><br>> > > > telnet localhost 7500<br>> > > > Trying 127.0.0.1...<br>> > > > Connected to localhost.localdomain
.<br>> > > > Escape character is '^]'.<br>> > > > GET <a href="http://81.171.121.30:7500/dev4/usage">http://81.171.121.30:7500/dev4/usage</a><br>> > > ><br>> > > > doesn't return anything..
<br>> > > ><br>> > > > This is my config:<br>> > > > cat /etc/mogilefs/mogstored.conf<br>> > > > httplisten = <a href="http://0.0.0.0:7500">0.0.0.0:7500</a><br>> > > > docroot = /var/mogdata
<br>> > > ><br>> > > > --<br>> > > ><br>> > > > cat /etc/mogilefs/mogilefsd.conf<br>> > > > daemonize = 1<br>> > > > db_dsn = DBI:mysql:mogilefs:host=
<a href="http://111.111.111.43">111.111.111.43</a><br>> > > > db_user = mogilefs<br>> > > > db_pass = PASSWD<br>> > > > conf_port = 7001<br>> > > > listener_jobs = 10<br>> > > > delete_jobs = 1
<br>> > > > replicate_jobs = 5<br>> > > > mog_root = /mnt/mogilefs<br>> > > > reaper_jobs = 1<br>> > > > # debug = 3<br>> > > ><br>> > > > any suggestions?
<br>> > > ><br>> > > > Thanks,<br>> > > ><br>> > > > Arnoud<br>> > > ><br>> > > > On 1/29/06, Brad Fitzpatrick <<a href="mailto:brad@danga.com">brad@danga.com
</a>> wrote:<br>> > > > ><br>> > > > > You have some port numbers wrong somewhere... the tracker doesn't<br>> > speak<br>> > > > > HTTP.<br>> > > > ><br>
> > > > > - Brad<br>> > > > ><br>> > > > ><br>> > > > > On Sat, 28 Jan 2006, Arnoud Vermeer wrote:<br>> > > > ><br>> > > > > > Hi guys,
<br>> > > > > ><br>> > > > > > I'm trying to setup a small test cluster of MogileFS, but I'm<br>> > running<br>> > > > > into a<br>> > > > > > problem.
<br>> > > > > > I've got 3 desktop PC's in the datacenter running Debian Sarge<br>> > > > > (installed<br>> > > > > > via netinstall)<br>> > > > > > 2 x 1200 Mhz intel with a single PATA 40 gb HD
<br>> > > > > > and a AMD 2400+ also with a PATA 40 gb HD.<br>> > > > > ><br>> > > > > > I've installed mogileFS just fine, first the .tar.gz release from<br>> > the
<br>> > > > > site,<br>> > > > > > but that one was running into problems with adding disks.<br>> > > > > > So I grabbed the latest CVS (28-jan-2006), but this one seems to
<br>> > run<br>> > > > > into<br>> > > > > > the same problems.<br>> > > > > ><br>> > > > > > mfs1 (1200Mhz+40GB HD) runs Perlbal, mogilefsd and mogstored
<br>> > > > > > mfs2 (2400Mhz+40GB HD) runs Perlbal, mogilefsd and mogstored<br>> > > > > > mfs3 (1200Mhz+40GB HD) just runs mogstored<br>> > > > > ><br>> > > > > > I've added the hosts and disks via the mogadm commandline, but
<br>> > when I<br>> > > > > run a:<br>> > > > > > mogadm -c /etc/mogilefs/mogadm.conf check<br>> > > > > ><br>> > > > > > I get the following result:
<br>> > > > > ><br>> > > > > > mogadm -c /etc/mogilefs/mogadm.conf check (IP's and domain<br>> > removed..)<br>> > > > > > Checking trackers...<br>> > > > > >
<a href="http://111.111.111.30:7001">111.111.111.30:7001</a> ... OK<br>> > > > > > <a href="http://111.111.111.31:7001">111.111.111.31:7001</a> ... OK<br>> > > > > ><br>> > > > > > Checking hosts...
<br>> > > > > > [ 1] mfs1.domain ... OK<br>> > > > > > [ 2] mfs2.domain ... OK<br>> > > > > > [ 3] mfs3.domain ... OK<br>> > > > > >
<br>> > > > > > Checking devices...<br>> > > > > > host device size(G) used(G) free(G)<br>> > use%<br>> > > > > > ---- --------------- ---------- ---------- ----------
<br>> > ------<br>> > > > > > [ 1] dev4 REQUEST FAILURE<br>> > > > > > [ 2] dev3 REQUEST FAILURE<br>> > > > > > [ 3] dev5 REQUEST FAILURE
<br>> > > > > > Illegal division by zero at /usr/bin/mogadm line 165,<br>> > > > > > <Sock_81.171.121.31:7001> line 2.<br>> > > > > ><br>> > > > > > So I looked into the source and found the command at line 165, and
<br>> > > > > gave this<br>> > > > > > via telnet onto the the tracker:<br>> > > > > ><br>> > > > > > telnet localhost 7001<br>> > > > > > Trying
127.0.0.1...<br>> > > > > > Connected to localhost.localdomain.<br>> > > > > > Escape character is '^]'.<br>> > > > > > GET <a href="http://81.171.121.30:7500/dev4/usage">
http://81.171.121.30:7500/dev4/usage</a><br>> > > > > > ERR unknown_command Unknown+server+command<br>> > > > > ><br>> > > > > > So now I'm stumped.<br>> > > > > >
<br>> > > > > > Does anybody have a clue?<br>> > > > > ><br>> > > > > > Thanks,<br>> > > > > ><br>> > > > > > Arnoud Vermeer<br>> > > > > > FreshWay Innovations
<br>> > > > > ><br>> > > > ><br>> > > ><br>> > > ><br>> > ><br>> ><br>><br></blockquote></div><br>