[uml-user] How to setup UML cluster and use ocfs2?
Hi all, I am new guy to Use Mode Linux and I am trying to use UML to build up a 2-node cluster and ocfs2 for share storage. I have created 2 nodes and a shared file, and run the two kernel with the following commands: ./linux mem=256M ubda=root_fs_1 ubdb=ocfs2_fs eth0=mcast ./linux mem=256M ubda=root_fs_2 ubdb=ocfs2_fs eth0=mcast I can mount the ocfs2_fs on node1, but when I mount it on node2, the error msg is: ubdb: Can't open "ocfs2_fs": errno = 11 mount.ocfs2: I/O error on channel while opening device /dev/ubdb1 I have searched the uml website, and it seems that "COW" don't meet my need, since I need to access the file at the same time by all the nodes. But "COW" only save the modified file in its own cow-file. Am I wrong? And Can anyone tell me how to setup a share disk which has direct read/write access for multiple nodes? btw, I don't subscribe to this mail list, so could you please reply directly to my e-mail? thanks. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ User-mode-linux-user mailing list User-mode-linux-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user
Re: [uml-user] How to setup UML cluster and use ocfs2?
On 6/21/07, Jeff Dike <[EMAIL PROTECTED]> wrote: On Thu, Jun 21, 2007 at 10:28:32AM +0800, Linux Lover wrote: > Hi all, >I am new guy to Use Mode Linux and I am trying to use UML to build up a > 2-node cluster and ocfs2 for share storage. > I have created 2 nodes and a shared file, and run the two kernel with the > following commands: > ./linux mem=256M ubda=root_fs_1 ubdb=ocfs2_fs eth0=mcast > ./linux mem=256M ubda=root_fs_2 ubdb=ocfs2_fs eth0=mcast Use ubdbc=ocfs2_fs The "c" stands for Cluster and was introduced for exactly this reason. That works. Cool! Thanks! - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ User-mode-linux-user mailing list User-mode-linux-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user
Re: [uml-user] How to setup UML cluster and use ocfs2?
Hi Jeff, This works well in kernel 2.6.21.6, but today when I tried 2.6.22, the client uml is freezed. So is there any problem in 2.6.22? Thanks. On 6/21/07, Jeff Dike <[EMAIL PROTECTED]> wrote: On Thu, Jun 21, 2007 at 10:28:32AM +0800, Linux Lover wrote: > Hi all, >I am new guy to Use Mode Linux and I am trying to use UML to build up a > 2-node cluster and ocfs2 for share storage. > I have created 2 nodes and a shared file, and run the two kernel with the > following commands: > ./linux mem=256M ubda=root_fs_1 ubdb=ocfs2_fs eth0=mcast > ./linux mem=256M ubda=root_fs_2 ubdb=ocfs2_fs eth0=mcast Use ubdbc=ocfs2_fs The "c" stands for Cluster and was introduced for exactly this reason. Jeff -- Work email - jdike at linux dot intel dot com - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ User-mode-linux-user mailing list User-mode-linux-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user
Re: [uml-user] How to setup UML cluster and use ocfs2?
On 7/16/07, Linux Lover <[EMAIL PROTECTED]> wrote: Hi Jeff, This works well in kernel 2.6.21.6, but today when I tried 2.6.22, the client uml is freezed. So is there any problem in 2.6.22? Let me say it a little clearly. Both nodes can start up. The first node can mount the ocfs2 volume right, but when the second node try to mount the ocfs2 volume also, it freezes. These two nodes work fine with the last released kernel of 21(2.6.21.6), so there should be some bug with the new 2.6.22.x series. Thanks. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ User-mode-linux-user mailing list User-mode-linux-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user
Re: [uml-user] How to setup UML cluster and use ocfs2?
On 7/16/07, Jeff Dike <[EMAIL PROTECTED]> wrote: On Mon, Jul 16, 2007 at 10:29:43AM +0800, Linux Lover wrote: > Let me say it a little clearly. > Both nodes can start up. > The first node can mount the ocfs2 volume right, but when the second node > try to mount the ocfs2 volume also, it freezes. > These two nodes work fine with the last released kernel of 21(2.6.21.6), so > there should be some bug with the new 2.6.22.x series. Can you check with 2.6.21? If that's OK, can you do a git bisect to figure out which change broke things? 2.6.21.6 is OK, so can I deduce that 2.6.21 is OK also? I am a newbie in kernel development, so sorry for the silly question. git bisect? OK, I will try to learn how to use git and git bisect. Wish I could output something helpful. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ User-mode-linux-user mailing list User-mode-linux-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user
Re: [uml-user] How to setup UML cluster and use ocfs2?
On 7/17/07, Jeff Dike <[EMAIL PROTECTED]> wrote: You downloaded 2.6.21.6 from kernel.org, right? Just get 2.6.21 the same way instead and try that. Yes, I have downloaded 2.6.21, and it works OK. git bisect? OK, I will try to learn how to use git and git bisect. Wish I > could output something helpful. Linus described how to do this here: http://groups.google.com/group/fa.linux.kernel/browse_thread/thread/af2a2d1151270a01/cdcaf2d55bb2f5e2?lnk=st&q=Linus+git-bisect+good&rnum=2&hl=en#cdcaf2d55bb2f5e2 Once you're you've got git going, git-bisect is a very simple, mechanical procedure. I have followed the step described by Linus. git clone git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6 *$git bisect **good* v2.6.21 *$git bisect* bad v2.6.22 $git bisect The output is: Bisecting: 3420 revisions left to test after this [58936d8d944e27b75c99b1c59cfeea3f253b03cb] Char: cyclades, create cy_pci_probe but when I do the following steps: $cp arch/um/defconfig .config $make menuconfig ARCH=um and select to build ocfs2 in kernel. $make linux ARCH=um The build is broken. The error message is: SYMLINK arch/um/include/kern_constants.h SYMLINK arch/um/include/sysdep make[1]: `arch/um/sys-i386/user-offsets.s' is up to date. CHK include/linux/version.h CHK include/linux/utsrelease.h CC arch/um/kernel/asm-offsets.s In file included from include/asm/cpufeature.h:4, from include/asm/arch/system.h:6, from include/asm/system-generic.h:4, from include/asm/system.h:4, from include/linux/spinlock.h:57, from include/linux/capability.h:45, from include/linux/sched.h:46, from arch/um/include/sysdep/kernel-offsets.h:2, from arch/um/kernel/asm-offsets.c:1: include/asm/arch/cpufeature.h:13:35: asm/required-features.h: No such file or directory make[1]: *** [arch/um/kernel/asm-offsets.s] Error 1 make: *** [prepare0] Error 2 So what is wrong with the build process? I did the same step with the package I downloaded from kernel.org, and it works OK. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ User-mode-linux-user mailing list User-mode-linux-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user
Re: [uml-user] How to setup UML cluster and use ocfs2?
You hit a point where UML doesn't build. This happens occasionally, and it's usually fixed pretty quickly. In this case, apply this patch to it - http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=commitdiff_plain;h=1e0cb0c3bf04850fa6fb300293d9e85ba81b605f The kernel builds OK, but when I run it, I meet with segmentation fault. After gdb, the error message is very strange. I have attached the frame. Any idea about it? (gdb) r mem=256M ubda=../../Ubuntu-FeistyFawn-i386-root_fs_2 ubdbc=../../ocfs2_fs eth0=mcast Starting program: /home/test/source/newest/linux-2.6/linux mem=256M ubda=../../Ubuntu-FeistyFawn-i386-root_fs_2 ubdbc=../../ocfs2_fs eth0=mcast Core dump limits : soft - 0 hard - NONE Checking that ptrace can change system call numbers...Detaching after fork from child process 14952. OK Checking syscall emulation patch for ptrace...Detaching after fork from child process 14953. missing Checking for tmpfs mount on /dev/shm...OK Checking PROT_EXEC mmap in /dev/shm/...OK Checking for the skas3 patch in the host: - /proc/mm...not found: No such file or directory - PTRACE_FAULTINFO...Detaching after fork from child process 14954. not found - PTRACE_LDT...Detaching after fork from child process 14955. not found UML running in SKAS0 mode Detaching after fork from child process 14956. Detaching after fork from child process 14957. Program received signal SIGSEGV, Segmentation fault. create_dir (k=0x8252b2c, p=0x16d, n=0x8252b30 "logmask", d=0x87cfe6c) at fs/sysfs/dir.c:156 156 mutex_lock(&p->d_inode->i_mutex); (gdb) bt #0 create_dir (k=0x8252b2c, p=0x16d, n=0x8252b30 "logmask", d=0x87cfe6c) at fs/sysfs/dir.c:156 #1 0x080d70d6 in sysfs_create_dir (kobj=0x8252b2c, shadow_parent=0x0) at include/linux/kobject.h:66 #2 0x081662da in create_dir (kobj=0x8252b2c, shadow_parent=0x0) at lib/kobject.c:51 #3 0x081664d0 in kobject_shadow_add (kobj=0x8252b2c, shadow_parent=0x0) at lib/kobject.c:197 #4 0x08166527 in kobject_add (kobj=0x8252b2c) at lib/kobject.c:224 #5 0x081669ba in kset_add (k=0x8252b20) at lib/kobject.c:589 #6 0x081669d8 in kset_register (k=0x8252b20) at lib/kobject.c:603 #7 0x08132439 in mlog_sys_init (o2cb_subsys=0x8252bc0) at fs/ocfs2/cluster/masklog.c:161 #8 0x08132501 in o2cb_sys_init () at fs/ocfs2/cluster/sys.c:119 #9 0x0804f76f in init_o2nm () at fs/ocfs2/cluster/nodemanager.c:944 Previous frame inner to this frame (corrupt stack?) - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ User-mode-linux-user mailing list User-mode-linux-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user
Re: [uml-user] How to setup UML cluster and use ocfs2?
Sorry for the late response. I let this be a bug. And do "git bisect bad". But when I try to build another version, it fails. So I may hit another point that UML can't build. ;) arch/um/os-Linux/aio.c: In function 'do_aio': arch/um/os-Linux/aio.c:80: error: unknown field 'aio_reserved3' specified in initializer make[1]: *** [arch/um/os-Linux/aio.o] Error 1 make: *** [arch/um/os-Linux] Error 2 The last commit log is: [d6454706c382ab74e2ecad7803c434cc6bd30343] Merge branch 'for-linus' of master.kernel.org:/pub/scm/linux/kernel/git/jikos/hid So which patch should I patch? On 7/26/07, Jeff Dike <[EMAIL PROTECTED]> wrote: > > On Wed, Jul 18, 2007 at 02:50:31PM +0800, Linux Lover wrote: > > The kernel builds OK, but when I run it, I meet with segmentation fault. > > After gdb, the error message is very strange. > > I have attached the frame. Any idea about it? > > > > #4 0x08166527 in kobject_add (kobj=0x8252b2c) at lib/kobject.c:224 > > #5 0x081669ba in kset_add (k=0x8252b20) at lib/kobject.c:589 > > #6 0x081669d8 in kset_register (k=0x8252b20) at lib/kobject.c:603 > > #7 0x08132439 in mlog_sys_init (o2cb_subsys=0x8252bc0) at > > fs/ocfs2/cluster/masklog.c:161 > > #8 0x08132501 in o2cb_sys_init () at fs/ocfs2/cluster/sys.c:119 > > #9 0x0804f76f in init_o2nm () at fs/ocfs2/cluster/nodemanager.c:944 > > There's ocfs2 all over this, so it looks like that's an ocfs2 bug. > > git-bisect isn't working too well here. You might try finding a later > commit in which ocfs2 is working again and using that as your starting > point. > > Jeff > > -- > Work email - jdike at linux dot intel dot com > - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/___ User-mode-linux-user mailing list User-mode-linux-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user
Re: [uml-user] How to setup UML cluster and use ocfs2?
Hi Jeff, It seems that aio_reserved3 was removed from (struct iocb).. So I just removing it from the initialization code in uml. Am I wrong? ;) On 7/30/07, Linux Lover <[EMAIL PROTECTED]> wrote: > > Sorry for the late response. > I let this be a bug. And do "git bisect bad". > But when I try to build another version, it fails. So I may hit another > point that UML can't build. ;) > arch/um/os-Linux/aio.c: In function 'do_aio': > arch/um/os-Linux/aio.c:80: error: unknown field 'aio_reserved3' specified > in initializer > make[1]: *** [arch/um/os-Linux/aio.o] Error 1 > make: *** [arch/um/os-Linux] Error 2 > > The last commit log is: > [d6454706c382ab74e2ecad7803c434cc6bd30343] Merge branch 'for-linus' of > master.kernel.org:/pub/scm/linux/kernel/git/jikos/hid > > So which patch should I patch? > > > On 7/26/07, Jeff Dike < [EMAIL PROTECTED]> wrote: > > > > On Wed, Jul 18, 2007 at 02:50:31PM +0800, Linux Lover wrote: > > > The kernel builds OK, but when I run it, I meet with segmentation > > fault. > > > After gdb, the error message is very strange. > > > I have attached the frame. Any idea about it? > > > > > > #4 0x08166527 in kobject_add (kobj=0x8252b2c) at lib/kobject.c:224 > > > #5 0x081669ba in kset_add (k=0x8252b20) at lib/kobject.c:589 > > > #6 0x081669d8 in kset_register (k=0x8252b20) at lib/kobject.c:603 > > > #7 0x08132439 in mlog_sys_init (o2cb_subsys=0x8252bc0) at > > > fs/ocfs2/cluster/masklog.c:161 > > > #8 0x08132501 in o2cb_sys_init () at fs/ocfs2/cluster/sys.c:119 > > > #9 0x0804f76f in init_o2nm () at fs/ocfs2/cluster/nodemanager.c:944 > > > > There's ocfs2 all over this, so it looks like that's an ocfs2 bug. > > > > git-bisect isn't working too well here. You might try finding a later > > commit in which ocfs2 is working again and using that as your starting > > point. > > > > Jeff > > > > -- > > Work email - jdike at linux dot intel dot com > > > > - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/___ User-mode-linux-user mailing list User-mode-linux-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user
