I was noticing this even before the 1.0.5 update right after I changed from heartbeat to openais. I assume there may be some files in that folder from back when I was using heartbeat which were causing the problem even with the older pacemaker version.

If I want to delete all files in /var/lib/pengine, which of the following options should I use:

1. Completely stop all nodes first, then remove the files on both nodes, then restart.

2. Stop one node at a time, delete files from /var/lib/pengine on that node then start the node again.

3. Simply delete /var/lib/pengine/* while crm and openais is running.

Thanks,

Diego


hj lee wrote:
Hi,

I had the same problem after upgrading to pacemaker 1.0.5 in RHLE 5.3. After deleting all the files in /var/lib/pengine/ directory, this problem seems gone, I haven't seen it so far. Maybe it is related the UID change in pengine(hacluster to daemon) in 1.0.5, but not exactly sure.

hj

On Fri, Aug 21, 2009 at 9:11 AM, Diego Remolina <diego.remol...@physics.gatech.edu <mailto:diego.remol...@physics.gatech.edu>> wrote:

    Here is what I am seeing now right after stopping openais, updating
    heartbeat and pacemaker and trying to start openais again:


    [r...@phys-file02 ~]# ps -ef | grep aisexec
    root     19423     1  0 11:01 pts/1    00:00:00 aisexec
    root     19520 19241  0 11:02 pts/1    00:00:00 grep aisexec
    [r...@phys-file02 ~]# gdb aisexec 19423
    GNU gdb Fedora (6.8-27.el5)
    Copyright (C) 2008 Free Software Foundation, Inc.
    License GPLv3+: GNU GPL version 3 or later
    <http://gnu.org/licenses/gpl.html>
    This is free software: you are free to change and redistribute it.
    There is NO WARRANTY, to the extent permitted by law.  Type "show
    copying"
    and "show warranty" for details.
    This GDB was configured as "x86_64-redhat-linux-gnu"...
    (no debugging symbols found)
    Attaching to program: /usr/sbin/aisexec, process 19423
    Reading symbols from /lib64/libdl.so.2...(no debugging symbols
    found)...done.
    Loaded symbols for /lib64/libdl.so.2
    Reading symbols from /lib64/libpthread.so.0...(no debugging symbols
    found)...done.
    [Thread debugging using libthread_db enabled]
    [New Thread 0x2ae946b8fec0 (LWP 19423)]
    [New Thread 0x40638fe0 (LWP 19425)]
    Loaded symbols for /lib64/libpthread.so.0
    Reading symbols from /lib64/libc.so.6...(no debugging symbols
    found)...done.
    Loaded symbols for /lib64/libc.so.6
    Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging
    symbols found)...done.
    Loaded symbols for /lib64/ld-linux-x86-64.so.2
    Reading symbols from /usr/libexec/lcrso/objdb.lcrso...done.
    Loaded symbols for /usr/libexec/lcrso/objdb.lcrso
    Reading symbols from /usr/libexec/lcrso/aisparser.lcrso...done.
    Loaded symbols for /usr/libexec/lcrso/aisparser.lcrso
    Reading symbols from /usr/libexec/lcrso/pacemaker.lcrso...done.
    Loaded symbols for /usr/libexec/lcrso/pacemaker.lcrso
    Reading symbols from /usr/lib64/libplumb.so.2...done.
    Loaded symbols for /usr/lib64/libplumb.so.2
    Reading symbols from /usr/lib64/libpils.so.2...done.
    Loaded symbols for /usr/lib64/libpils.so.2
    Reading symbols from /usr/lib64/libbz2.so.1...done.
    Loaded symbols for /usr/lib64/libbz2.so.1
    Reading symbols from /usr/lib64/libxslt.so.1...done.
    Loaded symbols for /usr/lib64/libxslt.so.1
    Reading symbols from /usr/lib64/libxml2.so.2...done.
    Loaded symbols for /usr/lib64/libxml2.so.2
    Reading symbols from /lib64/libuuid.so.1...done.
    Loaded symbols for /lib64/libuuid.so.1
    Reading symbols from /lib64/libpam.so.0...done.
    Loaded symbols for /lib64/libpam.so.0
    Reading symbols from /lib64/librt.so.1...done.
    Loaded symbols for /lib64/librt.so.1
    Reading symbols from /lib64/libglib-2.0.so.0...done.
    Loaded symbols for /lib64/libglib-2.0.so.0
    Reading symbols from /usr/lib64/libltdl.so.3...done.
    Loaded symbols for /usr/lib64/libltdl.so.3
    Reading symbols from /usr/lib64/libz.so.1...done.
    Loaded symbols for /usr/lib64/libz.so.1
    Reading symbols from /lib64/libm.so.6...done.
    Loaded symbols for /lib64/libm.so.6
    Reading symbols from /lib64/libaudit.so.0...done.
    Loaded symbols for /lib64/libaudit.so.0
    Reading symbols from /lib64/libgcc_s.so.1...done.
    Loaded symbols for /lib64/libgcc_s.so.1
    0x0000003be08dee5e in __lll_lock_wait_private () from /lib64/libc.so.6
    (gdb) where
    #0  0x0000003be08dee5e in __lll_lock_wait_private () from
    /lib64/libc.so.6
    #1  0x0000003be088c74d in _L_lock_1685 () from /lib64/libc.so.6
    #2  0x0000003be088c497 in __tz_convert () from /lib64/libc.so.6
    #3  0x0000000000418a16 in _log_printf ()
    #4  0x0000000000418cb1 in internal_log_printf2 ()
    #5  0x00002aaaab0b8819 in pcmk_plugin_init () from
    /usr/libexec/lcrso/pacemaker.lcrso
    #6  0x00002aaaab0b946a in pcmk_startup () from
    /usr/libexec/lcrso/pacemaker.lcrso
    #7  0x000000000041a422 in openais_service_link_and_init ()
    #8  0x000000000041a5c8 in openais_service_defaults_link_and_init ()
    #9  0x0000000000418117 in main ()
    (gdb) thread 0
    Thread ID 0 not known.
    (gdb) thread 1
    [Switching to thread 1 (Thread 0x2ae946b8fec0 (LWP 19423))]#0
    0x0000003be08dee5e in __lll_lock_wait_private () from /lib64/libc.so.6
    (gdb) where
    #0  0x0000003be08dee5e in __lll_lock_wait_private () from
    /lib64/libc.so.6
    #1  0x0000003be088c74d in _L_lock_1685 () from /lib64/libc.so.6
    #2  0x0000003be088c497 in __tz_convert () from /lib64/libc.so.6
    #3  0x0000000000418a16 in _log_printf ()
    #4  0x0000000000418cb1 in internal_log_printf2 ()
    #5  0x00002aaaab0b8819 in pcmk_plugin_init () from
    /usr/libexec/lcrso/pacemaker.lcrso
    #6  0x00002aaaab0b946a in pcmk_startup () from
    /usr/libexec/lcrso/pacemaker.lcrso
    #7  0x000000000041a422 in openais_service_link_and_init ()
    #8  0x000000000041a5c8 in openais_service_defaults_link_and_init ()
    #9  0x0000000000418117 in main ()
    (gdb) thread 3
    Thread ID 3 not known.
    (gdb) thread 4
    Thread ID 4 not known.
    (gdb) thread 5
    Thread ID 5 not known.
    (gdb) thread 6
    Thread ID 6 not known.



------------------------------------------------------------------------

_______________________________________________
Pacemaker mailing list
Pacemaker@oss.clusterlabs.org
http://oss.clusterlabs.org/mailman/listinfo/pacemaker

--
Diego Julian Remolina
System Administrator - Systems Support Specialist IV
School of Physics
Georgia Institute of Technology
Phone: (404) 385-3499

_______________________________________________
Pacemaker mailing list
Pacemaker@oss.clusterlabs.org
http://oss.clusterlabs.org/mailman/listinfo/pacemaker

Reply via email to