Hi all,
recently we updated our backup server from Debian 8 to Debian 9 with
Bacula release 7.4.4+dfsg-6. After a few days we experienced some
crashes of the Storage Daemon during the backup runs. When Bacula is
idle no crash happens.
The log showed this:
Aug 26 06:03:15 s110180 bacula-sd[9035]: s110180-sd: dircmd.c:162-0
Connection request from client failed.
Aug 26 06:04:15 s110180 bacula-sd[9035]: s110180-sd: dircmd.c:162-0
Connection request from client failed.
Aug 26 06:05:15 s110180 bacula-sd[9035]: s110180-sd: dircmd.c:162-0
Connection request from client failed.
Aug 26 06:05:40 s110180 bacula-sd[9035]: Bacula interrupted by signal
11: Segmentation violation
Aug 26 06:05:40 s110180 bacula-sd[9035]: Kaboom! bacula-sd, s110180-sd
got signal 11 - Segmentation violation at 26-Aug-2017 06:05:40.
Attempting traceback.
Aug 26 06:05:40 s110180 bacula-sd[9035]: Kaboom! exepath=/usr/sbin/
Aug 26 06:05:40 s110180 bacula-sd[9035]: Bacula interrupted by signal
11: Segmentation violation
Aug 26 06:05:40 s110180 bacula-sd[9035]: Calling: /usr/sbin/btraceback
/usr/sbin/bacula-sd 9035 /var/lib/bacula
Aug 26 06:05:40 s110180 systemd[1]: bacula-sd.service: Main process
exited, code=exited, status=1/FAILURE
Aug 26 06:05:40 s110180 systemd[1]: bacula-sd.service: Unit entered
failed state.
Aug 26 06:05:40 s110180 systemd[1]: bacula-sd.service: Failed with
result 'exit-code'.
Also I enabled btraceback with this result:
[New LWP 6596]
[New LWP 6617]
[New LWP 6622]
[New LWP 6625]
[New LWP 6723]
[Thread debugging using libthread_db enabled] Using host libthread_db
library "/lib/x86_64-linux-gnu/libthread_db.so.1".
0x00007fb00e1e43f3 in select () at ../sysdeps/unix/syscall-template.S:84
84 ../sysdeps/unix/syscall-template.S: No such file or directory.
$1 = 1093482802
$2 = 808530291
$3 = 994335848
$4 = 994335912
$5 = 0
$6 = 0
$7 = 264805061
$8 = 264805030
$9 = 264805023
$10 = 264805057
$11 = 808530291
$12 = 264805050
Environment variable "TestName" not defined.
#0 0x00007fb00e1e43f3 in select () at
../sysdeps/unix/syscall-template.S:84
#1 0x00007fb00fc561ca in bnet_thread_server(dlist*, int, workq_tag*,
void* (*)(void*)) () from /usr/lib/bacula/libbac-7.4.4.so
#2 0x0000557a39cd8a84 in ?? ()
#3 0x00007fb00e1232b1 in __libc_start_main (main=0x557a39cd8130,
argc=4, argv=0x7ffde08270e8, init=<optimized out>, fini=<optimized out>,
rtld_fini=<optimized out>, stack_end=0x7ffde08270d8) at
../csu/libc-start.c:291
#4 0x0000557a39cd8dba in ?? ()
Thread 6 (Thread 0x7fb0077fe700 (LWP 6723)):
#0 0x00007fb00fa30b3a in __waitpid (pid=6731, stat_loc=0x7fb0077fd0ac,
options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:29
#1 0x00007fb00fc74f7e in signal_handler () from
/usr/lib/bacula/libbac-7.4.4.so
#2 <signal handler called>
#3 0x00007fb00fc77c69 in new_tls_connection(TLS_Context*, int) () from
/usr/lib/bacula/libbac-7.4.4.so
#4 0x00007fb00fc54e4d in bnet_tls_server(TLS_Context*, BSOCK*, alist*)
() from /usr/lib/bacula/libbac-7.4.4.so
#5 0x0000557a39ce6ae9 in ?? ()
#6 0x0000557a39cfc2df in ?? ()
#7 0x0000557a39cf9890 in ?? ()
#8 0x00007fb00fc7fd02 in workq_server () from
/usr/lib/bacula/libbac-7.4.4.so
#9 0x00007fb00fa27494 in start_thread (arg=0x7fb0077fe700) at
pthread_create.c:333
#10 0x00007fb00e1ebaff in clone () at
../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 5 (Thread 0x7fb007fff700 (LWP 6625)):
#0 pthread_cond_timedwait@@GLIBC_2.3.2 () at
../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
#1 0x0000557a39cfb530 in ?? ()
#2 0x0000557a39cf9a4f in ?? ()
#3 0x00007fb00fc7fd02 in workq_server () from
/usr/lib/bacula/libbac-7.4.4.so
#4 0x00007fb00fa27494 in start_thread (arg=0x7fb007fff700) at
pthread_create.c:333
#5 0x00007fb00e1ebaff in clone () at
../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 4 (Thread 0x7fb00c9bb700 (LWP 6622)):
#0 0x00007fb00fa3020d in read () at
../sysdeps/unix/syscall-template.S:84
#1 0x00007fb00fc54ad7 in read_nbytes(BSOCK*, char*, int) () from
/usr/lib/bacula/libbac-7.4.4.so
#2 0x00007fb00fc5827f in BSOCK::recv() () from
/usr/lib/bacula/libbac-7.4.4.so
#3 0x00007fb00fc5443c in bget_msg(BSOCK*) () from
/usr/lib/bacula/libbac-7.4.4.so
#4 0x00007fb00fc54793 in GetMsg::bget_msg(bmessage**) () from
/usr/lib/bacula/libbac-7.4.4.so
#5 0x0000557a39ce2e7b in ?? ()
#6 0x0000557a39cf9f8b in ?? ()
#7 0x0000557a39cfa530 in ?? ()
#8 0x0000557a39cfa76f in ?? ()
#9 0x0000557a39cfb350 in ?? ()
#10 0x0000557a39cf9a4f in ?? ()
#11 0x00007fb00fc7fd02 in workq_server () from
/usr/lib/bacula/libbac-7.4.4.so
#12 0x00007fb00fa27494 in start_thread (arg=0x7fb00c9bb700) at
pthread_create.c:333
#13 0x00007fb00e1ebaff in clone () at
../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 3 (Thread 0x7fb00dbcf700 (LWP 6617)):
#0 0x00007fb00fa3020d in read () at
../sysdeps/unix/syscall-template.S:84
#1 0x00007fb00fc54ad7 in read_nbytes(BSOCK*, char*, int) () from
/usr/lib/bacula/libbac-7.4.4.so
#2 0x00007fb00fc584a5 in BSOCK::recv() () from
/usr/lib/bacula/libbac-7.4.4.so
#3 0x00007fb00fc5443c in bget_msg(BSOCK*) () from
/usr/lib/bacula/libbac-7.4.4.so
#4 0x00007fb00fc54793 in GetMsg::bget_msg(bmessage**) () from
/usr/lib/bacula/libbac-7.4.4.so
#5 0x0000557a39ce2f14 in ?? ()
#6 0x0000557a39cf9f8b in ?? ()
#7 0x0000557a39cfa530 in ?? ()
#8 0x0000557a39cfa76f in ?? ()
#9 0x0000557a39cfb350 in ?? ()
#10 0x0000557a39cf9a4f in ?? ()
#11 0x00007fb00fc7fd02 in workq_server () from
/usr/lib/bacula/libbac-7.4.4.so
#12 0x00007fb00fa27494 in start_thread (arg=0x7fb00dbcf700) at
pthread_create.c:333
#13 0x00007fb00e1ebaff in clone () at
../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 2 (Thread 0x7fb00d3ce700 (LWP 6596)):
#0 pthread_cond_timedwait@@GLIBC_2.3.2 () at
../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
#1 0x00007fb00fc7f361 in watchdog_thread () from
/usr/lib/bacula/libbac-7.4.4.so
#2 0x00007fb00fa27494 in start_thread (arg=0x7fb00d3ce700) at
pthread_create.c:333
#3 0x00007fb00e1ebaff in clone () at
../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 1 (Thread 0x7fb0104d3680 (LWP 6594)):
#0 0x00007fb00e1e43f3 in select () at
../sysdeps/unix/syscall-template.S:84
#1 0x00007fb00fc561ca in bnet_thread_server(dlist*, int, workq_tag*,
void* (*)(void*)) () from /usr/lib/bacula/libbac-7.4.4.so
#2 0x0000557a39cd8a84 in ?? ()
#3 0x00007fb00e1232b1 in __libc_start_main (main=0x557a39cd8130,
argc=4, argv=0x7ffde08270e8, init=<optimized out>, fini=<optimized out>,
rtld_fini=<optimized out>, stack_end=0x7ffde08270d8) at
../csu/libc-start.c:291
#4 0x0000557a39cd8dba in ?? ()
#0 0x00007fb00e1e43f3 in select () at
../sysdeps/unix/syscall-template.S:84
84 in ../sysdeps/unix/syscall-template.S
No locals.
#1 0x00007fb00fc561ca in bnet_thread_server(dlist*, int, workq_tag*,
void* (*)(void*)) () from /usr/lib/bacula/libbac-7.4.4.so No symbol
table info available.
#2 0x0000557a39cd8a84 in ?? ()
No symbol table info available.
#3 0x00007fb00e1232b1 in __libc_start_main (main=0x557a39cd8130,
argc=4, argv=0x7ffde08270e8, init=<optimized out>, fini=<optimized out>,
rtld_fini=<optimized out>, stack_end=0x7ffde08270d8) at
../csu/libc-start.c:291
291 ../csu/libc-start.c: No such file or directory.
result = <optimized out>
unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, 1171193144337334840,
93983444143504, 140728370098400, 0, 0, 4994310920361050680,
5031794510901510712}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0,
0x7ffde0827110, 0x7fb0104e7170}, data = {prev = 0x0, cleanup = 0x0,
canceltype = -528322288}}} not_first_call = <optimized out>
#4 0x0000557a39cd8dba in ?? ()
No symbol table info available.
#0 0x0000000000000000 in ?? ()
No symbol table info available.
#0 0x0000000000000000 in ?? ()
No symbol table info available.
#0 0x0000000000000000 in ?? ()
No symbol table info available.
We never had such a problem before the upgrade, so we are wondering what
could be the reason for that.
Regards, Christian Garling
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
