On Saturday 19 December 2020 09:42:55 Nathan Stratton Treadway wrote:
> On Sat, Dec 19, 2020 at 03:32:07 -0500, Gene Heskett wrote:
> > But the problem is not fixed:
>
> Well, at least this time it's a one-part dump file, so that may make
> investigation at little easier....
>
> > FAILURE DUMP SUMMARY:
> > rpi4 /usr/lib lev 0 partial taper: source server crc
> > (efe0c707:1538583893) and input server crc (fa79e777:1538583893)
> > differ)
> > rpi4 /usr/lib lev 0 was successfully retried
> >
> > But the failed dump is still in the holding disk:
> >
> > root@coyote:config-bak$ ls -l /sdb/dumps/20201219020104/
> > total 1502560
> > -rw------- 1 amanda amanda 1538616661 Dec 19 02:13 rpi4._usr_lib.0
> >
> > >From the emailed report:
> >
> > driver: rpi4 /usr/lib 20201219020104 0 [Will retry dump because of
> > holding disk error: source server crc (efe0c707:1538583893) and
> > input server crc (fa79e777:1538583893) differ)] taper: tape
> > Dailys-24 kb 16495500 fm 79 [OK]
> >
> > and:
> > rpi4 /usr/lib 0 3273 1467 -- 5:23 10366.4 0:01 1502523.0 PARTIAL
> > FLUSH 5:11 4831.3
> >
> > Even the sizes don't match so of course the crc's won't either.
>
> Note that the two sizes mentioned in the error message do match
> (1538583893), so I think the full file is getting transfered.
>
> (The file on the holding disk is 32kiB larger, i.e. the size of the
> Amanda header: 1538616661-1538583893=32768 .)
>
>
> What's the header of that holding-disk file look like? (e.g.
> $ sudo dd if=/sdb/dumps/20201219020104/rpi4._usr_lib.0 bs=32k
> count=1 )
new error file, from /home on GO704:(word wrap off)
dd if=/sdb/dumps/20201219085654/GO704._home.0 bs=32k count=1
AMANDA: FILE 20201219085654 GO704 /home lev 0 comp .gz program APPLICATION
APPLICATION=amgtar
ORIGSIZE=7322300
SERVER-CRC=adcf8473:2018270728
DLE=<<ENDDLE
<dle>
<program>APPLICATION</program>
<disk>/home</disk>
<level>0</level>
<auth>bsdtcp</auth>
<compress>BEST</compress>
<record>YES</record>
<index>YES</index>
<datapath>AMANDA</datapath>
<exclude>
<list>/GenesAmandaHelper-0.61/excludes</list>
</exclude>
<backup-program>
<plugin>amgtar</plugin>
<property>
<name>ignore</name>
<value encoding="raw"
raw="OiBzb2NrZXQgaWdub3JlZCQ=">:_socket_ignored$</value> <value
encoding="raw"
raw="ZmlsZSBjaGFuZ2VkIGFzIHdlIHJlYWQgaXQk">file_changed_as_we_read_it$</value>
</property>
<property>
<name>one-file-system</name>
<value>yes</value>
</property>
<property>
<name>check-device</name>
<value>no</value>
</property>
</backup-program>
</dle>
ENDDLE
To restore, position tape at start of file and run:
dd if=<tape> skip=1 | /bin/gzip -dc |
/usr/lib/amanda/application/amgtar restore [./file-to-restore]+
That's a different error and that machines background activity may have
caused apt-get to refresh its list of available updates at about that
time of the morning. That however, should not have affetcted /home.
There was no other commanded activity at the time although I do have
an ssh session open to all machines from this machine full time, and
they are all mounted here via sshnet. Beats nfs like a
white nosed mule since it Just Works.
>
> Do you get any hits when you grep the Amanda debug and log files for
> those two CRC values ( efe0c707 and fa79e777 )?
New crc's
root@coyote:GenesAmandaHelper-0.61$ grep adcf8473:2018270728
/usr/local/var/amanda/Daily/*
/usr/local/var/amanda/Daily/amdump.1:driver: result time 2044.439 from
chunker3: DONE 03-00051
1970967 "adcf8473:2018270728" "[sec 1253.143125 kb 1970967 kps 1572.818747]"
/usr/local/var/amanda/Daily/amdump.1:driver: result time 2045.654 from taper0:
PARTIAL worker0-0 02-00088 INPUT-ERROR
TAPE-GOOD "1452994d:2018270728" "[sec 1.000000 bytes 2018270728 kps
1970967.000000 orig-kb 7322300]" "source server crc
(1452994d:2018270728) and input server crc (adcf8473:2018270728) differ)" ""
/usr/local/var/amanda/Daily/amdump.1:driver: taper failed GO704 /home: source
server crc (1452994d:2018270728) and input
server crc (adcf8473:2018270728) differ)
/usr/local/var/amanda/Daily/amdump.20201219085654:driver: result time 2044.439
from chunker3: DONE 03-00051
1970967 "adcf8473:2018270728" "[sec 1253.143125 kb 1970967 kps 1572.818747]"
/usr/local/var/amanda/Daily/amdump.20201219085654:driver: result time 2045.654
from taper0: PARTIAL worker0-0 02-00088
INPUT-ERROR TAPE-GOOD "1452994d:2018270728" "[sec 1.000000 bytes 2018270728 kps
1970967.000000 orig-kb 7322300]" "source
server crc (1452994d:2018270728) and input server crc (adcf8473:2018270728)
differ)" ""
/usr/local/var/amanda/Daily/amdump.20201219085654:driver: taper failed GO704
/home: source server crc
(1452994d:2018270728) and input server crc (adcf8473:2018270728) differ)
grep: /usr/local/var/amanda/Daily/curinfo: Is a directory
grep: /usr/local/var/amanda/Daily/gnutar-lists: Is a directory
grep: /usr/local/var/amanda/Daily/index: Is a directory
/usr/local/var/amanda/Daily/log:SUCCESS chunker GO704 /home 20201219085654 0
adcf8473:2018270728 [sec 1253.143125 kb
1970967 kps 1572.818747]
/usr/local/var/amanda/Daily/log:PARTIAL taper "ST:Daily" "POOL:Daily" GO704
/home 20201219085654 1 0 00000000:0
00000000:0 adcf8473:2018270728 [sec 1.000000 bytes 2018270728 kps
1970967.000000 orig-kb 7322300] "source server crc
(1452994d:2018270728) and input server crc (adcf8473:2018270728) differ)"
/usr/local/var/amanda/Daily/log:INFO driver GO704 /home 20201219085654 0 [Will
retry dump because of holding disk error:
source server crc (1452994d:2018270728) and input server crc
(adcf8473:2018270728) differ)]
/usr/local/var/amanda/Daily/log.20201219085654.0:SUCCESS chunker GO704 /home
20201219085654 0 adcf8473:2018270728 [sec
1253.143125 kb 1970967 kps 1572.818747]
/usr/local/var/amanda/Daily/log.20201219085654.0:PARTIAL taper "ST:Daily"
"POOL:Daily" GO704 /home 20201219085654 1 0
00000000:0 00000000:0 adcf8473:2018270728 [sec 1.000000 bytes 2018270728 kps
1970967.000000 orig-kb 7322300] "source
server crc (1452994d:2018270728) and input server crc (adcf8473:2018270728)
differ)"
/usr/local/var/amanda/Daily/log.20201219085654.0:INFO driver GO704 /home
20201219085654 0 [Will retry dump because of
holding disk error: source server crc (1452994d:2018270728) and input server
crc (adcf8473:2018270728) differ)]
grep: /usr/local/var/amanda/Daily/oldlog: Is a directory
Good luck wading thru all THAT!
Thanks. >
> Nathan
>
>
>
> ----------------------------------------------------------------------
>------ Nathan Stratton Treadway - [email protected] - Mid-Atlantic
> region Ray Ontko & Co. - Software consulting services -
> http://www.ontko.com/ GPG Key:
> http://www.ontko.com/~nathanst/gpg_key.txt ID: 1023D/ECFB6239 Key
> fingerprint = 6AD8 485E 20B9 5C71 231C 0C32 15F3 ADCD ECFB 6239
Copyright 2019 by Maurice E. Heskett
Cheers, Gene Heskett
--
"There are four boxes to be used in defense of liberty:
soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
- Louis D. Brandeis
Genes Web page <http://geneslinuxbox.net:6309/gene>
