Re: [Bacula-users] Issue with second writing to tape

Thu, 03 Dec 2015 06:31:25 -0800 

Hi,
After replacing drive and bought new tapes, the backup using tar succeed ok, 
the btape test also succeeded ok.
but when I use btape fill test it stops after 20GB claiming end of tape, this is the error/message 





Wrote block=300000, file,blk=20,5499 VolBytes=19,353,535,488 rate=18.53  
MB/s
Wrote block=305000, file,blk=20,10499 VolBytes=19,676,095,488 rate=18.15  
MB/s

14:40:30 Flush block, write EOF

Wrote block=310000, file,blk=20,15499 VolBytes=19,998,655,488 rate=17.79  
MB/s
Wrote block=315000, file,blk=21,4999 VolBytes=20,321,215,488 rate=17.35  
MB/s
Wrote block=320000, file,blk=21,9999 VolBytes=20,643,775,488 rate=17.04  
MB/s
Wrote block=325000, file,blk=21,14999 VolBytes=20,966,335,488 rate=16.74  
MB/s
Wrote block=330000, file,blk=22,4499 VolBytes=21,288,895,488 rate=16.56  
MB/s
Wrote block=335000, file,blk=22,9499 VolBytes=21,611,455,488 rate=16.22  
MB/s

14:44:39 Flush block, write EOF

29-Nov 14:44 btape JobId 0: End of Volume "TestVolume1" at 22:11901 on  
device "DTL01" (/dev/nst0). Write of 64512 bytes got -1.

29-Nov 14:46 btape JobId 0: Re-read of last block succeeded.
btape: btape.c:2712 Last block at: 22:11900 this_dev_block_num=11901

btape: btape.c:2747 End of tape 22:0. Volume Bytes=21,766,413,312. Write  
rate = 15.04 MB/s

btape: btape.c:2318 Wrote 1000 blocks on second tape. Done.
Done writing 0 records ...

btape: btape.c:2387 Wrote state file last_block_num1=11900  
last_block_num2=0

btape: btape.c:2402

14:46:32 Done filling tape at 22:0. Now beginning re-read of tape ...
btape: btape.c:2483 Enter do_unfill

29-Nov 14:48 btape JobId 0: Ready to read from volume "TestVolume1" on  
device "DTL01" (/dev/nst0).

Rewinding.
Reading the first 10000 records from 0:0.

29-Nov 14:55 btape JobId 0: Error: block.c:1001 Read error on fd=3 at  
file:blk 1:0 on device "DTL01" (/dev/nst0). ERR=Input/output error.
29-Nov 14:55 btape JobId 0: End of Volume at file 1 on device "DTL01"  
(/dev/nst0), Volume "TestVolume1"

btape: btape.c:3094 End of Volume "TestVolume1" 1 records.
Read block=0, VolBytes=0 rate=0 B/s

29-Nov 14:55 btape JobId 0: 3307 Issuing autochanger "unload slot 1, drive  
0" command.
29-Nov 14:56 btape JobId 0: 3304 Issuing autochanger "load slot 2, drive  
0" command.
29-Nov 14:57 btape JobId 0: 3305 Autochanger "load slot 2, drive 0",  
status is OK.
29-Nov 14:57 btape JobId 0: Warning: acquire.c:280 Read acquire: Could not  
unserialize Volume label: ERR=label.c:784 Expecting Volume Label, got FI=0  
Stream=0 len=64412



29-Nov 14:58 btape JobId 0: Warning: acquire.c:280 Read acquire: Could not  
unserialize Volume label: ERR=label.c:784 Expecting Volume Label, got FI=0  
Stream=0 len=64412


label.c:784 Expecting Volume Label, got FI=0 Stream=0 len=64412

Mount second Volume on device "DTL01" (/dev/nst0) and press return when  
ready: 29-Nov 14:58 btape JobId 0: Warning: acquire.c:280 Read acquire:  
Could not unserialize Volume label:

ERR=label.c:784 Expecting Volume Label, got FI=0 Stream=0 len=64412






I see there is also read error but I currently want to fix the write cause  
it weird issue and not the first time that occurs(always stops after  
around 20GB, 1-2 hours).

this is my bacula-sd.conf

Storage {
Name = bacula-sd
SDPort = 9103
WorkingDirectory = "/var/lib/bacula"
Pid Directory = "/var/run/bacula"
Maximum Concurrent Jobs = 20
SDAddress = 192.168.0.70
}

Director {
Name = bacula-dir
Password = "f64ydhwsxsfu62iu83d22"
}

Device {
Name = "DTL01"
Description = "HPTapeLibrary - first drive"
Media Type = LTO-5
Archive Device = /dev/nst0

Autochanger = yes
Drive Index = 0

# Hardware End of Medium = no
# BSF at EOM = no
# Backward Space Record = no
# Fast Forward Space File = no
# TWO EOF = no

Spool Directory = /home/bacula/spooling-lib
Maximum Spool Size = 11759496889
Maximum Job Spool Size = 11759496889 # 10GB
# AlwaysOpen = no
# Random access = no

# Minimum Block Size = 262144
# Maximum Block Size = 262144
}

Autochanger {
Name = MSL2024
Device = "DTL01"
# Device = Drive-2
Description = "HP MSL024."
Changer Device = /dev/sg4
Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d"
}

thank you!
Roi



On Tue, 29 Sep 2015 13:09:00 +0300, Radosław Korzeniewski  
<rados...@korzeniewski.net> wrote:



Hello,


Again: Did you tested your tape drive with btape utility? For me it is a  
misconfigured storage device.


best regards

2015-09-24 19:54 GMT+02:00 ADCD Support <adcd...@gmail.com>:

I use 64bits system.

I tried with other version of file daemon but still the same, stopped  
after 20GB



24-Sep 18:46 buffer-bacula-sd JobId 121: Fatal error: Unable to write  
EOF. ERR=dev.c:1551 ioctl MTWEOF error on >>"DTL01" (/dev/nst0).  
ERR=Input/output error.



24-Sep 18:46 buffer-bacula-sd JobId 121: Error: Error writing final EOF  
to tape. This Volume may not be readable.
dev.c:1551 ioctl MTWEOF error on "DTL01" (/dev/nst0). ERR=Input/output  
error.
24-Sep 18:46 buffer-bacula-sd JobId 121: Job write elapsed time =  
03:19:49, Transfer rate = 1.666 M Bytes/second
24-Sep 18:49 cow-fd JobId 121: Error:  
/home/kern/bacula/k/bacula/src/lib/bsock.c:389 Write error sending  
65536 bytes >>to Storage daemon:192.168.0.70:9103: ERR=Input/output  
error
24-Sep 18:49 cow-fd JobId 121: Fatal error:  
/home/kern/bacula/k/bacula/src/filed/backup.c:1144 Network send error  
to >>SD. ERR=Input/output error
24-Sep 18:49 cow-fd JobId 121: VSS Writer (BackupComplete): "System  
Writer", State: 0x1 (VSS_WS_STABLE)
24-Sep 18:49 cow-fd JobId 121: VSS Writer (BackupComplete):  
"MSDEWriter", State: 0x1 (VSS_WS_STABLE)
24-Sep 18:49 cow-fd JobId 121: VSS Writer (BackupComplete): "IIS  
Metabase Writer", State: 0x1 (VSS_WS_STABLE)
24-Sep 18:49 cow-fd JobId 121: VSS Writer (BackupComplete): "Registry  
Writer", State: 0x1 (VSS_WS_STABLE)
24-Sep 18:49 cow-fd JobId 121: VSS Writer (BackupComplete): "COM+ REGDB  
Writer", State: 0x1 (VSS_WS_STABLE)
24-Sep 18:49 cow-fd JobId 121: VSS Writer (BackupComplete): "Event Log  
Writer", State: 0x1 (VSS_WS_STABLE)
24-Sep 18:49 cow-fd JobId 121: VSS Writer (BackupComplete): "WMI  
Writer", State: 0x1 (VSS_WS_STABLE)
24-Sep 18:48 buffer-bacula-dir JobId 121: Error: Bacula  
buffer-bacula-dir 5.2.5 (26Jan12):

Build OS: x86_64-pc-linux-gnu ubuntu 12.04
JobId: 121
Job: cow-bj.2015-09-24_15.26.32_04
Backup Level: Full

Client: "cow" 5.2.1 (30Oct11) Microsoft Windows Home ServerStandard  
Edition Service Pack 2 (build 3790),Cross->>compile,Win32

FileSet: "cow" 2015-09-07 02:00:04
Pool: "Main" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "HPTapeLibrary" (From Job resource)
Scheduled time: 24-Sep-2015 15:26:29
Start time: 24-Sep-2015 15:26:34
End time: 24-Sep-2015 18:48:16
Elapsed time: 3 hours 21 mins 42 secs
Priority: 10
FD Files Written: 186,596
SD Files Written: 186,596
FD Bytes Written: 19,947,109,995 (19.94 GB)
SD Bytes Written: 19,980,349,784 (19.98 GB)
Rate: 1648.2 KB/s
Software Compression: None
VSS: yes
Encryption: no
Accurate: no
Volume name(s): TAPE05L5
Volume Session Id: 1
Volume Session Time: 1443100511
Last Volume Bytes: 19,998,720,000 (19.99 GB)
Non-fatal FD errors: 1
SD Errors: 2
FD termination status: Error
SD termination status: Error
Termination: *** Backup Error ***


On Tue, 22 Sep 2015 20:17:07 +0300, Ana Emília M. Arruda  
<emiliaarr...@gmail.com> wrote:



Hello,

The recommendation for Bacula versions are:

director = storage daemon >= file daemon


It seems you have your director and storage daemon running 5.2.5  
version and client running 5.2.10. Also, is your system 32 or >>>64  
bits?


Best regards,
Ana


On Tue, Sep 22, 2015 at 2:48 AM, Radosław Korzeniewski  
<rados...@korzeniewski.net> wrote:

Hello


Did you tested your tape drive with btape utility? What was a result  
of the test?


best regards

2015-09-20 18:00 GMT+02:00 ADCD IT <adcd...@gmail.com>:

Hi Everyone,

I have issue writing to my tapes.

I have an HP tape library connected to ubuntu 12.04 with bacula 5.2.5
installed.

when I am running a full backup job on any client or with any tape  
(tapes

are new, so its not tape issue)

the job stops in the middle after the SD wrote about 20GB than mark  
the

tape as FULL and throw those errors:

19-Sep 16:53 buffer-bacula-dir JobId 108: Start Backup JobId 108,
Job=cow-bj.2015-09-19_16.53.18_08
19-Sep 16:53 buffer-bacula-dir JobId 108: Using Device "DTL01"

19-Sep 16:53 buffer-bacula-sd JobId 108: Wrote label to prelabeled  
Volume

"TAPE05L5" on device "DTL01" (/dev/nst0)

19-Sep 16:55 cow-fd JobId 108: Generate VSS snapshots. Driver="Win32  
VSS",

Drive(s)="CD"

19-Sep 20:22 buffer-bacula-sd JobId 108: Fatal error: Unable to  
write EOF.
ERR=dev.c:1551 ioctl MTWEOF error on "DTL01" (/dev/nst0).  
ERR=Input/output

error.


19-Sep 20:22 buffer-bacula-sd JobId 108: Error: Error writing final  
EOF to

tape. This Volume may not be readable.

dev.c:1551 ioctl MTWEOF error on "DTL01" (/dev/nst0).  
ERR=Input/output

error.
19-Sep 20:22 buffer-bacula-sd JobId 108: Job write elapsed time =
03:29:04, Transfer rate = 1.990 M Bytes/second

19-Sep 20:24 cow-fd JobId 108: Error: lib/bsock.c:429 Write error  
sending
65536 bytes to Storage daemon:192.168.0.70:9103: ERR=Input/output  
error
19-Sep 20:24 cow-fd JobId 108: Fatal error: filed/backup.c:1194  
Network

send error to SD. ERR=Input/output error
19-Sep 20:24 cow-fd JobId 108: VSS Writer (BackupComplete): "System
Writer", State: 0x1 (VSS_WS_STABLE)

19-Sep 20:24 cow-fd JobId 108: VSS Writer (BackupComplete):  
"MSDEWriter",

State: 0x1 (VSS_WS_STABLE)

19-Sep 20:24 cow-fd JobId 108: VSS Writer (BackupComplete): "IIS  
Metabase

Writer", State: 0x1 (VSS_WS_STABLE)
19-Sep 20:24 cow-fd JobId 108: VSS Writer (BackupComplete): "Registry
Writer", State: 0x1 (VSS_WS_STABLE)

19-Sep 20:24 cow-fd JobId 108: VSS Writer (BackupComplete): "Event  
Log

Writer", State: 0x1 (VSS_WS_STABLE)

19-Sep 20:24 cow-fd JobId 108: VSS Writer (BackupComplete): "COM+  
REGDB

Writer", State: 0x1 (VSS_WS_STABLE)

19-Sep 20:24 cow-fd JobId 108: VSS Writer (BackupComplete): "WMI  
Writer",

State: 0x1 (VSS_WS_STABLE)

19-Sep 20:24 cow-fd JobId 108: VSS Writer (BackupComplete): "BITS  
Writer",

State: 0x1 (VSS_WS_STABLE)

19-Sep 20:23 buffer-bacula-dir JobId 108: Error: Bacula  
buffer-bacula-dir

5.2.5 (26Jan12):
  Build OS:               x86_64-pc-linux-gnu ubuntu 12.04
  JobId:                  108
  Job:                    cow-bj.2015-09-19_16.53.18_08
  Backup Level:           Full

  Client:                 "cow" 5.2.10 (28Jun12) Microsoft Windows  
Home
ServerStandard Edition Service Pack 2 (build  
3790),Cross-compile,Win32

  FileSet:                "cow" 2015-09-07 02:00:04
  Pool:                   "Main" (From Job resource)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "HPTapeLibrary" (From Job resource)
  Scheduled time:         19-Sep-2015 16:53:15
  Start time:             19-Sep-2015 16:53:21
  End time:               19-Sep-2015 20:23:34
  Elapsed time:           3 hours 30 mins 13 secs
  Priority:               10
  FD Files Written:       250,664
  SD Files Written:       250,650
  FD Bytes Written:       24,929,269,562 (24.92 GB)
  SD Bytes Written:       24,974,983,634 (24.97 GB)
  Rate:                   1976.5 KB/s
  Software Compression:   None
  VSS:                    yes
  Encryption:             no
  Accurate:               no
  Volume name(s):         TAPE05L5
  Volume Session Id:      1
  Volume Session Time:    1442506946
  Last Volume Bytes:      24,998,400,000 (24.99 GB)
  Non-fatal FD errors:    1
  SD Errors:              2
  FD termination status:  Error
  SD termination status:  Error
  Termination:            *** Backup Error ***



if I try to change the  tape from FULL to APPEND and run the job  
again on

the previously written tape, this is the error I am getting:

20-Sep 10:53 buffer-bacula-dir JobId 109: Start Backup JobId 109,
Job=cow-bj.2015-09-20_09.52.20_20
20-Sep 10:53 buffer-bacula-dir JobId 109: Using Device "DTL01"
20-Sep 10:54 buffer-bacula-sd JobId 109: Volume "TAPE05L5" previously
written, moving to end of data.

20-Sep 11:10 buffer-bacula-sd JobId 109: Error: Unable to position  
to end
of data on device "DTL01" (/dev/nst0): ERR=dev.c:763 ioctl MTEOM  
error on

"DTL01" (/dev/nst0). ERR=Input/output error.

20-Sep 11:10 buffer-bacula-sd JobId 109: Marking Volume "TAPE05L5" in
Error in Catalog.

20-Sep 11:10 buffer-bacula-sd JobId 109: 3307 Issuing autochanger  
"unload

slot 1, drive 0" command.

20-Sep 11:12 buffer-bacula-sd JobId 109: 3301 Issuing autochanger  
"loaded?

drive 0" command.

20-Sep 11:12 buffer-bacula-sd JobId 109: 3302 Autochanger "loaded?  
drive

0", result: nothing loaded.

20-Sep 11:12 buffer-bacula-sd JobId 109: 3304 Issuing autochanger  
"load

slot 2, drive 0" command.

20-Sep 11:13 buffer-bacula-sd JobId 109: 3305 Autochanger "load slot  
2,

drive 0", status is OK.

20-Sep 11:13 buffer-bacula-sd JobId 109: Wrote label to prelabeled  
Volume

"TAPE06L5" on device "DTL01" (/dev/nst0)

20-Sep 11:15 cow-fd JobId 109: Generate VSS snapshots. Driver="Win32  
VSS",

Drive(s)="CD"

20-Sep 13:54 buffer-bacula-sd JobId 109: Error: block.c:577 Write  
error at

19:14135 on device "DTL01" (/dev/nst0). ERR=Input/output error.

20-Sep 13:59 buffer-bacula-sd JobId 109: Error: Error writing final  
EOF to

tape. This Volume may not be readable.

dev.c:1551 ioctl MTWEOF error on "DTL01" (/dev/nst0).  
ERR=Input/output

error.
20-Sep 13:59 buffer-bacula-sd JobId 109: End of medium on Volume
"TAPE06L5" Bytes=19,910,661,120 Blocks=308,634 at 20-Sep-2015 13:59.

20-Sep 13:59 buffer-bacula-sd JobId 109: 3307 Issuing autochanger  
"unload

slot 2, drive 0" command.

20-Sep 14:02 buffer-bacula-sd JobId 109: 3301 Issuing autochanger  
"loaded?

drive 0" command.

20-Sep 14:02 buffer-bacula-sd JobId 109: 3302 Autochanger "loaded?  
drive

0", result: nothing loaded.

20-Sep 14:02 buffer-bacula-sd JobId 109: 3304 Issuing autochanger  
"load

slot 3, drive 0" command.

20-Sep 14:03 buffer-bacula-sd JobId 109: 3305 Autochanger "load slot  
3,

drive 0", status is OK.

20-Sep 14:03 buffer-bacula-sd JobId 109: Wrote label to prelabeled  
Volume

"TAPE07L5" on device "DTL01" (/dev/nst0)

20-Sep 14:03 buffer-bacula-sd JobId 109: New volume "TAPE07L5"  
mounted on

device "DTL01" (/dev/nst0) at 20-Sep-2015 14:03.
20-Sep 15:53 cow-fd JobId 109: VSS Writer (BackupComplete): "System
Writer", State: 0x1 (VSS_WS_STABLE)

20-Sep 15:53 cow-fd JobId 109: VSS Writer (BackupComplete):  
"MSDEWriter",

State: 0x1 (VSS_WS_STABLE)

20-Sep 15:53 cow-fd JobId 109: VSS Writer (BackupComplete): "IIS  
Metabase

Writer", State: 0x1 (VSS_WS_STABLE)

20-Sep 15:53 cow-fd JobId 109: VSS Writer (BackupComplete): "Event  
Log

Writer", State: 0x1 (VSS_WS_STABLE)

20-Sep 15:53 cow-fd JobId 109: VSS Writer (BackupComplete): "BITS  
Writer",

State: 0x1 (VSS_WS_STABLE)

20-Sep 15:53 cow-fd JobId 109: VSS Writer (BackupComplete): "COM+  
REGDB

Writer", State: 0x1 (VSS_WS_STABLE)
20-Sep 15:53 cow-fd JobId 109: VSS Writer (BackupComplete): "Registry
Writer", State: 0x1 (VSS_WS_STABLE)

20-Sep 15:53 cow-fd JobId 109: VSS Writer (BackupComplete): "WMI  
Writer",

State: 0x1 (VSS_WS_STABLE)
20-Sep 15:52 buffer-bacula-sd JobId 109: Job write elapsed time =
04:34:57, Transfer rate = 2.152 M Bytes/second

20-Sep 15:53 buffer-bacula-dir JobId 109: Bacula buffer-bacula-dir  
5.2.5

(26Jan12):
  Build OS:               x86_64-pc-linux-gnu ubuntu 12.04
  JobId:                  109
  Job:                    cow-bj.2015-09-20_09.52.20_20
  Backup Level:           Full

  Client:                 "cow" 5.2.10 (28Jun12) Microsoft Windows  
Home
ServerStandard Edition Service Pack 2 (build  
3790),Cross-compile,Win32

  FileSet:                "cow" 2015-09-07 02:00:04
  Pool:                   "Main" (From Job resource)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "HPTapeLibrary" (From command line)
  Scheduled time:         20-Sep-2015 10:53:39
  Start time:             20-Sep-2015 10:53:42
  End time:               20-Sep-2015 15:53:52
  Elapsed time:           5 hours 10 secs
  Priority:               10
  FD Files Written:       318,022
  SD Files Written:       318,022
  FD Bytes Written:       35,442,904,385 (35.44 GB)
  SD Bytes Written:       35,505,180,848 (35.50 GB)
  Rate:                   1968.0 KB/s
  Software Compression:   None
  VSS:                    yes
  Encryption:             no
  Accurate:               no
  Volume name(s):         TAPE06L5|TAPE07L5
  Volume Session Id:      2
  Volume Session Time:    1442506946
  Last Volume Bytes:      15,627,257,856 (15.62 GB)
  Non-fatal FD errors:    0
  SD Errors:              3
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK -- with warnings



this is the SD configuration:
Device {
  Name                    = "DTL01"
  Description             = "HPTapeLibrary - first drive"
  Media Type              = LTO-5
  Archive Device          = /dev/nst0

  Autochanger             = yes
  Drive Index             = 0

 #Hardware End of Medium  = no
 # BSF at EOM              = no
 # Backward Space Record   = no
 # Fast Forward Space File = no
 # TWO EOF                 = no

  Spool Directory         = /home/bacula/spooling-lib
  Maximum Spool Size      = 11759496889
  Maximum Job Spool Size  = 11759496889    # 10GB
  AlwaysOpen = no
  Random access = no

#  Minimum Block Size = 262144
#  Maximum Block Size = 262144
}
Autochanger {
  Name            = MSL2024
  Device          = "DTL01"
# Device = Drive-2
  Description     = "HP MSL024."
  Changer Device  = /dev/sg3
  Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d"
}


the backup succeed but with two new volumes(tapes), but it should  
succeed

with one tape

the tape is LTO5 1.5T capacity so I don't understand why it stops  
around
20GB and also can't position to the end of data for previously  
written

tape.

I cleaned the drive several times but it still occurs, any idea what  
the

cause? hardware issue? software issue?

Kind Regards,
Roi,


------------------------------------------------------------------------------
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users




--Radosław Korzeniewski
rados...@korzeniewski.net

------------------------------------------------------------------------------

_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users







--Using Opera's mail client: http://www.opera.com/mail/




--Radosław Korzeniewski
rados...@korzeniewski.net




--
Using Opera's mail client: http://www.opera.com/mail/
------------------------------------------------------------------------------
Go from Idea to Many App Stores Faster with Intel(R) XDK
Give your users amazing mobile app experiences with Intel(R) XDK.
Use one codebase in this all-in-one HTML5 development environment.
Design, debug & build mobile apps & 2D/3D high-impact games for multiple OSs.
http://pubads.g.doubleclick.net/gampad/clk?id=254741911&iu=/4140
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users






















					Reply via email to