Hello Ana, Thank you for asking!
I have no news related to the issue. Yes, it's reported, I've sent some more information to help resolve the issue. But no fresh news. To be honest, I've started using another solution for backup Kubernetes things, so actually I'm not too involved in the problem anymore. But I hope developers can fix the issue and it helps others using the plugin. Best regards, Zsolt On Mon, Feb 27, 2023 at 10:51 AM Ana Emília M. Arruda < emiliaarr...@gmail.com> wrote: > Hello Zsolt, > > Do you have any news for the " > https://www.mail-archive.com/bacula-devel@lists.sourceforge.net/msg09804.html"; > thread in the bacula-devel list? > > It seems to me the issue reported here -> > https://gitlab.bacula.org/bacula-community-edition/bacula-community/-/issues/2669, > is related to an issue with the kubernetes plugin and it triggers the > Catalog error. > > Thank you. > > Best, > Ana > > On Fri, Jan 13, 2023 at 12:29 PM Ana Emília M. Arruda < > emiliaarr...@gmail.com> wrote: > >> Hello Zsolt, >> >> Great! Thanks to you for reporting it! >> >> Hopefully it can be fixed soon. >> >> Best regards, >> Ana >> >> On Fri, Jan 13, 2023 at 12:20 PM Zsolt Kozak <koza...@gmail.com> wrote: >> >>> Hello Ana, >>> >>> I've just opened a bug report. Thanks for suggesting it! >>> >>> We have a huge Bacula database and moving to PostgreSQL would be a pain. >>> So I'd rather wait for the bug report. :) >>> >>> I'm also corresponding on the Bacula-devel mailing list. Another >>> investigation is in progress too. >>> >>> But anyway, thank you for your help. I'll let you know how the bug >>> report goes. >>> >>> Best regards, >>> Zsolt >>> >>> On Fri, Jan 13, 2023 at 9:52 AM Ana Emília M. Arruda < >>> emiliaarr...@gmail.com> wrote: >>> >>>> Hello Zsolt, >>>> >>>> Right, thanks a lot for the quick test. The issue is clearly related to >>>> the MySQL/MariaDB bacula database: >>>> >>>> Fatal error: sql_create.c:1273 Create db Object record INSERT INTO >>>> RestoreObject >>>> (ObjectName,PluginName,RestoreObject,ObjectLength,ObjectFullLength,ObjectIndex,ObjectType,ObjectCompression,FileIndex,JobId) >>>> VALUES ('RestoreOptions','kubernetes: debug=1 >>>> baculaimage=repo/bacula-backup:04jan23 namespace=some pvcdata >>>> pluginhost=kubernetes.server timeout=120 verify_ssl=0 >>>> fdcertfile=/etc/bacula/certs/bacula-backup.cert >>>> fdkeyfile=/etc/bacula/certs/bacula-backup.key','# Plugin configuration >>>> file\n# Version 1\nOptPrompt=\"K8S config >>>> file\"\nOptDefault=\"*None*\"\nconfig=@STR@\n\nOptPrompt=\"K8S API >>>> server URL/Host\"\nOptDefault=\"*None*\"\nhost=@STR@\n\nOptPrompt=\"K8S >>>> Bearertoken\"\nOptDefault=\"*None*\"\ntoken=@STR@\n\nOptPrompt=\"K8S >>>> API server cert >>>> verification\"\nOptDefault=\"True\"\nverify_ssl=@BOOL@\n\nOptPrompt=\"Custom >>>> CA Certs file to >>>> use\"\nOptDefault=\"*None*\"\nssl_ca_cert=@STR@\n\nOptPrompt=\"Output >>>> format when saving to file (JSON, >>>> YAML)\"\nOptDefault=\"RAW\"\noutputformat=@STR@\n\nOptPrompt=\"The >>>> address for listen to incoming backup pod >>>> data\"\nOptDefault=\"*FDAddress*\"\nfdaddress=@STR@\n\nOptPrompt=\"The >>>> port for opening socket for >>>> listen\"\nOptDefault=\"9104\"\nfdport=@INT32@\n\nOptPrompt=\"The >>>> endpoint address for backup pod to >>>> connect\"\nOptDefault=\"*FDAddress*\"\npluginhost=@STR@\n\nOptPrompt=\"The >>>> endpoint port to >>>> connect\"\nOptDefault=\"9104\"\npluginport=@INT32@\n\n',859,859,0,27,0,1,411957) >>>> failed. ERR=Data too long for column 'PluginName' at row 1 >>>> >>>> Would it be possible for you to open a bug report so developers can >>>> help you on this one? >>>> >>>> If you can move to a PostgreSQL database, it is very probable the >>>> pvcdata backup will work fine. >>>> >>>> Best, >>>> Ana >>>> >>>> >>>> >>>> On Fri, Jan 13, 2023 at 9:09 AM Zsolt Kozak <koza...@gmail.com> wrote: >>>> >>>>> Hello Ana! >>>>> >>>>> I've just removed the backslashes and rerun the job but unfortunately >>>>> the error is still there. >>>>> >>>>> Here is a brand new error message from Bacula. >>>>> >>>>> Best regards, >>>>> Zsolt >>>>> >>>>> bacula-fd kubernetes: Processing namespace: some >>>>> kubernetes: Start backup volume claim: some-claim >>>>> kubernetes: Prepare Bacula Pod on: node with: >>>>> repo/bacula-backup:04jan23 kubernetes.server:9104 >>>>> kubernetes: Connected to Kubernetes 1.25 - v1.25.4. >>>>> bacula-sd Ready to append to end of Volume "Full-0513" >>>>> size=1,680,733,693 >>>>> node-fd >>>>> Error: Read error on file >>>>> /@kubernetes/namespaces/some/persistentvolumeclaims/some-claim.tar. >>>>> ERR=Input/output error >>>>> >>>>> Error: kubernetes: ConnectionServer: Timeout waiting... >>>>> >>>>> Error: kubernetes: PTCOMM cannot get packet header from backend. >>>>> bacula-sd Sending spooled attrs to the Director. Despooling 11,646 >>>>> bytes ... >>>>> node-fd >>>>> Error: kubernetes: Unable to remove proxy Pod bacula-backup! Other >>>>> operations with proxy Pod will fail! >>>>> bacula-dir Fatal error: catreq.c:680 Restore object create error. >>>>> >>>>> Error: Bacula Enterprise bacula-dir 13.0.1 (05Aug22): >>>>> Build OS: x86_64-pc-linux-gnu-bacula-enterprise debian >>>>> 11.2 >>>>> JobId: 411957 >>>>> Job: KubernetesBackup.2023-01-13_08.45.44_07 >>>>> Backup Level: Full >>>>> Client: "bacula-fd" 13.0.1 (05Aug22) >>>>> x86_64-pc-linux-gnu-bacula-enterprise,debian,10.11 >>>>> FileSet: "Kubernetes Set" 2023-01-13 08:39:12 >>>>> Pool: "Full-Pool-Internal" (From Job FullPool >>>>> override) >>>>> Catalog: "MyCatalog" (From Client resource) >>>>> Storage: "InternalStorageFull" (From Pool resource) >>>>> Scheduled time: 13-Jan-2023 08:45:41 >>>>> Start time: 13-Jan-2023 08:45:47 >>>>> End time: 13-Jan-2023 08:51:51 >>>>> Elapsed time: 6 mins 4 secs >>>>> Priority: 10 >>>>> FD Files Written: 34 >>>>> SD Files Written: 0 >>>>> FD Bytes Written: 76,496 (76.49 KB) >>>>> SD Bytes Written: 0 (0 B) >>>>> Rate: 0.2 KB/s >>>>> Software Compression: 100.0% 1.0:1 >>>>> Comm Line Compression: 2.6% 1.0:1 >>>>> Snapshot/VSS: no >>>>> Encryption: yes >>>>> Accurate: yes >>>>> Volume name(s): Full-0513 >>>>> Volume Session Id: 559 >>>>> Volume Session Time: 1672853724 >>>>> Last Volume Bytes: 1,680,850,542 (1.680 GB) >>>>> Non-fatal FD errors: 7 >>>>> SD Errors: 0 >>>>> FD termination status: OK >>>>> SD termination status: SD despooling Attributes >>>>> Termination: *** Backup Error *** >>>>> Fatal error: sql_create.c:1273 Create db Object record INSERT INTO >>>>> RestoreObject >>>>> (ObjectName,PluginName,RestoreObject,ObjectLength,ObjectFullLength,ObjectIndex,ObjectType,ObjectCompression,FileIndex,JobId) >>>>> VALUES ('RestoreOptions','kubernetes: debug=1 >>>>> baculaimage=repo/bacula-backup:04jan23 namespace=some pvcdata >>>>> pluginhost=kubernetes.server timeout=120 verify_ssl=0 >>>>> fdcertfile=/etc/bacula/certs/bacula-backup.cert >>>>> fdkeyfile=/etc/bacula/certs/bacula-backup.key','# Plugin configuration >>>>> file\n# Version 1\nOptPrompt=\"K8S config >>>>> file\"\nOptDefault=\"*None*\"\nconfig=@STR@\n\nOptPrompt=\"K8S API >>>>> server URL/Host\"\nOptDefault=\"*None*\"\nhost=@STR@\n\nOptPrompt=\"K8S >>>>> Bearertoken\"\nOptDefault=\"*None*\"\ntoken=@STR@\n\nOptPrompt=\"K8S >>>>> API server cert >>>>> verification\"\nOptDefault=\"True\"\nverify_ssl=@BOOL@\n\nOptPrompt=\"Custom >>>>> CA Certs file to >>>>> use\"\nOptDefault=\"*None*\"\nssl_ca_cert=@STR@\n\nOptPrompt=\"Output >>>>> format when saving to file (JSON, >>>>> YAML)\"\nOptDefault=\"RAW\"\noutputformat=@STR@\n\nOptPrompt=\"The >>>>> address for listen to incoming backup pod >>>>> data\"\nOptDefault=\"*FDAddress*\"\nfdaddress=@STR@\n\nOptPrompt=\"The >>>>> port for opening socket for >>>>> listen\"\nOptDefault=\"9104\"\nfdport=@INT32@\n\nOptPrompt=\"The >>>>> endpoint address for backup pod to >>>>> connect\"\nOptDefault=\"*FDAddress*\"\npluginhost=@STR@\n\nOptPrompt=\"The >>>>> endpoint port to >>>>> connect\"\nOptDefault=\"9104\"\npluginport=@INT32@\n\n',859,859,0,27,0,1,411957) >>>>> failed. ERR=Data too long for column 'PluginName' at row 1 >>>>> bacula-sd Elapsed time=00:06:04, Transfer rate=310 Bytes/second >>>>> bacula-fd >>>>> Error: kubernetes: Error closing backend. Err=Child exited with code 1 >>>>> >>>>> Error: kubernetes: PTCOMM cannot get packet header from backend. >>>>> >>>>> On Thu, Jan 12, 2023 at 11:48 PM Ana Emília M. Arruda < >>>>> emiliaarr...@gmail.com> wrote: >>>>> >>>>>> Hello Zsolt, >>>>>> >>>>>> It seems to me that Bacula is trying to insert into the "PluginName" >>>>>> field the value "kubernetes: \n debug=1 \n >>>>>> baculaimage=repo/bacula-backup:04jan23 \n namespace=namespace >>>>>> \n pvcdata \n >>>>>> pluginhost=kubernetes.server \n timeout=120 \n >>>>>> verify_ssl=0 \n >>>>>> fdcertfile=/etc/bacula/certs/bacula-backup.cert >>>>>> \n >>>>>> fdkeyfile=/etc/bacula/certs/bacula-backup.key". When it should be >>>>>> "kubernetes" only. >>>>>> >>>>>> We can see the error here: >>>>>> >>>>>> bacula-dir Fatal error: sql_create.c:1273 Create db Object record >>>>>> INSERT INTO RestoreObject >>>>>> (ObjectName,PluginName,RestoreObject,ObjectLength,ObjectFullLength,ObjectIndex,ObjectType,ObjectCompression,FileIndex,JobId) >>>>>> >>>>>> VALUES ('RestoreOptions','kubernetes: \n debug=1 \n >>>>>> baculaimage=repo/bacula-backup:04jan23 \n >>>>>> namespace=namespace \n pvcdata \n >>>>>> pluginhost=kubernetes.server \n timeout=120 \n >>>>>> verify_ssl=0 \n >>>>>> fdcertfile=/etc/bacula/certs/bacula-backup.cert >>>>>> \n >>>>>> fdkeyfile=/etc/bacula/certs/bacula-backup.key','# Plugin >>>>>> configuration file\n# Version 1\nOptPrompt=\"K8S config >>>>>> file\"\nOptDefault=\"*None*\"\nconfig=@STR@\n\n >>>>>> OptPrompt=\"K8S API server >>>>>> URL/Host\"\nOptDefault=\"*None*\"\nhost=@STR@\n\nOptPrompt=\"K8S >>>>>> Bearertoken\"\nOptDefault=\"*None*\"\ntoken=@STR@\n\nOptPrompt=\"K8S >>>>>> API server cert verification\"\n >>>>>> OptDefault=\"True\"\nverify_ssl=@BOOL@\n\nOptPrompt=\"Custom CA >>>>>> Certs file to >>>>>> use\"\nOptDefault=\"*None*\"\nssl_ca_cert=@STR@\n\nOptPrompt=\"Output >>>>>> format when saving to file (JSON, YAML)\"\n >>>>>> OptDefault=\"RAW\"\noutputformat=@STR@\n\nOptPrompt=\"The address >>>>>> for listen to incoming backup pod >>>>>> data\"\nOptDefault=\"*FDAddress*\"\nfdaddress=@STR@\n\n >>>>>> OptPrompt=\"The port for opening socket for >>>>>> listen\"\nOptDefault=\"9104\"\nfdport=@INT32@\n\nOptPrompt=\"The >>>>>> endpoint address for backup pod to connect\"\n >>>>>> OptDefault=\"*FDAddress*\"\npluginhost=@STR@\n\nOptPrompt=\"The >>>>>> endpoint port to connect\"\nOptDefault=\"9104\"\n >>>>>> pluginport=@INT32@\n\n',859,859,0,27,0,1,410830) failed. ERR=Data >>>>>> too long for column 'PluginName' at row 1 >>>>>> >>>>>> Do you think you could perform a test removing the backslashes in the >>>>>> plugin line in the FileSet configuration? >>>>>> -----8<----- >>>>>> FileSet { >>>>>> Name = "Kubernetes Set" >>>>>> Include { >>>>>> Options { >>>>>> signature = SHA512 >>>>>> compression = GZIP >>>>>> Verify = pins3 >>>>>> } >>>>>> Plugin = "kubernetes: \ >>>>>> debug=1 \ >>>>>> baculaimage=repo/bacula-backup:04jan23 \ >>>>>> namespace=namespace \ >>>>>> pvcdata \ >>>>>> pluginhost=kubernetes.server \ >>>>>> timeout=120 \ >>>>>> verify_ssl=0 \ >>>>>> fdcertfile=/etc/bacula/certs/bacula-backup.cert \ >>>>>> fdkeyfile=/etc/bacula/certs/bacula-backup.key" >>>>>> } >>>>>> } >>>>>> >>>>>> -----8<----- >>>>>> Please keep everything in a single line and let me know if it works. >>>>>> Then, we can check why using backslashes is not working to break long >>>>>> lines >>>>>> here. >>>>>> Best regards, >>>>>> Ana >>>>>> >>>>>>
_______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
