Re: [D] Pseudo-CDC - polled pipeline runs? (hop)

GitHub user sramazzina added a comment to the discussion: Pseudo-CDC - polled pipeline runs? Hi @casesolved-co-uk let me disagree on your view on Debezium as a consistent way of managing CDC. IMHO a simple single node installation kafka/debezium in docker could be easy to implement and your o

AW: Azure VFS and metadata: correct usage

Alright, that works. Didn't consider that option 🙂 Maybe add that example to the documentation for the next person, that doesn't see the forest for the trees? Cheers Gabriel Von: Hans Van Akelyen Gesendet: Dienstag, 8. April 2025 15:00 An: users@hop.apache.org

Re: Azure VFS and metadata: correct usage

The name you give to your new metadata type will be the prefix. so let's say you created a metadata object name myAzure it will be myAzure://[containername] Hope this helps On 8 Apr 2025 at 14:39 +0200, Gabriel Grohmann , wrote: > Hey there, > > I want to connect to an azure blob storage throug

Re: [D] How to check if expected files exist in a folder? (hop)

GitHub user hansva added a comment to the discussion: How to check if expected files exist in a folder? On workflow level you have the files exist action which should work with the variables the way you are describing it. I think the transform needs actual filenames. Most of our input transf

Azure VFS and metadata: correct usage

Hey there, I want to connect to an azure blob storage through the (new) metadata alternative, but haven't had any luck yet. So far I managed to use the general account settings, which are stored within the hop-config.json. However, I didn't figure out yet how to make use of the Azure Authentic

Re: [D] VFS - Connect on remote hdfs (hop)

GitHub user oudine13 edited a comment on the discussion: VFS - Connect on remote hdfs Since then, I've been unable to resolve my VFS file object error. I look for another services and i saw that kerberos configuration is possible with [Cloudera Impala.](https://hop.apache.org/manual/latest/d

Re: AW: Azure VFS and metadata: correct usage

Good idea, I created a PR [1] Cheeers, Hans [1] https://github.com/apache/hop/pull/5140 On 8 Apr 2025 at 15:09 +0200, Gabriel Grohmann , wrote: > Alright, that works. Didn't consider that option 🙂 > > Maybe add that example to the documentation for the next person, that doesn't > see the fores

Re: AW: Azure VFS and metadata: correct usage

It seems the next version of the docs already has an example https://hop.apache.org/manual/next/metadata-types/azure-authentication.html On 8 Apr 2025 at 15:37 +0200, Hans Van Akelyen , wrote: > Good idea, I created a PR [1] > > Cheeers, > Hans > > > [1] https://github.com/apache/hop/pull/5140 >