Re: Setting uid hash for non-legacy sinks

2024-06-12 Thread Salva Alcántara
{ "emoji": "♥️", "version": 1 }

Re: Setting uid hash for non-legacy sinks

2024-06-12 Thread Gabor Somogyi
o ensure >>>>> cross-version state compatibility. However, this cannot be easily done >>>>> when >>>>> setting the uidHash, that's why Flink currently does not support setting >>>>> it >>>>> for non-legacy sinks. >>

Re: Setting uid hash for non-legacy sinks

2024-06-10 Thread Gabor Somogyi
rator. Maybe you can further investigate it and fire a JIRA >>> issue on it. >>> >>> Best, >>> Zhanghao Chen >>> -- >>> *From:* Salva Alcántara >>> *Sent:* Sunday, June 9, 2024 14:49 >>> *To:* Ga

Re: Setting uid hash for non-legacy sinks

2024-06-10 Thread Salva Alcántara
te the corresponding uidHash for >> each suboperator. Maybe you can further investigate it and fire a JIRA >> issue on it. >> >> Best, >> Zhanghao Chen >> -- >> *From:* Salva Alcántara >> *Sent:* Sunday, June 9, 2024 14:49 >> *To:* Gabor

Re: Setting uid hash for non-legacy sinks

2024-06-09 Thread Gabor Somogyi
9, 2024 14:49 > *To:* Gabor Somogyi > *Cc:* user > *Subject:* Re: Setting uid hash for non-legacy sinks > > Hi Gabor, > > Yeah, I know this, but what if you initially forgot and now you want to > add the uid "after the fact"? > > You need to get the operator/

Re: Setting uid hash for non-legacy sinks

2024-06-09 Thread Zhanghao Chen
e the corresponding uidHash for each suboperator. Maybe you can further investigate it and fire a JIRA issue on it. Best, Zhanghao Chen From: Salva Alcántara Sent: Sunday, June 9, 2024 14:49 To: Gabor Somogyi Cc: user Subject: Re: Setting uid hash for non-legacy

Re: Setting uid hash for non-legacy sinks

2024-06-08 Thread Salva Alcántara
Hi Gabor, Yeah, I know this, but what if you initially forgot and now you want to add the uid "after the fact"? You need to get the operator/vertex id used by Flink for current savepoints and somehow set this id for the sink. With the uid method you would need to "hack" the existing hash (get a

Re: Setting uid hash for non-legacy sinks

2024-06-07 Thread Gabor Somogyi
Hi Salva, Just wondering why not good to set the uid like this? ``` output.sinkTo(outputSink).uid("my-human-readable-sink-uid"); ``` >From the mentioned UID Flink is going to make the hash which is consistent from UID -> HASH transformation perspective. BR, G On Fri, Jun 7, 2024 at 7:54 AM Sa

Setting uid hash for non-legacy sinks

2024-06-06 Thread Salva Alcántara
Hi, I want to add the uid for my Kafka sink in such a way that I can still use the existing savepoint. The problem I'm having is that I cannot set the uid hash. If I try something like this: ``` output.sinkTo(outputSink).setUidHash("xyzb"); ``` I get the following err