Elasticsearch SQL connector with SSL

Hi, I recently started working on a flink job using elasticsearch sql connector. Our elasticsearch cluster required SSL certificate to be connected and there is no option to set cert in the current version of elasticsearch sql connector(Elasticsearch | Apache Flink

Why discard checkpoints on the job finished

Dear Flinkers: As "CheckpointProperties#CHECKPOINT_RETAINED_ON_CANCELLATION" shows, if Job stopped with JobStatus#FINISHED "CompletedCheckpointStore" will discard all completed checkpoints. My question is, why job on the FINISHED status the CompletedCheckpointStore discard all completed che

Re: The flink-kubernetes-operator vs third party flink operators

Hi! The main difference at the moment is the programming language and the APIs used to interact with Flink. The flink-kubernetes-operator, uses Java and interacts with Flink using the built in (native) clients. The other operators have been around since earlier Flink versions. They all use Golan

The flink-kubernetes-operator vs third party flink operators

Hi I started looking into Flink recently more specifically the flink-kubernetes-operator so I only know little about it. I found at least 3 other Flink K8s operators that Lyft, Google, and Spotify developed. Could someone please enlighten me what is the difference of these third party Flink k

Re:Re: Could you please give me a hand about json object in flink sql

Hi, Got it, seems this way is not flexable enough, but still thanks so much for your great support! Good wished! Regards && Thanks Hunk At 2022-04-02 16:34:29, "Qingsheng Ren" wrote: >Hi, > >If the schema of records is not fixed I’m afraid you have to do it in UDTF. > >Best, > >Q

Re: Could you please give me a hand about json object in flink sql

Hi, If the schema of records is not fixed I’m afraid you have to do it in UDTF. Best, Qingsheng > On Apr 2, 2022, at 15:45, wang <24248...@163.com> wrote: > > Hi, > > Thanks for your quick response! > > And I tried the format "raw", seems it only support single physical column, > and in

Re: Helm install flink-kubernetes-operator failed

Thanks for everyone's help, by executing: helm repo add operator-rc3 https://dist.apache.org/repos/dist/dev/flink/flink-kubernetes-operator-0.1.0-rc3 Now it works correctly On 04/2/2022 15:31，Gyula Fóra wrote： As Biao Geng said this will be much easier after the first preview release. Whic

Re:Re: Could you please give me a hand about json object in flink sql

Hi, Thanks for your quick response! And I tried the format "raw", seems it only support single physical column, and in our project reqiurement, there are more than one hundred columns in sink table. So I need combine those columns into one string in a single UDF? Thanks && Regards, Hunk

Re: Helm install flink-kubernetes-operator failed

As Biao Geng said this will be much easier after the first preview release. Which should become available on monday if all works out :) Until then you can also test our last release candidate which will hopefully become the release: helm repo add operator-rc3 https://dist.apache.org/repos/dist/de

答复: Helm install flink-kubernetes-operator failed

Hi Spoon, The command in current doc (helm install flink-kubernetes-operator helm/flink-kubernetes-operator) should be executed under the repo’s root dir (e.g. ~/flink-kubernetes-operator/). The community are working on to make this process simpler(https://github.com/apache/flink-kubernetes-ope

Re: Could you please give me a hand about json object in flink sql

Hi, You can construct the final json string in your UDTF, and write it to Kafka sink table with only one field, which is the entire json string constructed in UDTF, and use raw format [1] in the sink table: CREATE TABLE TableSink ( `final_json_string` STRING ) WITH ( ‘connector’ = ‘kafk

Helm install flink-kubernetes-operator failed

Hi, I am trying it according to the official documentation of flink-kubernetes-operator, according to the description in 'Quick Start', when I execute the command: | helm install flink-kubernetes-operator helm/flink-kubernetes-operator | it returns an error: | Error: INSTALLATION FAILED: failed