Re: Pyflink elastic search connectors

2022-03-30 Thread Sandeep Sharat
Thank you for your reply. Now I have a better understanding of it. On Wed, 30 Mar, 2022, 5:29 pm LuNing Wang, wrote: > Hi, > > The principle of the python datastream connector is interprocess > communication via py4j. I blocked in a class loading problem, so I haven't > achieved the PR about the

Re: Pyflink elastic search connectors

2022-03-30 Thread LuNing Wang
Hi, The principle of the python datastream connector is interprocess communication via py4j. I blocked in a class loading problem, so I haven't achieved the PR about the Python ES datastream connector yet. Compared with other connectors, the ES is a little more troublesome. Because implementing of

Re: Pyflink elastic search connectors

2022-03-30 Thread Sandeep Sharat
Hi, I am pretty much a novice in python. So writing an entire wrapper using python may be a tough nut to crack for me. But just out of curiosity, want to ask ask the question that why were the connectors not implemented in python api. Is it because of a very lesser number of use cases ???or most

Re: Pyflink elastic search connectors

2022-03-29 Thread Sandeep Sharat
Hi, Thank you for the quick responses. We are using the datastream api for pyflink. We are trying to implement a wrapper in python for the same as we speak. Hopefully it will work out. 😊 On Wed, 30 Mar, 2022, 8:02 am Xingbo Huang, wrote: > Hi, > > Are you using datastream api or table api?If yo

Re: Pyflink elastic search connectors

2022-03-29 Thread Xingbo Huang
Hi, Are you using datastream api or table api?If you are using the table api, you can use the connector by executing sql[1]. If you are using the datastream api, there is really no es connector api provided, you need to write python wrapper code, but the wrapper code is very simple. The underlying

Pyflink elastic search connectors

2022-03-29 Thread Sandeep Sharat
Hello Everyone, I have been working on a streaming application using elasticsearch as the sink. I had achieved it using the java api quite easily. But due to a recent policy change we are moving towards the python api for flink, however we were unable to find any python elastic search connectors f