Re: Facing ClassNotFoundException: org.apache.flink.api.common.ExecutionConfig on EMR

Hi Hang, I have checked this in my fat jar and the same class is not packaged in my jar. I have also searched about this issue in our mail archives too and the same issue was posted a few months back too. https://www.mail-archive.com/user@flink.apache.org/msg52035.html The solution was to simply

Re: Flink SQL query using a UDTAGG

Hi Pouria, Table aggregate functions are not currently supported in SQL, they have been introduced in the Table API as per FLIP-29: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=97552739. Best, Junrui Pouria Pirzadeh 于2024年3月13日周三 02:06写道： > Hi, > I am using the SQL api on F

Re: Facing ClassNotFoundException: org.apache.flink.api.common.ExecutionConfig on EMR

Hi, Sachin. I use the command `jar -tf flink-dist-1.18.0.jar| grep OutputTag` to make sure that this class is packaged correctly. I think you should check your own jar to make sure this class is not packaged in your jar. Best, Hang Sachin Mittal 于2024年3月12日周二 20:29写道： > I miss wrote. It’s ver

High latency in reading Iceberg tables using Flink table api

Hello all, I am using the flink-iceberg-runtime lib to read an iceberg table into a Flink datastream. I am using Glue as the catalog. I use the flink table API to build and query an iceberg table and then use toDataStream to convert it into a DataStream. Here is the code Table table = streamTable

Flink 1.18 with Java 17 production version release

Hi, The latest Flink 1.18.1 with Java 17 support is in beta mode, users can report issue, is there a planned release date for production version? Do you have a roadmap for production version? Thank you, Angela Meng

Flink SQL query using a UDTAGG

Hi, I am using the SQL api on Flink 1.18 and I am trying to write a SQL query which uses a 'user-defined table aggregate function' (UDTAGG). However, the documentation [1] only includes a Table API example w

Re: Flink Batch Execution Mode

Hi Irakli What version of flink-connector-kafka are you using? You may have encountered a bug [1] in the old version that prevents the source task from entering the finished state. [1]. https://issues.apache.org/jira/browse/FLINK-31319 Best, Feng On Tue, Mar 12, 2024 at 7:21 PM irakli.keshel.

Re:Read data from elasticsearch using Java flink

Hi, Fidea. Currently, elasticsearch is not supported to be used as a source. You can see the jira[1] for more details. You can also cherry pick this pr[2] to your own branch and build a custom elasticsearch connector to use it directly. [1] https://issues.apache.org/jira/browse/FLINK-25568 [2]

Re: Facing ClassNotFoundException: org.apache.flink.api.common.ExecutionConfig on EMR

Hi Hang, Once I exclude file-core from the fat jar I get this error: I believe org.apache.flink.util.OutputTag is part of flink-core itself. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/flink/util/OutputTag at java.base/java.lang.Class.forName0(Native Method)

Read data from elasticsearch using Java flink

Hi , I am trying to read data from elasticsearch & store in a stream. Could you please share a few examples to *read*/get all data from Elasticsearch using java. Thanks,

Re: Flink performance

It would be useful if you shared what you've found already, or could give a bit more detail about what it is that you're looking for. Numbers on their own don't really tell a full picture. Here are a few links that I found for you that might help: * https://flink.apache.org/2022/01/04/how-we-impr

Re: Facing ClassNotFoundException: org.apache.flink.api.common.ExecutionConfig on EMR

Ok. Actually it’s version 1.18. I will try to remove flink-core from the fat jar. On Tue, 12 Mar 2024 at 1:51 PM, Hang Ruan wrote: > Hi, Sachin. > > This error occurs when there is class conflict. There is no need to > package flink-core in your own jar. It is already contained in flink-dist. >

Re: Facing ClassNotFoundException: org.apache.flink.api.common.ExecutionConfig on EMR

I miss wrote. It’s version 1.18. This is latest and works locally but not on aws emr and I get class not found exception. On Tue, 12 Mar 2024 at 1:25 PM, Zhanghao Chen wrote: > Hi Sachin, > > Flink 1.8 series have already been out of support, have you tried with a > newer version of Flink? >

Re: Facing ClassNotFoundException: org.apache.flink.api.common.ExecutionConfig on EMR

Hi, Sachin. This error occurs when there is class conflict. There is no need to package flink-core in your own jar. It is already contained in flink-dist. And Flink version 1.8 is too old. It is better to update your flink version. Best, Hang Sachin Mittal 于2024年3月12日周二 16:04写道： > Hi, > We h

Re: Facing ClassNotFoundException: org.apache.flink.api.common.ExecutionConfig on EMR

Hi Sachin, Flink 1.8 series have already been out of support, have you tried with a newer version of Flink? From: Sachin Mittal Sent: Tuesday, March 12, 2024 14:48 To: user@flink.apache.org Subject: Facing ClassNotFoundException: org.apache.flink.api.common.Exe

Flink Batch Execution Mode

Hello, I have a Flink job that is running in the Batch mode. The source for the job is a Kafka topic which has limited number of events. I can see that the job starts running fine and consumes the events, but never makes it past the first task and becomes idle. The Kafka source is defined to be