Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

Congratulations !!! Best, Jiadong Lu On 2023/3/27 17:23, Yu Li wrote: Dear Flinkers, As you may have noticed, we are pleased to announce that Flink Table Store has  joined the Apache Incubator as a separate project called Apache  Paimon(incubating) [1] [2] [3]. The new project still aims at b

Re: Is MiniClusterWithClientResource expected to have a UI?

Hi, Sofya The MiniClusterWithClientResource does not provide UI by default. But you can enable it by adding flink-runtime-web dependency to do some debug. Add this dependency to your pom.xml. And flink will load the web ui automatically. org.apache.flink flink-runtime-web ${project.ve

Docker Flink Official Image with Docker Swarm cannot register TaskManager to JobManager's Resource Manager

Hello, I am having trouble when deploying Apache Flink 1.16.1 on 2 Google Cloud instances with Docker Swarm. The JobManager is deployed on the manager node and the TaskManager is deployed in the worker node. The TaskManager seems to have trouble to communicate with ResourceManager on JobManager via

Is MiniClusterWithClientResource expected to have a UI?

Hi, I'm experimenting with the MiniClusterWithClientResource, below, and when I print out the URL I'm not able to access a UI. Is the MiniClusterWithClientResource expected to provide a UI? Thanks -Sofya https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/dev/datastream/testing/#juni

RE: [EXTERNAL] Re: Unable to Use spec.flinkVersion v1_17 with Flink Operator

The commands for updating CRD seem to assume they are being run from the flink-operator-repo. Accordingly, to run them in my environment I should run them as: ```bash # upgrade CRD kubectl replace -f https://github.com/apache/flink-kubernetes-operator/tree/release-1.4/helm/flink-kubernetes-opera

Re: Unexpected behaviour when configuring both `withWatermarkAlignment` & `withIdleness`

Hey Martijn, The version is 1.16.0 On Wed, Mar 29, 2023 at 5:43 PM Martijn Visser wrote: > Hi Reem, > > What's the Flink version where you're encountering this issue? > > Best regards, > > Martijn > > On Wed, Mar 29, 2023 at 5:18 PM Reem Razak via user > wrote: > >> Hey there! >> >> We are see

Re: Unexpected behaviour when configuring both `withWatermarkAlignment` & `withIdleness`

Hi Reem, What's the Flink version where you're encountering this issue? Best regards, Martijn On Wed, Mar 29, 2023 at 5:18 PM Reem Razak via user wrote: > Hey there! > > We are seeing a second Flink pipeline encountering similar issues when > configuring both `withWatermarkAlignment` and `wit

Re: Unexpected behaviour when configuring both `withWatermarkAlignment` & `withIdleness`

Hey there! We are seeing a second Flink pipeline encountering similar issues when configuring both `withWatermarkAlignment` and `withIdleness`. The unexpected behaviour gets triggered after a Kafka cluster failover. Any thoughts on there being an incompatibility between the two? Thanks! On Wed,

Re: org.apache.flink.table.api.ValidationException

Hi, This error occurs when the data type can not be parsed. You could read this part to see more details about the User-Defined Data Types[1]. Best, Hang [1] https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/dev/table/types/#user-defined-data-types 柒朵 <1303809...@qq.com> 于2023年3月

org.apache.flink.table.api.ValidationException

Exception in thread "main" org.apache.flink.table.api.ValidationException: Could not extract a data type from 'class UserStatus'. Please pass the required data type manually or allow RAW types. 1303809...@qq.com  

Re: Questions on S3 File Sink Behavior

Hi, 1. In case of S3 FileSystem, Flink uses the multipart upload process [1] for better performance. It might not be obvious at first by looking at the docs, but it's noted at the bottom of the FileSystem page [2] For more information you can also check FLINK-9751 and FLINK-9752 2. In case of loc

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

Congratulations! Dong On Mon, Mar 27, 2023 at 5:24 PM Yu Li wrote: > Dear Flinkers, > > > > As you may have noticed, we are pleased to announce that Flink Table Store > has joined the Apache Incubator as a separate project called Apache > Paimon(incubating) [1] [2] [3]. The new project still

Questions on S3 File Sink Behavior

Hi,   We are tying to use Flink's File sink to distribute files to AWS S3 storage. We are using Flink provided Hadoop s3a connector as plugin. We have some observations that we needed to clarify: 1. When using file sink for local filesystem distribution, we can see that the sink creates 3 se