Unhandled exception in flink 1.14.2

2022-01-14 Thread John Smith
Hi using 1.14.2, running 3 job nodes. Everything seems to work ok. When I use the UI and just navigate from one jobmanager ui to the other, it sometimes seems to take long or timeout and I see an "Internal Server Error" popup on the top right messages. Looking at the logs I see this, but not sur

Re: Example with JSONKeyValueDeserializationSchema?

2022-01-14 Thread Kamil ty
Hello Hans, As far as I know the JSONKeyValueDeserializationSchema returns a Jackson ObjectNode. Below I have included an example based on Flink stable documentation. KafkaSource source = KafkaSource.builder() .setBootstrapServers(brokers) .setTopics("input-topic") .setGroupId("my-group") .setSta

Unaligned Tumbling Windows

2022-01-14 Thread Aeden Jameson
When using tumbling windows the windows materialize all at once which results in burst-y traffic. How does one go about unaligned tumbling windows? Does this require going down the road of custom window, assigner and triggers? -- Cheers, Aeden

Flink (DataStream) in Kubernetes

2022-01-14 Thread Jessy Ping
Hi Team, We are planning to run the below pipeline as a standalone Flink application cluster on kubernetes. It will be better if the community can share their insights regarding the below questions. [image: image.png] We can describe the pipeline as follows, 1. Combine the realtime streams fr

Example with JSONKeyValueDeserializationSchema?

2022-01-14 Thread HG
Hi, Before starting programming myself I'd like to know whether there are good examples with deserialization of JSON that I can borrow. The structure of the JSON is nested with multiple levels. Any references? 'better well stolen than badly invented myself' we'd say in Dutch😁 Regards Hans

Flink per-job cluster HbaseSinkFunction fails before starting - Configuration issue

2022-01-14 Thread Kamil ty
Hello all, I have a flink job that is using the HbaseSinkFunction as specified here: flink/flink-connectors/flink-connector-hbase-2.2 at master · a0x8o/flink (github.com)

Re: [DISCUSS] Moving connectors from Flink to external connector repositories

2022-01-14 Thread Konstantin Knauf
Hi Martijn, makes sense to me. For dropping a connector, I think, we need separate discussion for each of them and I would not block this effort on these discussions. Cheers, Konstantin On Fri, Jan 14, 2022 at 10:26 AM Martijn Visser wrote: > Hi User mailing list, > > I'm also forwarding this

Re: FlinkKafkaConsumer and FlinkKafkaProducer and Kafka Cluster Migration

2022-01-14 Thread Fabian Paul
Hi Alexey, The bootstrap servers are not part of the state so you are good to go although please stop all your jobs with a savepoint and resume from it with the new properties. I guess to migrate the FlinkKafkaConsumer to an empty topic you can discard the state if you ensure that all messages beg

Fwd: [DISCUSS] Moving connectors from Flink to external connector repositories

2022-01-14 Thread Martijn Visser
Hi User mailing list, I'm also forwarding this thread to you. Please let me know if you have any comments or feedback! Best regards, Martijn -- Forwarded message - From: Martijn Visser Date: Fri, 14 Jan 2022 at 06:28 Subject: Re: [DISCUSS] Moving connectors from Flink to extern

退订

2022-01-14 Thread rimin515
退订