Re: Issues with Flink scheduler?

2022-08-01 Thread Hemanga Borah
it is not able to find enough resources. On Sun, Jul 31, 2022 at 6:59 PM Lijie Wang wrote: > Hi, > > Which version are you using? Has any job failover occurred? It would be > better if you can provide the full log of JM. > > Best, > Lijie > > Hemanga Borah 于2022年8月1日

Issues with Flink scheduler?

2022-07-31 Thread Hemanga Borah
Hello guys, We have been seeing an issue with our Flink applications. Our applications run fine for several hours, and then we see an error/exception like so: java.util.concurrent.CompletionException: java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResour

Re: DataStream.keyBy() with keys determined at run time

2022-07-10 Thread Hemanga Borah
he exact error message, but basically the idea of the error > message is that I cannot use the abstract class Tuple and instead, I should > use Tuple1, Tuple2 and etc. > > Thomas > > On Sun, Jul 10, 2022 at 12:47 PM Hemanga Borah > wrote: > >> What error do you see?

Re: DataStream.keyBy() with keys determined at run time

2022-07-10 Thread Hemanga Borah
What error do you see? On Sun, Jul 10, 2022 at 6:30 AM Thomas Wang wrote: > Hi, > > I have a use case where I need to call DataStream.keyBy() with keys loaded > from a configuration. The number of keys and their data types are variables > and is determined by the configuration. Once the configur

Re: Unit test have Error "could not find implicit value for evidence parameter"

2022-07-09 Thread Hemanga Borah
What version of scala are you using? Depending on the build you are using you may be using 2.11 or 2.12. The version on your maven build files needs to be consistent across your system. On Fri, Jul 8, 2022 at 10:00 PM Min Tu via user wrote: > Hi, > > I have downloaded the flink code and the bui

Re: Migrating Flink apps across cloud with state

2022-05-11 Thread Hemanga Borah
looking for! >> https://issues.apache.org/jira/browse/KAFKA-9076 >> >> https://kafka.apache.org/26/javadoc/org/apache/kafka/connect/mirror/Checkpoint.html >> https://strimzi.io/blog/2020/03/30/introducing-mirrormaker2/ >> >> I tried to find some better docs to link for

Re: Migrating Flink apps across cloud with state

2022-05-04 Thread Hemanga Borah
load/latency/whatever > > > > This scheme sounds more complicated than it really is … and has saved my > sanity quite a number of times 😊 > > > > Good luck and ready to answer more details > > > > Thias > > > > *From:* Hemanga Borah > *Sent:* Tu

Re: Migrating Flink apps across cloud with state

2022-05-03 Thread Hemanga Borah
Any ideas, guys? On Mon, May 2, 2022 at 6:11 PM Hemanga Borah wrote: > Hello, > We are attempting to port our Flink applications from one cloud provider > to another. > > These Flink applications consume data from Kafka topics and output to > various destinations (Kafka

Migrating Flink apps across cloud with state

2022-05-02 Thread Hemanga Borah
Hello, We are attempting to port our Flink applications from one cloud provider to another. These Flink applications consume data from Kafka topics and output to various destinations (Kafka or databases). The applications have states stored in them. Some of these stored states are aggregations,