Is it possible to make SideOutput back to input stream?

2022-03-20 Thread Chen-Che Huang
Hi all, We have an application where the operations on some keys depend on the results of related keys. Assume that there are two keys k1 and k2 that have some relationship between them. Our application won't send the value for key k1 to the data sink when the value for key k2 was sent to the data

Re: exception when parallelizing application

2022-03-20 Thread Guowei Ma
It seems that the key's hashcode is not stable. So would you like to show the details of the `TraceKeyOuterClass.TraceKey`. Best, Guowei On Sun, Mar 20, 2022 at 3:21 PM Prashant Deva wrote: > here is the key code (in kotlin) > > val ks = object: KeySelector TraceFragmentOuterClass.TraceFragm

Re: Flink UI - Operator Chaining - broken with "Records Sent"

2022-03-20 Thread Yun Gao
Hi Dan This seem to be a known issue [1], and which is now tracked in [2]. As a whole, now the record sent only shows the records sent by the "last" operator in the chain, thus if there are chained sideoutput, the number of records in main output would be overriden. Best, Yun [1] https://iss

Re: exception when parallelizing application

2022-03-20 Thread Prashant Deva
here is the key code (in kotlin) val ks = object: KeySelector, TraceKeyOuterClass.TraceKey> { override fun getKey(it:Tuple2): TraceKeyOuterClass.TraceKey { return it.f0 } } and here is the code that uses it: env.addSource(kafkaConsumer, name_source) .name(name_

Re: scala shell not part of 1.14.4 download

2022-03-20 Thread Georg Heiler
Many thanks. I will try your suggestions in the coming days. Why is support for the scala-shell dropped in 2.12? Other projects i.e. spark also managed to keep a spark-shell (REPL like flink's current scala-shell) working for the 2.12 release. Best, Georg Am Fr., 18. März 2022 um 13:33 Uhr schrie