how to count kafka sink number

hi i have a flink sql, reading record from kafka, then use table function do some transformation, then produce to kafka. i have found that in the flink web record received of the first subTask is always 0 ,and the Records send of the last subTask is 0 as well. i want to count how many r

Re: Approach to Auto Scaling Flink Job

Hi Anil, The reason why we are using Docker is because internally we support Dockerized container for microservices. Ideally speaking this can be any external service running on something other than the actual YARN cluster you Flink application resides. Basically watchdog runs outside of the Flin

problem with avro serialization

Hello - Facing an issue with avro serialization with Scala case classes generated through avrohugger .. Scala case classes generated by avrohugger has the avro schema in the companion object. This is a sample generated class (details elided) .. case class Data(var id: Int, var name: String) exten

Re: Reconstruct object through partial select query

Hi shahar, An easier way to solve your problem is to use a Row to store your data instead of the `TaggedEvent `. I think this is what Fabian means. In this way, you don't have to define the user-defined TypeFactory and use the Row type directly. Take `TaggedEvent` as an example, the corresponding

Re: Getting async function call terminated with an exception

Thank you! that did it ! On Wed, May 8, 2019 at 5:42 PM Till Rohrmann wrote: > *This Message originated outside your organization.* > -- > Hi Avi, > > you need to complete the given resultFuture and not return a future. You > can do this via resultFuture.complete(r).