Pending Metrics

Hello! Is there any metric that refers to the queued records, for each operator? Thanks!

Re: Side outputs documentation

Hi Yunfeng, Thanks for the response. I hadn't even seen the other constructor, but it seems that the single-arg constructor works fine even if the output tag is declared as "static final", at least in my use case. I imagine Flink would complain about unknown types if it really can't figure it out

Default Flink S3 FileSource Questions

Hello Flink Community, Flink Version: 1.16.1, Zookeeper for HA. My Flink Applications reads raw parquet files hosted in S3, applies transformations and re-writes them to S3, under a different location. Below is my code to read from parquets from S3: ``` final Configuration configuration = new C

Re: Flink upgrade 1.14.6 to 1.15.4 -> StackOverflowError

Same problem with 1.16.1. But seems we just had too small stack size, which is not enough for 1.15+ (or maybe Java 11 stack usage is bigger), anyway after increasing stack size to 1m (was 220k), application started to work Thanks, Alexey From: liu ron Sent: Thur

Dashboard Bytes/Records Received/Sent showing Zero values

Despite my Flink jobs working, I am unable to get numbers to show up in the dashboard for Bytes/Records Received/Sent after upgrading from 1.12.7 to 1.17.1. I have looked for what the problem might be but do not see anything obvious. I am using Flink with the Pulsar client. I can see metrics und

Execution model when using AsyncIO

Hi Flink users, I was reading the asyncIO operator and couldn't understand the execution model. I started to think about the flink execution model in general and a few questions arose. 1. For a given subtask(one parallel instance of N chained operators) how do the elements get executed?. Do they

Re: Side outputs documentation

Hi Alexis, Thanks for the clarification. I found the second constructor on Flink's master branch here[1], and maybe it was that we had been commenting on different versions of Flink, and the second constructor has not been introduced in the version you use. From the source code I can see that the

Re: Is there any example that use hbase connector in stream API

Hi, There is not a HBase connector for the DataStream API. But we could follow codes in the Table API to learn how to use it. 1. We could know how to build a HBaseTableSchema in HBase2DynamicTableFactory[1]. 2. We could know how to build a RowDataToMutationConverter in HBaseDynamicTableSink[2].