Prometheus not showing custom metrics for flink

2020-07-04 Thread Manish G
Hi, I have integrated prometheus and flink for monitoring custom flink metrics. But I am not able to get those metrics displayed on prometheus dashboard or on Grafana dashboard. I can see default flink metrics, but not custom ones. I have put details here SO question

Re: Asynchronous I/O poor performance

2020-07-04 Thread Benchao Li
Hi Mark, Could you give more details about your Flink job? - the capacity of AsyncDataStream - the parallelism of AsyncDataStream operator - the time of per blocked rpc request Mark Zitnik 于2020年7月5日周日 上午3:48写道: > Hi > > In my flink application I need to enrich data using > AsyncDataStream.uno

Re: can't exectue query when table type is datagen

2020-07-04 Thread Jingsong Li
Hi, Looks like you are using the watermark feature with the old Flink planner? Is this what you expect? Or can you change the planner to Blink planner? Best, Jingsong On Sun, Jul 5, 2020 at 10:52 AM xin Destiny wrote: > Hi, all: > i use zeppelin execute sql, FLink version is Flink 1.11 snaps

can't exectue query when table type is datagen

2020-07-04 Thread xin Destiny
Hi, all: i use zeppelin execute sql, FLink version is Flink 1.11 snapshot ,build from branch release-1.11 ,commit is 334f35cbd6da754d8b5b294032cd84c858b1f973 when the table type is datagen, Flink will thrown exception ,but the exception message is null ; My DDL is : CREATE TABLE datagen_dijie2 (

Fwd: Asynchronous I/O poor performance

2020-07-04 Thread Mark Zitnik
Hi In my flink application I need to enrich data using AsyncDataStream.unorderedWait but I am getting poor perforce at the beginning I was just working with http call, but I have switched to grpc, I running on 8 core node and getting total of 3200 events per second my service that I am using is no

Re: Parquet data stream group converter error

2020-07-04 Thread Jesse Lord
I should have mentioned that I was able to read the same file in the batch ParquetTableSource. It is only when reading it in a stream that I encounter this error. - Jesse From: Khachatryan Roman Sent: Friday, July 3, 2020 12:08:51 AM To: Jesse Lord Cc: user@fli

[Table API] how to configure a nested timestamp field

2020-07-04 Thread Dongwon Kim
Hi, I use Flink 1.10.1 and I want to use Table API to read JSON messages. The message looks like below. > { >"type":"Update", >"location":{ > "id":"123e4567-e89b-12d3-a456-42665234", > "lastUpdateTime":1593866161436 >} > } I wrote the follo