Re: [BULK]Re: [SURVEY] Remove Mesos support

2020-10-27 Thread Oleksandr Nitavskyi
should be totally fine. In the future, we would be glad to help you guys with any maintenance-related questions. One of the highest priorities around this component seems to be the development of the full e2e test. Kind Regards Oleksandr Nitavskyi From: Xintong

DisableGenericTypes is not compatible with Kafka

2020-01-30 Thread Oleksandr Nitavskyi
Hi guys, We have encountered on some issue related with possibility to ‘disableGenericTypes’ (disabling Kryo for the job). It seems a very nice as idea to ensure that nobody introduce some random change which penalize the performance of the job. The issue we have encountered is that Flink’s Ka

Re: [BULK]Re: DisableGenericTypes is not compatible with Kafka

2020-02-05 Thread Oleksandr Nitavskyi
d7a9763f2a%7C2a35d8fd574d48e3927c8c398e225a01%7C1%7C0%7C637164197634662107&sdata=YbnYb1Cjf%2BqotG8WkE8hC8ElpX9S2C%2BPDn464Hn5XyI%3D&reserved=0 > > Best, > Guowei > > > Oleksandr Nitavskyi 于2020年1月31日周五 上午12:40写道: > >> Hi guys, >> >> >> >> We have e

CoreOptions.TMP_DIRS bug

2018-07-04 Thread Oleksandr Nitavskyi
another folders, that folders allocated by YARN TaskManager cannot be started. Could you please confirm that it is a bug and I will create a Jira ticket to track it? Thanks Kind Regards Oleksandr Nitavskyi

Table API, custom window

2018-08-09 Thread Oleksandr Nitavskyi
Oleksandr Nitavskyi

Custom metrics in Watermark Assigner

2018-09-12 Thread Oleksandr Nitavskyi
Hello guys, In our custom AssignerWithPunctuatedWatermarks we want to have custom metrics. Unfortunately operator’s wrapping this assigner interface is hidden from user API. What do you think if we add some optional api in order to let user possibility to register custom metrics in the watermar

Re: Weird behaviour after change sources in a job.

2018-09-13 Thread Oleksandr Nitavskyi
Hello Dawid, Thank you for the answer. In our case we did change the name of the Kafka source so we expected it shouldn’t restore state for a given Kafka source operator. Anyway shouldn’t FlinkKafkaConsumerBase have a safeguard which do not allow restoring of the KafkaTopicPartitions from the

Re: Weird behaviour after change sources in a job.

2018-09-13 Thread Oleksandr Nitavskyi
September 2018 at 11:15 To: Oleksandr Nitavskyi Cc: R&D/Product Engineering/PRIME/Delight , "gor...@data-artisans.com" , Juan Gentile , "user@flink.apache.org" Subject: Re: Weird behaviour after change sources in a job. Hi Oleksandr, The mapping of state to operator is d

Flink 1.6, User Interface response time

2018-10-31 Thread Oleksandr Nitavskyi
Hello! We are migrating the the last 1.6.2 version and all the jobs seem to work fine, but when we check individual jobs through the web interface we encounter the issue that after clicking on a job, either it takes too long to load the information of the job or it never loads at all. Has anyo

Re: 1.6 UI issues

2019-01-02 Thread Oleksandr Nitavskyi
finished no UI has been changed. We will have a look closer on this behavior. Does it ring a bell for you probably? Thank you Kind Regards Oleksandr From: Till Rohrmann Date: Wednesday 19 December 2018 at 16:52 To: Juan Gentile Cc: "dwysakow...@apache.org" , Jeff Bean , Oleksandr

Re: Flink on Mesos

2019-07-23 Thread Oleksandr Nitavskyi
Rohrmann Date: Friday 5 April 2019 at 16:46 To: Juan Gentile Cc: "user@flink.apache.org" , Oleksandr Nitavskyi Subject: Re: Flink on Mesos Hi Juan, thanks for reporting this issue. If you could open an issue and also provide a fix for it, then this would be awesome. Please let me know

Flink long-running streaming job, Keytab authentication

2017-12-14 Thread Oleksandr Nitavskyi
Hello all, I have a question about Kerberos authentication in Yarn environment for long running streaming job. According to the documentation ( https://ci.apache.org/projects/flink/flink-docs-release-1.4/ops/security-kerberos.html#yarnmesos-mode ) Flink’s solution is to use keytab in order to p

Output batch to Kafka

2018-06-04 Thread Oleksandr Nitavskyi
is there a way to output data into the Kafka using the Batch approach? Thanks Kind Regards Oleksandr Nitavskyi