[jira] [Created] (FLINK-13491) AsyncWaitOperator doesn't handle endOfInput call properly

2019-07-30 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-13491: -- Summary: AsyncWaitOperator doesn't handle endOfInput call properly Key: FLINK-13491 URL: https://issues.apache.org/jira/browse/FLINK-13491 Project: Flink

[jira] [Created] (FLINK-13492) BoundedOutOfOrderTimestamps cause Watermark's timestamp leak

2019-07-30 Thread Simon Su (JIRA)
Simon Su created FLINK-13492: Summary: BoundedOutOfOrderTimestamps cause Watermark's timestamp leak Key: FLINK-13492 URL: https://issues.apache.org/jira/browse/FLINK-13492 Project: Flink Issue T

[jira] [Created] (FLINK-13493) BoundedBlockingSubpartition only notifies onConsumedSubpartition when all the readers are empty

2019-07-30 Thread zhijiang (JIRA)
zhijiang created FLINK-13493: Summary: BoundedBlockingSubpartition only notifies onConsumedSubpartition when all the readers are empty Key: FLINK-13493 URL: https://issues.apache.org/jira/browse/FLINK-13493

NoSuchMethodError: org.apache.calcite.tools.FrameworkConfig.getTraitDefs()

2019-07-30 Thread LakeShen
Hi all,when I use blink flink-sql-parser module,the maven dependency like this: com.alibaba.blink flink-sql-parser 1.5.1 I also import the flink 1.9 blink-table-planner module , I use FlinkPlannerImpl to parse the sql to get the List. But when I run the program , it throws the exception like th

Re: Something wrong with travis?

2019-07-30 Thread Chesnay Schepler
There is nothing to report; we already know what the problem is but it cannot be fixed. On 30/07/2019 08:46, Yun Tang wrote: I met this problem again at https://api.travis-ci.com/v3/job/220732163/log.txt . Is there any place we could ask for help to contact tarvis or any clues we could use to

[jira] [Created] (FLINK-13494) Blink planner changes source parallelism which causes stream SQL e2e test fails

2019-07-30 Thread Zhenghua Gao (JIRA)
Zhenghua Gao created FLINK-13494: Summary: Blink planner changes source parallelism which causes stream SQL e2e test fails Key: FLINK-13494 URL: https://issues.apache.org/jira/browse/FLINK-13494 Proje

[jira] [Created] (FLINK-13495) blink-planner should support decimal precision to table source

2019-07-30 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-13495: Summary: blink-planner should support decimal precision to table source Key: FLINK-13495 URL: https://issues.apache.org/jira/browse/FLINK-13495 Project: Flink

[jira] [Created] (FLINK-13496) Correct the documentation of Gauge metric initialization

2019-07-30 Thread Yun Tang (JIRA)
Yun Tang created FLINK-13496: Summary: Correct the documentation of Gauge metric initialization Key: FLINK-13496 URL: https://issues.apache.org/jira/browse/FLINK-13496 Project: Flink Issue Type:

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-30 Thread Jark Wu
Hi all, Progress updates: 1. the bui...@flink.apache.org can be subscribed now (thanks @Robert), you can send an email to builds-subscr...@flink.apache.org to subscribe. 2. We have a pull request [1] to send only apache/flink builds notifications and it works well. 3. However, all the notification

Re: NoSuchMethodError: org.apache.calcite.tools.FrameworkConfig.getTraitDefs()

2019-07-30 Thread Jark Wu
Hi Lakeshen, Thanks for trying out blink planner. First question, are you using blink-1.5.1 or flink-1.9-table-planner-blink ? We suggest to use the latter one because we don't maintain blink-1.5.1, you can try flink 1.9 instead. Best, Jark On Tue, 30 Jul 2019 at 17:02, LakeShen wrote: > Hi

Reading RocksDB contents from outside of Flink

2019-07-30 Thread Shilpa Deshpande
Hello All, I am new to Apache Flink. In my company we are thinking of using Flink to perform transformation of the data. The source of the data is Apache Kafka topics. Each message that we receive on Kafka topic, we want to transform it and store it on RocksDB. The messages can come out of order.

Re: [DISCUSS] Drop stale class Program

2019-07-30 Thread Zili Chen
Hi, With a one-week survey in user list[1], nobody expect Flavio and Jeff participant the thread. Flavio shared his experience with a revised Program like interface. This could be regraded as downstream integration and in client api enhancements document we propose rich interface for this integra

Re: Reading RocksDB contents from outside of Flink

2019-07-30 Thread taher koitawala
Hi Shilpa, The easiest way to do this is the make the Rocks DB state queryable. Then use the Flink queryable state client to access the state you have created. Regards Taher Koitawala On Tue, Jul 30, 2019, 4:58 PM Shilpa Deshpande wrote: > Hello All, > > I am new to Apache Flink. In my

Re: [DISCUSS] Removing the flink-mapr-fs module

2019-07-30 Thread Stephan Ewen
I will open a PR later today, changing the module to use reflection rather than a hard MapR dependency. On Tue, Jul 30, 2019 at 6:40 AM Rong Rong wrote: > We've also experienced some issues with our internal JFrog artifactory. I > am suspecting some sort of mirroring problem but somehow it only

Re: Reading RocksDB contents from outside of Flink

2019-07-30 Thread Stephan Ewen
Hi! Are you looking for online access or offline access? For online access, you can to key lookups via queryable state. For offline access, you can read and write rocksDB state using the new state processor API in Flink 1.9 https://ci.apache.org/projects/flink/flink-docs-master/dev/libs/state_pr

[jira] [Created] (FLINK-13497) Checkpoints can complete after CheckpointFailureManager fails job

2019-07-30 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13497: - Summary: Checkpoints can complete after CheckpointFailureManager fails job Key: FLINK-13497 URL: https://issues.apache.org/jira/browse/FLINK-13497 Project: Flink

[jira] [Created] (FLINK-13498) Reduce Kafka producer startup time by aborting transactions in parallel

2019-07-30 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-13498: --- Summary: Reduce Kafka producer startup time by aborting transactions in parallel Key: FLINK-13498 URL: https://issues.apache.org/jira/browse/FLINK-13498 Project: Flink

[jira] [Created] (FLINK-13499) Remove dependency on MapR artifact repository

2019-07-30 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-13499: Summary: Remove dependency on MapR artifact repository Key: FLINK-13499 URL: https://issues.apache.org/jira/browse/FLINK-13499 Project: Flink Issue Type: Imp

[jira] [Created] (FLINK-13500) RestClusterClient requires S3 access when HA is configured

2019-07-30 Thread David Judd (JIRA)
David Judd created FLINK-13500: -- Summary: RestClusterClient requires S3 access when HA is configured Key: FLINK-13500 URL: https://issues.apache.org/jira/browse/FLINK-13500 Project: Flink Issue

[jira] [Created] (FLINK-13501) Fixes a few issues in documentation for Hive integration

2019-07-30 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created FLINK-13501: --- Summary: Fixes a few issues in documentation for Hive integration Key: FLINK-13501 URL: https://issues.apache.org/jira/browse/FLINK-13501 Project: Flink Issue

[jira] [Created] (FLINK-13502) CatalogTableStatisticsConverter should be in planner.utils package

2019-07-30 Thread godfrey he (JIRA)
godfrey he created FLINK-13502: -- Summary: CatalogTableStatisticsConverter should be in planner.utils package Key: FLINK-13502 URL: https://issues.apache.org/jira/browse/FLINK-13502 Project: Flink

Re: REST API / JarRunHandler: More flexibility for launching jobs

2019-07-30 Thread Zili Chen
Hi Thomas, IIUC this "launcher" should run on client endpoint instead of dispatcher endpoint. "jar run" will extract the job graph and submit it to the dispatcher, which has mismatched semantic from your willing. Could you run it with CliFrontend? Or propose that "jar run" supports running direct

Re: Flink Kafka Issues

2019-07-30 Thread Ramya Ramamurthy
Hi Jiangjie, Thanks for your response. I was able to figure out the issue. We have multiple end points from which we receive data. Out of which, one of the endpoints NTP was not set up/rather not getting synced to ntp properly. so those VM's were sending packets which was 2 mins ahead of time. So

[jira] [Created] (FLINK-13503) Correct the behavior of `JDBCLookupFunction`

2019-07-30 Thread Jing Zhang (JIRA)
Jing Zhang created FLINK-13503: -- Summary: Correct the behavior of `JDBCLookupFunction` Key: FLINK-13503 URL: https://issues.apache.org/jira/browse/FLINK-13503 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-13504) NoSuchFieldError when executing DDL via tEnv.sqlUpdate in application project

2019-07-30 Thread Jark Wu (JIRA)
Jark Wu created FLINK-13504: --- Summary: NoSuchFieldError when executing DDL via tEnv.sqlUpdate in application project Key: FLINK-13504 URL: https://issues.apache.org/jira/browse/FLINK-13504 Project: Flink

Re: Flink Kafka Issues

2019-07-30 Thread Stephan Ewen
Is the watermarking configured per-partition in Kafka, or per source? If it is configured per partition, then a late (trailing) or early (leading) partition would not affect the watermark as a whole. There would not be any dropping of late data, simply a delay in the results until the latest parti