[jira] [Created] (FLINK-10836) Add repositories and pluginRepositories in root pom.xml

2018-11-08 Thread bjkonglu (JIRA)
bjkonglu created FLINK-10836: Summary: Add repositories and pluginRepositories in root pom.xml Key: FLINK-10836 URL: https://issues.apache.org/jira/browse/FLINK-10836 Project: Flink Issue Type:

Re: how get job id which job run slot

2018-11-08 Thread vino yang
Hi lining, Yes, currently you can't get slot information via the "/taskmanagers/:taskmanagerid" rest API. In addition, please ask questions in the user mailing list. The dev mailing list mainly discusses information related to Flink development. Thanks, vino. lining jing 于2018年11月9日周五 上午5:42写道

[jira] [Created] (FLINK-10835) Remove duplicated Round-robin ChannelSelector implementation in RecordWriterTest

2018-11-08 Thread zhijiang (JIRA)
zhijiang created FLINK-10835: Summary: Remove duplicated Round-robin ChannelSelector implementation in RecordWriterTest Key: FLINK-10835 URL: https://issues.apache.org/jira/browse/FLINK-10835 Project: Fli

[jira] [Created] (FLINK-10834) TableAPI flatten calculated value error

2018-11-08 Thread sunjincheng (JIRA)
sunjincheng created FLINK-10834: --- Summary: TableAPI flatten calculated value error Key: FLINK-10834 URL: https://issues.apache.org/jira/browse/FLINK-10834 Project: Flink Issue Type: Bug

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-11-08 Thread Zhang, Xuefu
Hi Piotr, That seems to be good idea! Since the google doc for the design is currently under extensive review, I will leave it as it is for now. However, I'll convert it to two different FLIPs when the time comes. How does it sound to you? Thanks, Xuefu -

[jira] [Created] (FLINK-10832) StreamExecutionEnvironment.execute() does not return when all sources end

2018-11-08 Thread Arnaud Linz (JIRA)
Arnaud Linz created FLINK-10832: --- Summary: StreamExecutionEnvironment.execute() does not return when all sources end Key: FLINK-10832 URL: https://issues.apache.org/jira/browse/FLINK-10832 Project: Flin

[jira] [Created] (FLINK-10829) Extend FlinkDistribution to support running jars

2018-11-08 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-10829: Summary: Extend FlinkDistribution to support running jars Key: FLINK-10829 URL: https://issues.apache.org/jira/browse/FLINK-10829 Project: Flink Issu

[jira] [Created] (FLINK-10819) The instability problem of CI, JobManagerHAProcessFailureRecoveryITCase.testDispatcherProcessFailure test fail.

2018-11-08 Thread sunjincheng (JIRA)
sunjincheng created FLINK-10819: --- Summary: The instability problem of CI, JobManagerHAProcessFailureRecoveryITCase.testDispatcherProcessFailure test fail. Key: FLINK-10819 URL: https://issues.apache.org/jira/browse/

how get job id which job run slot

2018-11-08 Thread lining jing
Hi, dev. I have a question. Now rest api can get TaskManagerInfo, but can not get information of task which run on slot.

[jira] [Created] (FLINK-10820) Simplify the RebalancePartitioner implementation

2018-11-08 Thread zhijiang (JIRA)
zhijiang created FLINK-10820: Summary: Simplify the RebalancePartitioner implementation Key: FLINK-10820 URL: https://issues.apache.org/jira/browse/FLINK-10820 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-10822) Configurable MetricQueryService interval

2018-11-08 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-10822: Summary: Configurable MetricQueryService interval Key: FLINK-10822 URL: https://issues.apache.org/jira/browse/FLINK-10822 Project: Flink Issue Type:

[jira] [Created] (FLINK-10828) Enforce that all TypeSerializers are tested through SerializerTestBase

2018-11-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10828: -- Summary: Enforce that all TypeSerializers are tested through SerializerTestBase Key: FLINK-10828 URL: https://issues.apache.org/jira/browse/FLINK-10828 Project: F

[jira] [Created] (FLINK-10826) Heavy deployment end-to-end test produces no output on Travis

2018-11-08 Thread Timo Walther (JIRA)
Timo Walther created FLINK-10826: Summary: Heavy deployment end-to-end test produces no output on Travis Key: FLINK-10826 URL: https://issues.apache.org/jira/browse/FLINK-10826 Project: Flink

[jira] [Created] (FLINK-10818) RestartStrategies.fixedDelayRestart Occur NoResourceAvailableException: Not enough free slots available to run the job.

2018-11-08 Thread ambition (JIRA)
ambition created FLINK-10818: Summary: RestartStrategies.fixedDelayRestart Occur NoResourceAvailableException: Not enough free slots available to run the job. Key: FLINK-10818 URL: https://issues.apache.org/jira/brow

[jira] [Created] (FLINK-10823) Missing scala suffixes

2018-11-08 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-10823: Summary: Missing scala suffixes Key: FLINK-10823 URL: https://issues.apache.org/jira/browse/FLINK-10823 Project: Flink Issue Type: Bug Comp

[jira] [Created] (FLINK-10830) Consider making processing time provider pluggable

2018-11-08 Thread Andrey Zagrebin (JIRA)
Andrey Zagrebin created FLINK-10830: --- Summary: Consider making processing time provider pluggable Key: FLINK-10830 URL: https://issues.apache.org/jira/browse/FLINK-10830 Project: Flink Issu

[jira] [Created] (FLINK-10831) Consider making processing time monotonically increasing by default

2018-11-08 Thread Andrey Zagrebin (JIRA)
Andrey Zagrebin created FLINK-10831: --- Summary: Consider making processing time monotonically increasing by default Key: FLINK-10831 URL: https://issues.apache.org/jira/browse/FLINK-10831 Project: Fl

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-11-08 Thread Piotr Nowojski
Hi, Maybe we should split this topic (and the design doc) into couple of smaller ones, hopefully independent. The questions that you have asked Fabian have for example very little to do with reading metadata from Hive Meta Store? Piotrek > On 7 Nov 2018, at 14:27, Fabian Hueske wrote: > > H

Re: [DISCUSS] Table API Enhancement Outline

2018-11-08 Thread jincheng sun
Hi all, We are discussing very detailed content about this proposal. We are trying to design the API in many aspects (functionality, compatibility, ease of use, etc.). I think this is a very good process. Only such a detailed discussion, In order to develop PR more clearly and smoothly in the late

[jira] [Created] (FLINK-10827) Add test for duplicate() to SerializerTestBase

2018-11-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10827: -- Summary: Add test for duplicate() to SerializerTestBase Key: FLINK-10827 URL: https://issues.apache.org/jira/browse/FLINK-10827 Project: Flink Issue Type

Re: [DISCUSS] FLIP-27: Refactor Source Interface

2018-11-08 Thread Becket Qin
Hi Piotrek, > But I don’t see a reason why we should expose both blocking `take()` and non-blocking `poll()` methods to the Flink engine. Someone (Flink engine or connector) would have to do the same busy > looping anyway and I think it would be better to have a simpler connector API (that would s

[jira] [Created] (FLINK-10821) Resuming Externalized Checkpoint E2E test does not Resume from Externalized Checkpoint

2018-11-08 Thread Gary Yao (JIRA)
Gary Yao created FLINK-10821: Summary: Resuming Externalized Checkpoint E2E test does not Resume from Externalized Checkpoint Key: FLINK-10821 URL: https://issues.apache.org/jira/browse/FLINK-10821 Projec

Re: Kinesis consumer e2e test

2018-11-08 Thread Stefan Richter
Hi, I was also just planning to work on it before Stephan contacted Thomas to ask about this test. Thomas, you are right about the structure, the test should also go into the `run-nightly-tests.sh`. What I was planning to do is a simple job that consists of a Kinesis consumer, a mapper that fa

Re: [VOTE] Release 1.7.0, release candidate #1

2018-11-08 Thread jincheng sun
Hi Till, Today when I do the CI before merge code, I find a instability test case: JobManagerHAProcessFailureRecoveryITCase.testDispatcherProcessFailure test fail. I'm not sure if this is issue should blocking the release 1.7, but I think it's best to find the cause and fix it before releasing 1.7

[jira] [Created] (FLINK-10824) Compile Flink unit test failed with 1.6.0 branch

2018-11-08 Thread Hongtao Zhang (JIRA)
Hongtao Zhang created FLINK-10824: - Summary: Compile Flink unit test failed with 1.6.0 branch Key: FLINK-10824 URL: https://issues.apache.org/jira/browse/FLINK-10824 Project: Flink Issue Type

[jira] [Created] (FLINK-10825) ConnectedComponents test instable on Travis

2018-11-08 Thread Timo Walther (JIRA)
Timo Walther created FLINK-10825: Summary: ConnectedComponents test instable on Travis Key: FLINK-10825 URL: https://issues.apache.org/jira/browse/FLINK-10825 Project: Flink Issue Type: Bug

Re: [DISCUSS]Rethink the rescale operation, can we do it async

2018-11-08 Thread Stefan Richter
Hi, in general, I think it is clearly a good idea to make rescaling as cheap and as dynamic as possible and this is a goal that is surely on the long term roadmap of Flink. However, from a technical point of view I think that things are not as simple if you go into details, and details is what

[jira] [Created] (FLINK-10833) FlinkKafkaProducerITCase.testFlinkKafkaProducerFailTransactionCoordinatorBeforeNotify failed on Travis

2018-11-08 Thread Andrey Zagrebin (JIRA)
Andrey Zagrebin created FLINK-10833: --- Summary: FlinkKafkaProducerITCase.testFlinkKafkaProducerFailTransactionCoordinatorBeforeNotify failed on Travis Key: FLINK-10833 URL: https://issues.apache.org/jira/browse/

Re: StreamingFileSink Bug? Committing results on stream close

2018-11-08 Thread Aljoscha Krettek
Hi Addison, unfortunately, there is a long-standing problem that user functions cannot differentiate between successful and erroneous shutdown [1]. I had this high on my private list of things that I finally want to see fixed in Flink 1.8. And your message further confirms this. Best, Aljoscha

Re: Kinesis consumer e2e test

2018-11-08 Thread Till Rohrmann
Hi Thomas, the community is really interested in adding an end-to-end test for the Kinesis connector (producer as well as consumer). Thus, it would be really helpful if you could contribute your work you've already done. Using Kinesalite sounds good to me and you're right and that we assume that

Re: StreamingFileSink Bug? Committing results on stream close

2018-11-08 Thread Till Rohrmann
Hi Addison, thanks for reporting this issue. I've pulled in Kostas who worked on the StreamingFileSink and knows the current behaviour as well as its limitations best. Cheers, Till On Wed, Nov 7, 2018 at 11:49 PM Addison Higham wrote: > Hi all, > > Just run into a bit of a problem and I am not