***UNCHECKED*** [jira] [Created] (FLINK-9943) Support TaskManagerMetricQueryServicePaths msg in JobManager Actor

2018-07-25 Thread Chuanlei Ni (JIRA)
Chuanlei Ni created FLINK-9943: -- Summary: Support TaskManagerMetricQueryServicePaths msg in JobManager Actor Key: FLINK-9943 URL: https://issues.apache.org/jira/browse/FLINK-9943 Project: Flink

***UNCHECKED*** [jira] [Created] (FLINK-9944) Cleanup end-to-end test poms

2018-07-25 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9944: --- Summary: Cleanup end-to-end test poms Key: FLINK-9944 URL: https://issues.apache.org/jira/browse/FLINK-9944 Project: Flink Issue Type: Improvement

Re: Intro

2018-07-25 Thread Till Rohrmann
Hi Kevin, welcome to the Flink project :-) Currently, there is no single person responsible for the documentation of Flink. It is more of a swarm effort but I think it could really benefit from someone sitting in the driver's seat. What the community does is to create issues with the "Documentat

Re: Backwards compatibility for REST API

2018-07-25 Thread Till Rohrmann
Thanks for bringing this issue up Thomas. I think you've raised a very important point that we should try to provide not only for the programming API but also for the REST API compatibility guarantees. Otherwise it is really hard for 3rd party applications to integrate with Flink. I think first as

Re: Backwards compatibility for REST API

2018-07-25 Thread Chesnay Schepler
Pretty sure we can piggyback the compatibility test on top of the REST API E2E test once that is done. Determine available requests for version A, submit against version B, see what happens. On 25.07.2018 09:54, Till Rohrmann wrote: Thanks for bringing this issue up Thomas. I think you've rais

[jira] [Created] (FLINK-9945) RocksDB state backend Checkpointing Failed

2018-07-25 Thread xymaqingxiang (JIRA)
xymaqingxiang created FLINK-9945: Summary: RocksDB state backend Checkpointing Failed Key: FLINK-9945 URL: https://issues.apache.org/jira/browse/FLINK-9945 Project: Flink Issue Type: Bug

Re: Intro

2018-07-25 Thread Kevin Waterson
Thanks Till, I am guessing you have confluence? Kev On Wed, Jul 25, 2018 at 5:43 PM Till Rohrmann wrote: > Hi Kevin, > > welcome to the Flink project :-) > > Currently, there is no single person responsible for the documentation of > Flink. It is more of a swarm effort but I think it could real

Re: [VOTE] Release 1.5.2, release candidate #1

2018-07-25 Thread Chesnay Schepler
+1 - built flink from source - ensured all examples are bundled in binaries - uploaded an example through WebUI, generated the plan and ran the job - verified that TM logs can be accessed through WebUI - ran tests on travis: basic tests: https://travis-ci.org/zentol/flink/builds/407963432

Re: Intro

2018-07-25 Thread Fabian Hueske
Hi Kevin, Welcome to the Flink community! The documentation is located in a folder in the regular code repository [1] and written in Markdown format. You can contribute to the documentation by opening pull requests against the repository. The contribution guidelines give a bit more info on the pr

[jira] [Created] (FLINK-9948) JSON format does not convert timestamps correctly

2018-07-25 Thread Timo Walther (JIRA)
Timo Walther created FLINK-9948: --- Summary: JSON format does not convert timestamps correctly Key: FLINK-9948 URL: https://issues.apache.org/jira/browse/FLINK-9948 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9946) Quickstart E2E test still runs against 1.6

2018-07-25 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9946: --- Summary: Quickstart E2E test still runs against 1.6 Key: FLINK-9946 URL: https://issues.apache.org/jira/browse/FLINK-9946 Project: Flink Issue Type: Bu

[jira] [Created] (FLINK-9947) Document unified table sources/sinks/formats

2018-07-25 Thread Timo Walther (JIRA)
Timo Walther created FLINK-9947: --- Summary: Document unified table sources/sinks/formats Key: FLINK-9947 URL: https://issues.apache.org/jira/browse/FLINK-9947 Project: Flink Issue Type: Improvem

[ANNOUNCE] GitBox is live

2018-07-25 Thread Chesnay Schepler
Hello everyone, the migration to GitBox that was discussed in [1] has finally happened. @contributors/committers: The remote for the apache repository was changed and is now located at https://gitbox.apache.org/repos/asf/flink.git. @committers: I have created a JIRA [2] for issues we find wit

Re: [VOTE] Release 1.5.2, release candidate #1

2018-07-25 Thread Chesnay Schepler
- built flink from source - ensured all examples are bundled in binaries - uploaded a jar through WebUI, generated the plan and ran the job - ran tests on travis: basic tests: https://travis-ci.org/zentol/flink/builds/407963432 E2E tests: https://travis-ci.org/zentol/flink-ci/builds/4080

Re: is Flink's recovery speed still slow?

2018-07-25 Thread jiaxl
Hi vino, Thanks for your early reply. Since 2017, developers of Flink have done great job to improve the performance. But I didn't find papers or blogs as a response to that paper. So I asked this question here. Before asking this question, I was doing some experiment with Flink 1.5.1. But as yo

[jira] [Created] (FLINK-9952) Update buildbot script

2018-07-25 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9952: --- Summary: Update buildbot script Key: FLINK-9952 URL: https://issues.apache.org/jira/browse/FLINK-9952 Project: Flink Issue Type: Sub-task Com

Re: [VOTE] Release 1.6.0, release candidate #1

2018-07-25 Thread Gary Yao
-1 (non-binding) We introduced a regression: https://issues.apache.org/jira/browse/FLINK-9939 Best, Gary On Tue, Jul 24, 2018 at 9:38 AM, Till Rohrmann wrote: > Hi everyone, > Please review and vote on the release candidate #1 for the version 1.6.0, > as follows: > [ ] +1, Approve the release

[jira] [Created] (FLINK-9954) Kubernetes ResourceManager

2018-07-25 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9954: Summary: Kubernetes ResourceManager Key: FLINK-9954 URL: https://issues.apache.org/jira/browse/FLINK-9954 Project: Flink Issue Type: Sub-task Compo

[jira] [Created] (FLINK-9955) Kubernetes ClusterDescriptor

2018-07-25 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9955: Summary: Kubernetes ClusterDescriptor Key: FLINK-9955 URL: https://issues.apache.org/jira/browse/FLINK-9955 Project: Flink Issue Type: Sub-task Com

[jira] [Created] (FLINK-9957) Rescale job wrt to available slots

2018-07-25 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9957: Summary: Rescale job wrt to available slots Key: FLINK-9957 URL: https://issues.apache.org/jira/browse/FLINK-9957 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-9958) Fix potential NPE for delta iteration of DataSet

2018-07-25 Thread Ruidong Li (JIRA)
Ruidong Li created FLINK-9958: - Summary: Fix potential NPE for delta iteration of DataSet Key: FLINK-9958 URL: https://issues.apache.org/jira/browse/FLINK-9958 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9949) Jepsen: Kill Flink processes when tearing down cluster

2018-07-25 Thread Gary Yao (JIRA)
Gary Yao created FLINK-9949: --- Summary: Jepsen: Kill Flink processes when tearing down cluster Key: FLINK-9949 URL: https://issues.apache.org/jira/browse/FLINK-9949 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9950) Handle migration to Gitbox

2018-07-25 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9950: --- Summary: Handle migration to Gitbox Key: FLINK-9950 URL: https://issues.apache.org/jira/browse/FLINK-9950 Project: Flink Issue Type: Improvement

Re: [VOTE] Release 1.5.2, release candidate #1

2018-07-25 Thread Gary Yao
-1 (non-binding) We introduced a regression: https://issues.apache.org/jira/browse/FLINK-9939 Best, Gary P.S. Link under [2] should be https://dist.apache.org/repos/dist/dev/flink/flink-1.5.2/ On Tue, Jul 24, 2018 at 2:43 PM, Chesnay Schepler wrote: > Hi everyone, > Please review and vote on

[jira] [Created] (FLINK-9951) Update scm developerConnection

2018-07-25 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9951: --- Summary: Update scm developerConnection Key: FLINK-9951 URL: https://issues.apache.org/jira/browse/FLINK-9951 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-9953) Active Kubernetes integration

2018-07-25 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9953: Summary: Active Kubernetes integration Key: FLINK-9953 URL: https://issues.apache.org/jira/browse/FLINK-9953 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9956) Push available slots to JobMaster

2018-07-25 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9956: Summary: Push available slots to JobMaster Key: FLINK-9956 URL: https://issues.apache.org/jira/browse/FLINK-9956 Project: Flink Issue Type: Sub-task

[CANCELED] [VOTE] Release 1.5.2, release candidate #1

2018-07-25 Thread Chesnay Schepler
I'm canceling a vote to include the fix for FLINK-9939. On 25.07.2018 16:04, Gary Yao wrote: -1 (non-binding) We introduced a regression: https://issues.apache.org/jira/browse/FLINK-9939 Best, Gary P.S. Link under [2] should be https://dist.apache.org/repos/dist/dev/flink/flink-1.5.2/ On Tue

Re: is Flink's recovery speed still slow?

2018-07-25 Thread vino yang
Hi jiaxl, Thanks for your verification! Yes, Flink is growing very fast. There is really not much benchmark or blog to explore this topic, after all, the local recovery feature is released in version 1.5. The time point is not long before, and this part is still being improved and not very mature

[jira] [Created] (FLINK-9959) JoinFunction should be able to access Window

2018-07-25 Thread Bowen Li (JIRA)
Bowen Li created FLINK-9959: --- Summary: JoinFunction should be able to access Window Key: FLINK-9959 URL: https://issues.apache.org/jira/browse/FLINK-9959 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-9960) JobManager can't failover to hdfs with multiple namenodes

2018-07-25 Thread Julio Biason (JIRA)
Julio Biason created FLINK-9960: --- Summary: JobManager can't failover to hdfs with multiple namenodes Key: FLINK-9960 URL: https://issues.apache.org/jira/browse/FLINK-9960 Project: Flink Issue T

Re: [VOTE] Release 1.6.0, release candidate #1

2018-07-25 Thread Till Rohrmann
Thanks for discovering FLINK-9939 Gary. I'm canceling the vote in order to fix this problem. Cheers, Till On Wed, Jul 25, 2018 at 5:18 PM Gary Yao wrote: > -1 (non-binding) > > We introduced a regression: > https://issues.apache.org/jira/browse/FLINK-9939 > > Best, > Gary > > On Tue, Jul 24, 20

Re: [CANCELED] [VOTE] Release 1.5.2, release candidate #1

2018-07-25 Thread Till Rohrmann
FLINK-9939 should already be fixed in the release-1.5 branch. Cheers, Till On Wed, Jul 25, 2018 at 7:05 PM Chesnay Schepler wrote: > I'm canceling a vote to include the fix for FLINK-9939. > > On 25.07.2018 16:04, Gary Yao wrote: > > -1 (non-binding) > > > > We introduced a regression: > https:

[jira] [Created] (FLINK-9961) Add CHR function for table/sql API

2018-07-25 Thread vinoyang (JIRA)
vinoyang created FLINK-9961: --- Summary: Add CHR function for table/sql API Key: FLINK-9961 URL: https://issues.apache.org/jira/browse/FLINK-9961 Project: Flink Issue Type: New Feature Comp

[jira] [Created] (FLINK-9962) allow users to specify TimeZone in DateTimeBucketer

2018-07-25 Thread Bowen Li (JIRA)
Bowen Li created FLINK-9962: --- Summary: allow users to specify TimeZone in DateTimeBucketer Key: FLINK-9962 URL: https://issues.apache.org/jira/browse/FLINK-9962 Project: Flink Issue Type: Improveme