[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-08-26 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438599#comment-15438599 ] Gabor Gevay commented on FLINK-3322: Yes, I think Stephan meant that you would be main

[jira] [Commented] (FLINK-4354) Implement TaskManager side of heartbeat from ResourceManager

2016-08-26 Thread Zhijiang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438609#comment-15438609 ] Zhijiang Wang commented on FLINK-4354: -- Yes, so it would be started after flink-4478

[jira] [Created] (FLINK-4504) Support user to decide whether the result of an operator is presistent

2016-08-26 Thread shuai.xu (JIRA)
shuai.xu created FLINK-4504: --- Summary: Support user to decide whether the result of an operator is presistent Key: FLINK-4504 URL: https://issues.apache.org/jira/browse/FLINK-4504 Project: Flink I

[jira] [Assigned] (FLINK-4504) Support user to decide whether the result of an operator is presistent

2016-08-26 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-4504: --- Assignee: shuai.xu > Support user to decide whether the result of an operator is presistent > ---

[jira] [Commented] (FLINK-4489) Implement TaskManager's SlotManager

2016-08-26 Thread Zhijiang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438621#comment-15438621 ] Zhijiang Wang commented on FLINK-4489: -- Does it refer to the slot manager in {{Resou

[GitHub] flink pull request #2244: [FLINK-3874] Add a Kafka TableSink with JSON seria...

2016-08-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2244 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-3874) Add a Kafka TableSink with JSON serialization

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438634#comment-15438634 ] ASF GitHub Bot commented on FLINK-3874: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-4486) JobManager not fully running when yarn-session.sh finishes

2016-08-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438661#comment-15438661 ] Aljoscha Krettek commented on FLINK-4486: - Or that a {{JobManager}} takes the job

[jira] [Commented] (FLINK-4487) Need tools for managing the yarn-session better

2016-08-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438662#comment-15438662 ] Aljoscha Krettek commented on FLINK-4487: - This could also already be addressed by

[jira] [Commented] (FLINK-4271) There is no way to set parallelism of operators produced by CoGroupedStreams

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438680#comment-15438680 ] ASF GitHub Bot commented on FLINK-4271: --- Github user StephanEwen commented on the is

[GitHub] flink issue #2305: [FLINK-4271] [DataStreamAPI] Enable CoGroupedStreams and ...

2016-08-26 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2305 The methods look good. They need a `@PublicEvolving` annotation and I think we should mark them with `@Deprecated` and comment that they are a temporary workaround while the `apply()` method has

[GitHub] flink issue #2422: FLINK-4499: Introduce findbugs maven plugin

2016-08-26 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2422 Thanks for adding this. I think that pure warning by the plugin will not be read and respected really. So it makes only sense when a "bug" detected by the plugin fails the build.

[GitHub] flink issue #2109: [FLINK-3677] FileInputFormat: Allow to specify include/ex...

2016-08-26 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/2109 Hi, I just saw that this was merged but I still have some comments. What is the reason for the added Guava (test)-dependency? (Probably a leftover but should nevertheless not be in this) And wha

[jira] [Commented] (FLINK-4486) JobManager not fully running when yarn-session.sh finishes

2016-08-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438685#comment-15438685 ] Maximilian Michels commented on FLINK-4486: --- The {{YarnClusterClient}} delays ch

[jira] [Commented] (FLINK-3677) FileInputFormat: Allow to specify include/exclude file name patterns

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438684#comment-15438684 ] ASF GitHub Bot commented on FLINK-3677: --- Github user aljoscha commented on the issue

[jira] [Commented] (FLINK-4499) Introduce findbugs maven plugin

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438683#comment-15438683 ] ASF GitHub Bot commented on FLINK-4499: --- Github user StephanEwen commented on the is

[jira] [Assigned] (FLINK-4486) JobManager not fully running when yarn-session.sh finishes

2016-08-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned FLINK-4486: - Assignee: Maximilian Michels > JobManager not fully running when yarn-session.sh

[jira] [Updated] (FLINK-4486) JobManager not fully running when yarn-session.sh finishes

2016-08-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-4486: -- Fix Version/s: 1.1.2 1.2.0 > JobManager not fully running when yarn-s

[jira] [Commented] (FLINK-4487) Need tools for managing the yarn-session better

2016-08-26 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438690#comment-15438690 ] Stephan Ewen commented on FLINK-4487: - I think that the last changes for cluster manag

[jira] [Commented] (FLINK-3677) FileInputFormat: Allow to specify include/exclude file name patterns

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438691#comment-15438691 ] ASF GitHub Bot commented on FLINK-3677: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request #:

2016-08-26 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/commit/4810910431e01bf143ae77a6e93a86f2fafbccd0#commitcomment-18789532 There is some followup discussion on this in the JIRA issue: https://issues.apache.org/jira/browse/FLINK-3677 --- If your pro

[jira] [Commented] (FLINK-4494) Expose the TimeServiceProvider from the Task to each Operator.

2016-08-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438695#comment-15438695 ] Aljoscha Krettek commented on FLINK-4494: - +1 that would be a very good change >

[jira] [Commented] (FLINK-3677) FileInputFormat: Allow to specify include/exclude file name patterns

2016-08-26 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438697#comment-15438697 ] Stephan Ewen commented on FLINK-3677: - I agree with Aljoscha. I am against adding tha

[GitHub] flink pull request #:

2016-08-26 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/commit/abb4496781883937a935113c1e33ae1174aafa73#commitcomment-18789807 Can I re-iterate on this issue? Do we need tests here that fire up Kafka clusters? Those are very time intensive, they

[jira] [Commented] (FLINK-3874) Add a Kafka TableSink with JSON serialization

2016-08-26 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438710#comment-15438710 ] Stephan Ewen commented on FLINK-3874: - I think this needs some improvement. I also com

[jira] [Comment Edited] (FLINK-3874) Add a Kafka TableSink with JSON serialization

2016-08-26 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438710#comment-15438710 ] Stephan Ewen edited comment on FLINK-3874 at 8/26/16 9:25 AM: --

[GitHub] flink pull request #:

2016-08-26 Thread mushketyk
Github user mushketyk commented on the pull request: https://github.com/apache/flink/commit/abb4496781883937a935113c1e33ae1174aafa73#commitcomment-18789946 Hi Stephan. I think you are right. I'll update the testing as soon as possible and create a different PR to address

[jira] [Commented] (FLINK-3677) FileInputFormat: Allow to specify include/exclude file name patterns

2016-08-26 Thread Ivan Mushketyk (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438716#comment-15438716 ] Ivan Mushketyk commented on FLINK-3677: --- Stephan, Aljoscha Thank you for pointing t

[jira] [Created] (FLINK-4505) Implement abstract TaskManagerFactory to bring up TaskManager for different modes

2016-08-26 Thread Zhijiang Wang (JIRA)
Zhijiang Wang created FLINK-4505: Summary: Implement abstract TaskManagerFactory to bring up TaskManager for different modes Key: FLINK-4505 URL: https://issues.apache.org/jira/browse/FLINK-4505 Proje

[jira] [Updated] (FLINK-4505) Implement TaskManagerFactory to bring up TaskManager for different modes

2016-08-26 Thread Zhijiang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang Wang updated FLINK-4505: - Summary: Implement TaskManagerFactory to bring up TaskManager for different modes (was: Implement

[jira] [Assigned] (FLINK-4505) Implement TaskManagerFactory to bring up TaskManager for different modes

2016-08-26 Thread Zhijiang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang Wang reassigned FLINK-4505: Assignee: Zhijiang Wang > Implement TaskManagerFactory to bring up TaskManager for differen

[jira] [Commented] (FLINK-4271) There is no way to set parallelism of operators produced by CoGroupedStreams

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438733#comment-15438733 ] ASF GitHub Bot commented on FLINK-4271: --- Github user wuchong commented on the issue:

[GitHub] flink issue #2305: [FLINK-4271] [DataStreamAPI] Enable CoGroupedStreams and ...

2016-08-26 Thread wuchong
Github user wuchong commented on the issue: https://github.com/apache/flink/pull/2305 Hi @StephanEwen , comments addressed. I'm not sure whether the comments are correct. Let me know if I'm wrong. --- If your project is set up for it, you can reply to this email and have yo

[jira] [Commented] (FLINK-4363) Implement TaskManager basic startup of all components in java

2016-08-26 Thread Zhijiang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438745#comment-15438745 ] Zhijiang Wang commented on FLINK-4363: -- Hi [~mxm], I have created the FLINK-4505 for

[jira] [Commented] (FLINK-4502) Cassandra connector documentation has misleading consistency guarantees

2016-08-26 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438754#comment-15438754 ] Chesnay Schepler commented on FLINK-4502: - Alright, so let's break this down point

[jira] [Created] (FLINK-4506) CsvOutputFormat defaults allowNullValues to false, even though doc and declaration says true

2016-08-26 Thread Michael Wong (JIRA)
Michael Wong created FLINK-4506: --- Summary: CsvOutputFormat defaults allowNullValues to false, even though doc and declaration says true Key: FLINK-4506 URL: https://issues.apache.org/jira/browse/FLINK-4506

[GitHub] flink pull request #2423: [FLINK-4486] detached YarnSession: wait until clus...

2016-08-26 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/flink/pull/2423 [FLINK-4486] detached YarnSession: wait until cluster startup is complete You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/flink FLINK-4486 Alte

[jira] [Commented] (FLINK-4486) JobManager not fully running when yarn-session.sh finishes

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438759#comment-15438759 ] ASF GitHub Bot commented on FLINK-4486: --- GitHub user mxm opened a pull request:

[jira] [Updated] (FLINK-4498) Better Cassandra sink documentation

2016-08-26 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-4498: Component/s: Cassandra Connector > Better Cassandra sink documentation > ---

[jira] [Updated] (FLINK-4502) Cassandra connector documentation has misleading consistency guarantees

2016-08-26 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-4502: Component/s: Cassandra Connector > Cassandra connector documentation has misleading consiste

[GitHub] flink issue #2361: [FLINK-3318][cep] Add support for quantifiers to CEP's pa...

2016-08-26 Thread mushketyk
Github user mushketyk commented on the issue: https://github.com/apache/flink/pull/2361 Could someone please take a look at this PR? It has been here without a review for more than 2 weeks. --- If your project is set up for it, you can reply to this email and have your reply appear o

[jira] [Commented] (FLINK-3318) Add support for quantifiers to CEP's pattern API

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438769#comment-15438769 ] ASF GitHub Bot commented on FLINK-3318: --- Github user mushketyk commented on the issu

[GitHub] flink issue #2269: [FLINK-4190] Generalise RollingSink to work with arbitrar...

2016-08-26 Thread joshfg
Github user joshfg commented on the issue: https://github.com/apache/flink/pull/2269 Hi Aljoscha, just wanted to remind you about this - any idea when the changes will be merged in? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear o

[jira] [Commented] (FLINK-4190) Generalise RollingSink to work with arbitrary buckets

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438770#comment-15438770 ] ASF GitHub Bot commented on FLINK-4190: --- Github user joshfg commented on the issue:

[jira] [Created] (FLINK-4507) Deprecate savepoint backend config

2016-08-26 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-4507: -- Summary: Deprecate savepoint backend config Key: FLINK-4507 URL: https://issues.apache.org/jira/browse/FLINK-4507 Project: Flink Issue Type: Sub-task C

[GitHub] flink pull request #2374: [FLINK-3950] Add Meter Metric Type

2016-08-26 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2374#discussion_r76410073 --- Diff: docs/monitoring/metrics.md --- @@ -155,6 +155,55 @@ public class MyMapper extends RichMapFunction { } {% endhighlight %} + Met

[jira] [Commented] (FLINK-3950) Add Meter Metric Type

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438868#comment-15438868 ] ASF GitHub Bot commented on FLINK-3950: --- Github user zentol commented on a diff in t

[GitHub] flink pull request #2374: [FLINK-3950] Add Meter Metric Type

2016-08-26 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2374#discussion_r76410471 --- Diff: flink-metrics/flink-metrics-dropwizard/src/test/java/org/apache/flink/dropwizard/metrics/DropwizardMeterWrapperTest.java --- @@ -0,0 +1,60 @@ +/

[jira] [Commented] (FLINK-3950) Add Meter Metric Type

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438875#comment-15438875 ] ASF GitHub Bot commented on FLINK-3950: --- Github user zentol commented on a diff in t

[jira] [Commented] (FLINK-3950) Add Meter Metric Type

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438884#comment-15438884 ] ASF GitHub Bot commented on FLINK-3950: --- Github user zentol commented on a diff in t

[jira] [Commented] (FLINK-4487) Need tools for managing the yarn-session better

2016-08-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438883#comment-15438883 ] Maximilian Michels commented on FLINK-4487: --- {quote} 1. If there is already a ya

[GitHub] flink pull request #2374: [FLINK-3950] Add Meter Metric Type

2016-08-26 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2374#discussion_r76411144 --- Diff: flink-metrics/flink-metrics-core/src/main/java/org/apache/flink/metrics/Meter.java --- @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Softw

[jira] [Commented] (FLINK-3677) FileInputFormat: Allow to specify include/exclude file name patterns

2016-08-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438935#comment-15438935 ] Maximilian Michels commented on FLINK-3677: --- I reviewed the pull requests and I

[jira] [Commented] (FLINK-3677) FileInputFormat: Allow to specify include/exclude file name patterns

2016-08-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438936#comment-15438936 ] Maximilian Michels commented on FLINK-3677: --- No worries. Your changes are not wr

[GitHub] flink issue #2109: [FLINK-3677] FileInputFormat: Allow to specify include/ex...

2016-08-26 Thread mxm
Github user mxm commented on the issue: https://github.com/apache/flink/pull/2109 @aljoscha As already pointed out in the JIRA issue, the method is not new. A now obsolete method has been deprecated (the diff is hard to read). --- If your project is set up for it, you can reply to th

[jira] [Commented] (FLINK-3677) FileInputFormat: Allow to specify include/exclude file name patterns

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438938#comment-15438938 ] ASF GitHub Bot commented on FLINK-3677: --- Github user mxm commented on the issue:

[jira] [Created] (FLINK-4508) Consolidate DummyEnvironment and MockEnvironment for Tests

2016-08-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4508: - Summary: Consolidate DummyEnvironment and MockEnvironment for Tests Key: FLINK-4508 URL: https://issues.apache.org/jira/browse/FLINK-4508 Project: Flink Is

[GitHub] flink issue #2330: FLINK-4311 Fixed several problems in TableInputFormat

2016-08-26 Thread nielsbasjes
Github user nielsbasjes commented on the issue: https://github.com/apache/flink/pull/2330 I managed to resolve the problems with running these unit tests. These problems were caused by version conflicts in guava. Now we have a HBaseMiniCluster that is started, a table with mult

[jira] [Commented] (FLINK-4311) TableInputFormat fails when reused on next split

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439102#comment-15439102 ] ASF GitHub Bot commented on FLINK-4311: --- Github user nielsbasjes commented on the is

[GitHub] flink issue #2391: [FLINK-3580] [table] Implement FLOOR/CEIL for time points

2016-08-26 Thread twalthr
Github user twalthr commented on the issue: https://github.com/apache/flink/pull/2391 Thanks @fhueske. I will address your comments and merge this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[jira] [Commented] (FLINK-3580) Reintroduce Date/Time and implement scalar functions for it

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439108#comment-15439108 ] ASF GitHub Bot commented on FLINK-3580: --- Github user twalthr commented on the issue:

[jira] [Commented] (FLINK-4487) Need tools for managing the yarn-session better

2016-08-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439112#comment-15439112 ] Maximilian Michels commented on FLINK-4487: --- I totally forgot that there is also

[GitHub] flink pull request #2391: [FLINK-3580] [table] Implement FLOOR/CEIL for time...

2016-08-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2391 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-3580) Reintroduce Date/Time and implement scalar functions for it

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439125#comment-15439125 ] ASF GitHub Bot commented on FLINK-3580: --- Github user asfgit closed the pull request

[jira] [Created] (FLINK-4509) Specify savepoint directory per savepoint

2016-08-26 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-4509: -- Summary: Specify savepoint directory per savepoint Key: FLINK-4509 URL: https://issues.apache.org/jira/browse/FLINK-4509 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4510) Always create CheckpointCoordinator

2016-08-26 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-4510: -- Summary: Always create CheckpointCoordinator Key: FLINK-4510 URL: https://issues.apache.org/jira/browse/FLINK-4510 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4511) Schedule periodic savepoints

2016-08-26 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-4511: -- Summary: Schedule periodic savepoints Key: FLINK-4511 URL: https://issues.apache.org/jira/browse/FLINK-4511 Project: Flink Issue Type: Sub-task Compone

[jira] [Commented] (FLINK-4508) Consolidate DummyEnvironment and MockEnvironment for Tests

2016-08-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439165#comment-15439165 ] Aljoscha Krettek commented on FLINK-4508: - Plus there's custom-mocked Environments

[jira] [Created] (FLINK-4512) Add option for persistent checkpoints

2016-08-26 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-4512: -- Summary: Add option for persistent checkpoints Key: FLINK-4512 URL: https://issues.apache.org/jira/browse/FLINK-4512 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-4440) Make API for edge/vertex creation less verbose

2016-08-26 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439178#comment-15439178 ] Vasia Kalavri commented on FLINK-4440: -- Alright, makes sense. Let's close this then.

[jira] [Commented] (FLINK-4440) Make API for edge/vertex creation less verbose

2016-08-26 Thread Ivan Mushketyk (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439188#comment-15439188 ] Ivan Mushketyk commented on FLINK-4440: --- It's ok with me. I'll close the JIRA issue

[jira] [Closed] (FLINK-4440) Make API for edge/vertex creation less verbose

2016-08-26 Thread Ivan Mushketyk (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Mushketyk closed FLINK-4440. - Resolution: Not A Problem > Make API for edge/vertex creation less verbose > -

[jira] [Commented] (FLINK-4459) Introduce SlotProvider for Scheduler

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439239#comment-15439239 ] ASF GitHub Bot commented on FLINK-4459: --- GitHub user KurtYoung opened a pull request

[GitHub] flink pull request #2424: [FLINK-4459][Scheduler] Introduce SlotProvider for...

2016-08-26 Thread KurtYoung
GitHub user KurtYoung opened a pull request: https://github.com/apache/flink/pull/2424 [FLINK-4459][Scheduler] Introduce SlotProvider for Scheduler Introduce SlotProvider, prepare for the further slot allocation refactoring You can merge this pull request into a Git repository by ru

[GitHub] flink issue #2269: [FLINK-4190] Generalise RollingSink to work with arbitrar...

2016-08-26 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/2269 Hi, I'm very for the delays! I still have this sitting at the top of my list and I'm hoping to get this in by beginning of next week. --- If your project is set up for it, you can reply to this

[jira] [Commented] (FLINK-4190) Generalise RollingSink to work with arbitrary buckets

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439249#comment-15439249 ] ASF GitHub Bot commented on FLINK-4190: --- Github user aljoscha commented on the issue

[jira] [Commented] (FLINK-3677) FileInputFormat: Allow to specify include/exclude file name patterns

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439277#comment-15439277 ] ASF GitHub Bot commented on FLINK-3677: --- Github user aljoscha commented on the issue

[GitHub] flink issue #2109: [FLINK-3677] FileInputFormat: Allow to specify include/ex...

2016-08-26 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/2109 @mxm @mushketyk Technically this change does add a new method that is the now deprecated method minus the `FilePathFilter`. That's a good change, though, since it simplifies the API in the long run.

[jira] [Created] (FLINK-4513) Kafka connector documentation refers to Flink 1.1-SNAPSHOT

2016-08-26 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-4513: Summary: Kafka connector documentation refers to Flink 1.1-SNAPSHOT Key: FLINK-4513 URL: https://issues.apache.org/jira/browse/FLINK-4513 Project: Flink Issu

[jira] [Commented] (FLINK-4510) Always create CheckpointCoordinator

2016-08-26 Thread Jark Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439292#comment-15439292 ] Jark Wu commented on FLINK-4510: Hi [~uce] , I would like to contribute this issue. > Alw

[GitHub] flink issue #2109: [FLINK-3677] FileInputFormat: Allow to specify include/ex...

2016-08-26 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2109 Ah, got it too now. The diff only makes it appear like the deprecated method is new. Then I take that back :-) A followup on removing Guava would be nice, through... --- If your project is s

[jira] [Commented] (FLINK-3677) FileInputFormat: Allow to specify include/exclude file name patterns

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439303#comment-15439303 ] ASF GitHub Bot commented on FLINK-3677: --- Github user StephanEwen commented on the is

[jira] [Updated] (FLINK-4510) Always create CheckpointCoordinator

2016-08-26 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-4510: Assignee: Jark Wu > Always create CheckpointCoordinator > --- > >

[jira] [Commented] (FLINK-4510) Always create CheckpointCoordinator

2016-08-26 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439312#comment-15439312 ] Stephan Ewen commented on FLINK-4510: - [~jark] Thanks for helping out here. I assigned

[jira] [Commented] (FLINK-4512) Add option for persistent checkpoints

2016-08-26 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439315#comment-15439315 ] Stephan Ewen commented on FLINK-4512: - +1 that makes a lot of sense. One thing to wat

[jira] [Commented] (FLINK-4509) Specify savepoint directory per savepoint

2016-08-26 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439317#comment-15439317 ] Stephan Ewen commented on FLINK-4509: - I think this needs some pre-requisite changes t

[jira] [Commented] (FLINK-4419) Batch improvement for supporting dfs as a ResultPartitionType

2016-08-26 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439327#comment-15439327 ] Greg Hogan commented on FLINK-4419: --- My apologies for being late to this discussion. Are

[GitHub] flink issue #2419: [FLINK-4488] only automatically shutdown clusters for det...

2016-08-26 Thread mxm
Github user mxm commented on the issue: https://github.com/apache/flink/pull/2419 Our currents tests make it difficult to test such behavior. Added a check to the `YarnTestBase`. Basically, I'm skipping the cluster shutdown to check if the JobManager is still alive and hasn't been shu

[jira] [Commented] (FLINK-4488) Prevent cluster shutdown after job execution for non-detached jobs

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439346#comment-15439346 ] ASF GitHub Bot commented on FLINK-4488: --- Github user mxm commented on the issue:

[GitHub] flink issue #2418: [FLINK-4245] JMXReporter exposes all defined variables

2016-08-26 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2418 Looks good to me! The only not-so-nice thing is that we have to convert the `Map` to a `HashTable` for every metric. Given how we tried to optimize the metric creation overhead, this it

[jira] [Commented] (FLINK-4245) Metric naming improvements

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439348#comment-15439348 ] ASF GitHub Bot commented on FLINK-4245: --- Github user StephanEwen commented on the is

[jira] [Commented] (FLINK-4245) Metric naming improvements

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439359#comment-15439359 ] ASF GitHub Bot commented on FLINK-4245: --- Github user StephanEwen commented on the is

[GitHub] flink issue #2418: [FLINK-4245] JMXReporter exposes all defined variables

2016-08-26 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2418 Actually, it may be possible, and not too bad if we assume the Hashtable is immutable. Something like this: ```java public class HashtableWrapper extends Hashtable { priv

[GitHub] flink issue #2109: [FLINK-3677] FileInputFormat: Allow to specify include/ex...

2016-08-26 Thread mushketyk
Github user mushketyk commented on the issue: https://github.com/apache/flink/pull/2109 @mxm @aljoscha @StephanEwen Thank you for your comments. Seems like this is sorted out :) I'll remove Guava calls today at the evening. --- If your project is set up for it, you can reply to t

[jira] [Commented] (FLINK-3677) FileInputFormat: Allow to specify include/exclude file name patterns

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439364#comment-15439364 ] ASF GitHub Bot commented on FLINK-3677: --- Github user mushketyk commented on the issu

[GitHub] flink issue #2376: [FLINK-3755] Introduce key groups for key-value state to ...

2016-08-26 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2376 Very good work and very nice code! Some comments after a joint review: - The most critical issue is that there should not be any blocking on async threads during task shutdown.

[jira] [Commented] (FLINK-3755) Introduce key groups for key-value state to support dynamic scaling

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439372#comment-15439372 ] ASF GitHub Bot commented on FLINK-3755: --- Github user StephanEwen commented on the is

[GitHub] flink issue #2388: [FLINK-4347][cluster management] Implement SlotManager co...

2016-08-26 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2388 Looks quite good all in all. Be good to get this in, so that JobManager followup work can build on this. I would take this, rebase it, and merge it. If I find some issues I would crea

[jira] [Commented] (FLINK-4347) Implement SlotManager core

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439373#comment-15439373 ] ASF GitHub Bot commented on FLINK-4347: --- Github user StephanEwen commented on the is

[GitHub] flink pull request #2383: [FLINK-4418] [client] Improve resilience when Inet...

2016-08-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2383 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

  1   2   >