[jira] [Closed] (FLINK-3446) Back pressure tracker throws NPE for archived jobs

2016-02-19 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi closed FLINK-3446. -- Resolution: Fixed Fixed in 5aa7c25. > Back pressure tracker throws NPE for archived jobs > ---

[jira] [Commented] (FLINK-3446) Back pressure tracker throws NPE for archived jobs

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155113#comment-15155113 ] ASF GitHub Bot commented on FLINK-3446: --- Github user asfgit closed the pull request

[GitHub] flink pull request: [FLINK-3446] [runtime-web] Don't trigger back ...

2016-02-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1673 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Closed] (FLINK-3381) Unstable Test: JobManagerSubmittedJobGraphsRecoveryITCase

2016-02-19 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi closed FLINK-3381. -- Resolution: Fixed Hopefully fixed in 59f978f. > Unstable Test: JobManagerSubmittedJobGraphsRecoveryITCa

[GitHub] flink pull request: Various test stability fixes

2016-02-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1676 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-3443) JobManager cancel and clear everything fails jobs instead of cancelling

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155099#comment-15155099 ] ASF GitHub Bot commented on FLINK-3443: --- Github user uce commented on a diff in the

[GitHub] flink pull request: [FLINK-3443] [runtime] Prevent cancelled jobs ...

2016-02-19 Thread uce
Github user uce commented on a diff in the pull request: https://github.com/apache/flink/pull/1669#discussion_r53531860 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/JobManager.scala --- @@ -1487,7 +1487,7 @@ class JobManager( }

[GitHub] flink pull request: Various test stability fixes

2016-02-19 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/1676#issuecomment-186440261 Thanks, let me merge this then. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Commented] (FLINK-3453) Fix TaskManager logs exception when sampling backpressure while task completes

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155054#comment-15155054 ] ASF GitHub Bot commented on FLINK-3453: --- GitHub user uce opened a pull request:

[GitHub] flink pull request: [FLINK-3453] [runtime, runtime-web] Report par...

2016-02-19 Thread uce
GitHub user uce opened a pull request: https://github.com/apache/flink/pull/1678 [FLINK-3453] [runtime, runtime-web] Report partial stack trace sample for cleared tasks Ongoing stack trace samples were considered failed if the tasks were cleared concurrently. Instead, they now repo

[jira] [Commented] (FLINK-3445) make JDBCInputFormat implement ResultTypeQueryable

2016-02-19 Thread Ken Geis (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154945#comment-15154945 ] Ken Geis commented on FLINK-3445: - To provide a little more context, I am coding in Groovy

[jira] [Commented] (FLINK-3398) Flink Kafka consumer should support auto-commit opt-outs

2016-02-19 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154906#comment-15154906 ] Shikhar Bhushan commented on FLINK-3398: Can this be addressed for 1.0 -- currentl

[jira] [Commented] (FLINK-3385) Fix outer join skipping unprobed partitions

2016-02-19 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154905#comment-15154905 ] Greg Hogan commented on FLINK-3385: --- Will submit the pull request when Travis has finish

[jira] [Commented] (FLINK-3368) Kafka 0.8 consumer fails to recover from broker shutdowns

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154902#comment-15154902 ] ASF GitHub Bot commented on FLINK-3368: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-3368][Kafka 0.8] Handle leader changes ...

2016-02-19 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1623#issuecomment-186418102 Thanks! And I finally got the meaning of that method with the nested loops ;-) --- If your project is set up for it, you can reply to this email and have your reply

[jira] [Created] (FLINK-3456) Backpressure Monitoring does not work for Kafka Sources

2016-02-19 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3456: --- Summary: Backpressure Monitoring does not work for Kafka Sources Key: FLINK-3456 URL: https://issues.apache.org/jira/browse/FLINK-3456 Project: Flink Issue Typ

[jira] [Commented] (FLINK-3443) JobManager cancel and clear everything fails jobs instead of cancelling

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154855#comment-15154855 ] ASF GitHub Bot commented on FLINK-3443: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request: [FLINK-3443] [runtime] Prevent cancelled jobs ...

2016-02-19 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/1669#discussion_r53517217 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/JobManager.scala --- @@ -1487,7 +1487,7 @@ class JobManager( }

[jira] [Commented] (FLINK-3439) Remove final Long.MAX_VALUE Watermark in StreamSource

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154836#comment-15154836 ] ASF GitHub Bot commented on FLINK-3439: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-3449] createInput() no longer swallows ...

2016-02-19 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1675#issuecomment-186398003 Looks good, +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Commented] (FLINK-3449) createInput swallows exception if TypeExtractor fails

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154837#comment-15154837 ] ASF GitHub Bot commented on FLINK-3449: --- Github user StephanEwen commented on the pu

[jira] [Commented] (FLINK-3439) Remove final Long.MAX_VALUE Watermark in StreamSource

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154835#comment-15154835 ] ASF GitHub Bot commented on FLINK-3439: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request: [FLINK-3439] Remove final Long.MAX_VALUE Water...

2016-02-19 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1677#issuecomment-186397860 Good and important fix. Can you add checks as described in the comments? Otherwise, +1 to merge --- If your project is set up for it, you can reply to this

[jira] [Commented] (FLINK-3439) Remove final Long.MAX_VALUE Watermark in StreamSource

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154834#comment-15154834 ] ASF GitHub Bot commented on FLINK-3439: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request: [FLINK-3439] Remove final Long.MAX_VALUE Water...

2016-02-19 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/1677#discussion_r53515651 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/timestamp/TimestampITCase.java --- @@ -346,9 +339,6 @@ public long checkAndGetNex

[GitHub] flink pull request: [FLINK-3439] Remove final Long.MAX_VALUE Water...

2016-02-19 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/1677#discussion_r53515589 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/timestamp/TimestampITCase.java --- @@ -157,13 +157,6 @@ public void testWatermark

[jira] [Commented] (FLINK-2213) Configure number of vcores

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154832#comment-15154832 ] ASF GitHub Bot commented on FLINK-2213: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: FLINK-2213 Makes the number of vcores per YARN...

2016-02-19 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1588#issuecomment-186396847 In my private tests and here, `YARNSessionFIFOITCase.testQueryCluster` failed with a timeout. Something has made this test unstable. --- If your project is set up for

[GitHub] flink pull request: Various test stability fixes

2016-02-19 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1676#issuecomment-186396861 Super, thanks for this nice piece of work! We'll all enjoy the enhanced test stability :-) Changes look good, +1 to merge this --- If your project is se

[jira] [Commented] (FLINK-3238) EventTimeAllWindowCheckpointingITCase.testSlidingTimeWindow()

2016-02-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154795#comment-15154795 ] Robert Metzger commented on FLINK-3238: --- Got it again https://s3.amazonaws.com/arch

[jira] [Commented] (FLINK-3446) Back pressure tracker throws NPE for archived jobs

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154723#comment-15154723 ] ASF GitHub Bot commented on FLINK-3446: --- Github user uce commented on the pull reque

[GitHub] flink pull request: [FLINK-3446] [runtime-web] Don't trigger back ...

2016-02-19 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/1673#issuecomment-186370222 Merging this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[jira] [Assigned] (FLINK-3453) Fix TaskManager logs exception when sampling backpressure while task completes

2016-02-19 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi reassigned FLINK-3453: -- Assignee: Ufuk Celebi > Fix TaskManager logs exception when sampling backpressure while task co

[jira] [Commented] (FLINK-2213) Configure number of vcores

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154689#comment-15154689 ] ASF GitHub Bot commented on FLINK-2213: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: FLINK-2213 Makes the number of vcores per YARN...

2016-02-19 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1588#issuecomment-186364227 I started some tests on my travis as well to see whether the one YARN test failure is a coincidence: https://travis-ci.org/rmetzger/flink/builds/110454166 --- If your

[jira] [Commented] (FLINK-3439) Remove final Long.MAX_VALUE Watermark in StreamSource

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154674#comment-15154674 ] ASF GitHub Bot commented on FLINK-3439: --- GitHub user aljoscha opened a pull request:

[GitHub] flink pull request: [FLINK-3439] Remove final Long.MAX_VALUE Water...

2016-02-19 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/flink/pull/1677 [FLINK-3439] Remove final Long.MAX_VALUE Watermark in StreamSource You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/flink watermark-rem

[jira] [Updated] (FLINK-3455) Bump Kafka 0.9 connector dependency to Kafka 0.9.0.1

2016-02-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-3455: -- Issue Type: Improvement (was: Bug) > Bump Kafka 0.9 connector dependency to Kafka 0.9.0.1 > ---

[jira] [Created] (FLINK-3455) Bump Kafka 0.9 connector dependency to Kafka 0.9.0.1

2016-02-19 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-3455: - Summary: Bump Kafka 0.9 connector dependency to Kafka 0.9.0.1 Key: FLINK-3455 URL: https://issues.apache.org/jira/browse/FLINK-3455 Project: Flink Issue Ty

[jira] [Resolved] (FLINK-3368) Kafka 0.8 consumer fails to recover from broker shutdowns

2016-02-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-3368. --- Resolution: Fixed Fix Version/s: 1.0.0 Fixed in http://git-wip-us.apache.org/repos/asf/

[jira] [Resolved] (FLINK-3386) Kafka consumers are not properly respecting the "auto.offset.reset" behavior

2016-02-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-3386. --- Resolution: Fixed Fix Version/s: 1.0.0 Closed in http://git-wip-us.apache.org/repos/asf

[GitHub] flink pull request: [FLINK-3368][Kafka 0.8] Improvements to the Ka...

2016-02-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1672 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] flink pull request: [FLINK-3368][Kafka 0.8] Handle leader changes ...

2016-02-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1623 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-3368) Kafka 0.8 consumer fails to recover from broker shutdowns

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154632#comment-15154632 ] ASF GitHub Bot commented on FLINK-3368: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-3368) Kafka 0.8 consumer fails to recover from broker shutdowns

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154633#comment-15154633 ] ASF GitHub Bot commented on FLINK-3368: --- Github user asfgit closed the pull request

[jira] [Created] (FLINK-3454) Add test dependencies on packaged jars

2016-02-19 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-3454: - Summary: Add test dependencies on packaged jars Key: FLINK-3454 URL: https://issues.apache.org/jira/browse/FLINK-3454 Project: Flink Issue Type: Bug Comp

[jira] [Commented] (FLINK-3385) Fix outer join skipping unprobed partitions

2016-02-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154530#comment-15154530 ] Fabian Hueske commented on FLINK-3385: -- Great, thanks a lot! > Fix outer join skippi

[jira] [Commented] (FLINK-3385) Fix outer join skipping unprobed partitions

2016-02-19 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154512#comment-15154512 ] Greg Hogan commented on FLINK-3385: --- Yes, I literally have my test passing as of 5 minut

[jira] [Commented] (FLINK-3385) Fix outer join skipping unprobed partitions

2016-02-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154506#comment-15154506 ] Fabian Hueske commented on FLINK-3385: -- Hi [~greghogan], have you started to work on

[jira] [Commented] (FLINK-3452) Procuring more Travis CI build capacity for Flink

2016-02-19 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154490#comment-15154490 ] Greg Hogan commented on FLINK-3452: --- Ah, yes, well, that is to be expected. Flink is clo

[jira] [Commented] (FLINK-3452) Procuring more Travis CI build capacity for Flink

2016-02-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154470#comment-15154470 ] Wes McKinney commented on FLINK-3452: - Like I said, Travis CI does not publish a price

[jira] [Assigned] (FLINK-3445) make JDBCInputFormat implement ResultTypeQueryable

2016-02-19 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-3445: --- Assignee: Chesnay Schepler > make JDBCInputFormat implement ResultTypeQueryable > ---

[jira] [Commented] (FLINK-3452) Procuring more Travis CI build capacity for Flink

2016-02-19 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154461#comment-15154461 ] Greg Hogan commented on FLINK-3452: --- [Travis CI Plans and Pricing|https://travis-ci.com/

[jira] [Commented] (FLINK-3452) Procuring more Travis CI build capacity for Flink

2016-02-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154441#comment-15154441 ] Wes McKinney commented on FLINK-3452: - Well, the additional cost to have 60 concurrent

[jira] [Commented] (FLINK-3445) make JDBCInputFormat implement ResultTypeQueryable

2016-02-19 Thread Ken Geis (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154335#comment-15154335 ] Ken Geis commented on FLINK-3445: - One can get ResultSetMetaData by preparing a statement

[GitHub] flink pull request: [FLINK-2237] [runtime] Add hash-based combiner...

2016-02-19 Thread aalexandrov
Github user aalexandrov commented on the pull request: https://github.com/apache/flink/pull/1517#issuecomment-186257996 @fhueske We will propose three experiments based on your suggestions in a Google Doc on Monday. Once we have fixed the setup we will prepare a Peel bundle an run the

[jira] [Commented] (FLINK-2237) Add hash-based Aggregation

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154333#comment-15154333 ] ASF GitHub Bot commented on FLINK-2237: --- Github user aalexandrov commented on the pu

[jira] [Commented] (FLINK-2237) Add hash-based Aggregation

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154306#comment-15154306 ] ASF GitHub Bot commented on FLINK-2237: --- Github user fhueske commented on the pull r

[GitHub] flink pull request: [FLINK-2237] [runtime] Add hash-based combiner...

2016-02-19 Thread ggevay
Github user ggevay commented on the pull request: https://github.com/apache/flink/pull/1517#issuecomment-186244959 @fhueske: So far, I have only run benchmarks on my work laptop and home laptop. I have used the newly created `ReducePerformance`, with varying the `(num

[GitHub] flink pull request: [FLINK-2237] [runtime] Add hash-based combiner...

2016-02-19 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/1517#issuecomment-186247461 Great, thanks for the detailed response @ggevay! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[jira] [Commented] (FLINK-2237) Add hash-based Aggregation

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154300#comment-15154300 ] ASF GitHub Bot commented on FLINK-2237: --- Github user ggevay commented on the pull re

[jira] [Created] (FLINK-3453) Fix TaskManager logs exception when sampling backpressure while task completes

2016-02-19 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-3453: - Summary: Fix TaskManager logs exception when sampling backpressure while task completes Key: FLINK-3453 URL: https://issues.apache.org/jira/browse/FLINK-3453 Project: Flink

[GitHub] flink pull request: Various test stability fixes

2016-02-19 Thread uce
GitHub user uce opened a pull request: https://github.com/apache/flink/pull/1676 Various test stability fixes Includes various test stability fixes. This does not address all issues encountered in the past weeks, but most. I will trigger further builds with this and see what comes

[jira] [Commented] (FLINK-3452) Procuring more Travis CI build capacity for Flink

2016-02-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154280#comment-15154280 ] Robert Metzger commented on FLINK-3452: --- Thank you for doing this good analysis of t

[jira] [Commented] (FLINK-3078) JobManager does not shutdown when checkpointed jobs are running

2016-02-19 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154281#comment-15154281 ] Ufuk Celebi commented on FLINK-3078: I think I've duplicated this issue in FLINK-3443.

[jira] [Commented] (FLINK-3452) Procuring more Travis CI build capacity for Flink

2016-02-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154267#comment-15154267 ] Wes McKinney commented on FLINK-3452: - Created INFRA-11293 to track > Procuring more

[jira] [Created] (FLINK-3452) Procuring more Travis CI build capacity for Flink

2016-02-19 Thread Wes McKinney (JIRA)
Wes McKinney created FLINK-3452: --- Summary: Procuring more Travis CI build capacity for Flink Key: FLINK-3452 URL: https://issues.apache.org/jira/browse/FLINK-3452 Project: Flink Issue Type: Wis

[jira] [Created] (FLINK-3451) NettyServer port is determined via NetUtils.getAvailablePort()

2016-02-19 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3451: -- Summary: NettyServer port is determined via NetUtils.getAvailablePort() Key: FLINK-3451 URL: https://issues.apache.org/jira/browse/FLINK-3451 Project: Flink Iss

[jira] [Commented] (FLINK-2237) Add hash-based Aggregation

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154250#comment-15154250 ] ASF GitHub Bot commented on FLINK-2237: --- Github user ggevay commented on the pull re

[GitHub] flink pull request: [FLINK-2237] [runtime] Add hash-based combiner...

2016-02-19 Thread ggevay
Github user ggevay commented on the pull request: https://github.com/apache/flink/pull/1517#issuecomment-186226971 OK, thanks @aalexandrov ! I wanted to try Peel anyway, this is a good opportunity. --- If your project is set up for it, you can reply to this email and have your reply

[jira] [Commented] (FLINK-2237) Add hash-based Aggregation

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154241#comment-15154241 ] ASF GitHub Bot commented on FLINK-2237: --- Github user aalexandrov commented on the pu

[GitHub] flink pull request: [FLINK-2237] [runtime] Add hash-based combiner...

2016-02-19 Thread aalexandrov
Github user aalexandrov commented on the pull request: https://github.com/apache/flink/pull/1517#issuecomment-186226154 @ggevay I would be interesting in helping you prepare a [`peel-flink-bundle`](http://peel-framework.org/getting-started.html) for the benchmarks @fhueske mentioned.

[jira] [Created] (FLINK-3450) RocksDB Backed Window Fails with KryoSerializer

2016-02-19 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-3450: --- Summary: RocksDB Backed Window Fails with KryoSerializer Key: FLINK-3450 URL: https://issues.apache.org/jira/browse/FLINK-3450 Project: Flink Issue Typ

[jira] [Commented] (FLINK-2237) Add hash-based Aggregation

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154224#comment-15154224 ] ASF GitHub Bot commented on FLINK-2237: --- Github user fhueske commented on the pull r

[GitHub] flink pull request: [FLINK-2237] [runtime] Add hash-based combiner...

2016-02-19 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/1517#issuecomment-186219363 OK, then lets keep the data in one partition for now. In case of var-length updates, this can default to a memory usage / combine behavior which is somewhat similar to t

[jira] [Updated] (FLINK-3340) Fix object juggling in drivers

2016-02-19 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan updated FLINK-3340: -- Fix Version/s: 1.0.0 > Fix object juggling in drivers > -- > >

[jira] [Commented] (FLINK-3368) Kafka 0.8 consumer fails to recover from broker shutdowns

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154178#comment-15154178 ] ASF GitHub Bot commented on FLINK-3368: --- Github user rmetzger commented on the pull

[jira] [Commented] (FLINK-3441) Revisit quickstarts exclusion policy

2016-02-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154177#comment-15154177 ] Till Rohrmann commented on FLINK-3441: -- Yes the "provided" approach would be the clea

[GitHub] flink pull request: [FLINK-3368][Kafka 0.8] Handle leader changes ...

2016-02-19 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1623#issuecomment-186201689 Thank you for the good review. I adopted my IntelliJ inspections to find some of the mentioned issues myself in the future (forgotten @Override, unused methods).

[jira] [Commented] (FLINK-3449) createInput swallows exception if TypeExtractor fails

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154172#comment-15154172 ] ASF GitHub Bot commented on FLINK-3449: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request: [FLINK-3449] createInput() no longer swallows ...

2016-02-19 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/1675 [FLINK-3449] createInput() no longer swallows exception You can merge this pull request into a Git repository by running: $ git pull https://github.com/zentol/flink 3449_input_swallow Alternat

[jira] [Commented] (FLINK-3445) make JDBCInputFormat implement ResultTypeQueryable

2016-02-19 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154168#comment-15154168 ] Chesnay Schepler commented on FLINK-3445: - About ResultTypeQueryable: After lookin

[jira] [Created] (FLINK-3449) createInput swallows exception if TypeExtractor fails

2016-02-19 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-3449: --- Summary: createInput swallows exception if TypeExtractor fails Key: FLINK-3449 URL: https://issues.apache.org/jira/browse/FLINK-3449 Project: Flink Iss

[jira] [Commented] (FLINK-3257) Add Exactly-Once Processing Guarantees in Iterative DataStream Jobs

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154090#comment-15154090 ] ASF GitHub Bot commented on FLINK-3257: --- Github user tillrohrmann commented on the p

[GitHub] flink pull request: [FLINK-3257] Add Exactly-Once Processing Guara...

2016-02-19 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/1668#issuecomment-186174994 Great idea @senorcarbone. I also really like it :-) I agree with @gyfora to include the logic of the `ForwardingOneInputStreamTask` in the `StreamIterationT

[jira] [Created] (FLINK-3448) Move initialization of handlers to start() method

2016-02-19 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-3448: - Summary: Move initialization of handlers to start() method Key: FLINK-3448 URL: https://issues.apache.org/jira/browse/FLINK-3448 Project: Flink Iss

[jira] [Updated] (FLINK-3448) WebRuntimeMonitor: Move initialization of handlers to start() method

2016-02-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-3448: -- Summary: WebRuntimeMonitor: Move initialization of handlers to start() method (was: Mov

[jira] [Commented] (FLINK-3416) [py] .bat files fail when path contains spaces

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154039#comment-15154039 ] ASF GitHub Bot commented on FLINK-3416: --- Github user zentol commented on the pull re

[GitHub] flink pull request: [FLINK-3416] [py] Support for spaces in flink ...

2016-02-19 Thread zentol
Github user zentol commented on the pull request: https://github.com/apache/flink/pull/1674#issuecomment-186149376 This PR adds "" around the flink path within python bat files, so that paths containing spaces are treated as a single argument. --- If your project is set up for it, yo

[jira] [Commented] (FLINK-3416) [py] .bat files fail when path contains spaces

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154038#comment-15154038 ] ASF GitHub Bot commented on FLINK-3416: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request: [FLINK-3416] [py] Support for spaces in flink ...

2016-02-19 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/1674 [FLINK-3416] [py] Support for spaces in flink path You can merge this pull request into a Git repository by running: $ git pull https://github.com/zentol/flink 3416_py_win Alternatively you ca

[jira] [Assigned] (FLINK-3416) [py] .bat files fail when path contains spaces

2016-02-19 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-3416: --- Assignee: Chesnay Schepler > [py] .bat files fail when path contains spaces > ---

[jira] [Commented] (FLINK-3257) Add Exactly-Once Processing Guarantees in Iterative DataStream Jobs

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154030#comment-15154030 ] ASF GitHub Bot commented on FLINK-3257: --- Github user senorcarbone commented on the p

[GitHub] flink pull request: [FLINK-3257] Add Exactly-Once Processing Guara...

2016-02-19 Thread senorcarbone
Github user senorcarbone commented on the pull request: https://github.com/apache/flink/pull/1668#issuecomment-186147597 Thanks for going through it Gyula! I agree, the `ForwardingOneInputStreamTask` can be integrated in the `StreamIterationTail`, I will probably do that. I ju

[jira] [Commented] (FLINK-3399) Count with timeout trigger

2016-02-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154009#comment-15154009 ] Aljoscha Krettek commented on FLINK-3399: - Unfortunately I did not yet have time t

[jira] [Commented] (FLINK-3257) Add Exactly-Once Processing Guarantees in Iterative DataStream Jobs

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154001#comment-15154001 ] ASF GitHub Bot commented on FLINK-3257: --- Github user gyfora commented on the pull re

[GitHub] flink pull request: [FLINK-3257] Add Exactly-Once Processing Guara...

2016-02-19 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/1668#issuecomment-186142276 Thanks Paris, I like the idea, it's a correct modification of the original algorithm to make it much easier to implement on Flink for the price of buffering more records.

[jira] [Commented] (FLINK-3439) Remove final Long.MAX_VALUE Watermark in StreamSource

2016-02-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153996#comment-15153996 ] Aljoscha Krettek commented on FLINK-3439: - [~jgrier] Yes, this is still the case.

[jira] [Commented] (FLINK-3311) Add a connector for streaming data into Cassandra

2016-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153993#comment-15153993 ] ASF GitHub Bot commented on FLINK-3311: --- Github user alkagin commented on a diff in

[GitHub] flink pull request: [FLINK-3311] Add a connector for streaming dat...

2016-02-19 Thread alkagin
Github user alkagin commented on a diff in the pull request: https://github.com/apache/flink/pull/1660#discussion_r53440225 --- Diff: flink-streaming-connectors/flink-connector-cassandra/pom.xml --- @@ -0,0 +1,149 @@ + + +http://maven.apache.org/POM/4.0.0"; +

  1   2   >