[GitHub] flink issue #2569: [FLINK-4711] Let the Task trigger partition state request...

2016-09-30 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/2569 Travis passed locally. Will merge the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[jira] [Commented] (FLINK-4711) TaskManager can crash due to failing onPartitionStateUpdate call

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535256#comment-15535256 ] ASF GitHub Bot commented on FLINK-4711: --- Github user tillrohrmann commented on the i

[jira] [Commented] (FLINK-4711) TaskManager can crash due to failing onPartitionStateUpdate call

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535263#comment-15535263 ] ASF GitHub Bot commented on FLINK-4711: --- Github user asfgit closed the pull request

[jira] [Closed] (FLINK-4711) TaskManager can crash due to failing onPartitionStateUpdate call

2016-09-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-4711. Resolution: Fixed Fixed via 477d1c5d4ca6f469b3c87bc1f7962ece805cae1d > TaskManager can crash due to

[GitHub] flink pull request #2569: [FLINK-4711] Let the Task trigger partition state ...

2016-09-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2569 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-4613) Extend ALS to handle implicit feedback datasets

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535268#comment-15535268 ] ASF GitHub Bot commented on FLINK-4613: --- Github user gaborhermann commented on the i

[GitHub] flink issue #2542: [FLINK-4613] [ml] Extend ALS to handle implicit feedback ...

2016-09-30 Thread gaborhermann
Github user gaborhermann commented on the issue: https://github.com/apache/flink/pull/2542 Okay, we're on it. @thvasilo thanks for the dataset suggestion. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] flink issue #2571: [FLINK-4348] Simplify logic of SlotManager

2016-09-30 Thread KurtYoung
Github user KurtYoung commented on the issue: https://github.com/apache/flink/pull/2571 @mxm Thanks for the simplification, i like the idea. When i wrote the first version of the SlotManager, i have noticed maybe i made things too complicated, but i didn't figure out how to make thing

[jira] [Commented] (FLINK-4348) Implement slot allocation protocol with TaskExecutor

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535299#comment-15535299 ] ASF GitHub Bot commented on FLINK-4348: --- Github user KurtYoung commented on the issu

[GitHub] flink issue #2564: [FLINK-2254] Add BipartiateGraph class

2016-09-30 Thread vasia
Github user vasia commented on the issue: https://github.com/apache/flink/pull/2564 Providing a flattened tuple is certainly better than having the user implement the reduce, but I think we should provide separate methods for the default and custom operations. A projection is a very w

[jira] [Commented] (FLINK-2254) Add Bipartite Graph Support for Gelly

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535322#comment-15535322 ] ASF GitHub Bot commented on FLINK-2254: --- Github user vasia commented on the issue:

[jira] [Commented] (FLINK-4315) Remove Hadoop Dependency from flink-java

2016-09-30 Thread Evgeny Kincharov (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535380#comment-15535380 ] Evgeny Kincharov commented on FLINK-4315: - I have moved the org.apache.hadoop depe

[jira] [Commented] (FLINK-4315) Remove Hadoop Dependency from flink-java

2016-09-30 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535462#comment-15535462 ] Stephan Ewen commented on FLINK-4315: - I think we can merge this only for Flink 2.0, s

[GitHub] flink pull request #2574: [FLINK-4702] [kafka connector] Commit offsets to K...

2016-09-30 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/2574#discussion_r81302867 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/test/java/org/apache/flink/streaming/connectors/kafka/Kafka09FetcherTest.java --- @@ -

[jira] [Commented] (FLINK-4702) Kafka consumer must commit offsets asynchronously

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535475#comment-15535475 ] ASF GitHub Bot commented on FLINK-4702: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request #2574: [FLINK-4702] [kafka connector] Commit offsets to K...

2016-09-30 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/2574#discussion_r81303182 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java ---

[jira] [Commented] (FLINK-4702) Kafka consumer must commit offsets asynchronously

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535482#comment-15535482 ] ASF GitHub Bot commented on FLINK-4702: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request #2574: [FLINK-4702] [kafka connector] Commit offsets to K...

2016-09-30 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/2574#discussion_r81303450 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java ---

[jira] [Commented] (FLINK-4702) Kafka consumer must commit offsets asynchronously

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535485#comment-15535485 ] ASF GitHub Bot commented on FLINK-4702: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request #2574: [FLINK-4702] [kafka connector] Commit offsets to K...

2016-09-30 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/2574#discussion_r81303617 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/test/java/org/apache/flink/streaming/connectors/kafka/Kafka09FetcherTest.java --- @@ -

[jira] [Commented] (FLINK-4702) Kafka consumer must commit offsets asynchronously

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535491#comment-15535491 ] ASF GitHub Bot commented on FLINK-4702: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request #2574: [FLINK-4702] [kafka connector] Commit offsets to K...

2016-09-30 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/2574#discussion_r81303671 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/test/java/org/apache/flink/streaming/connectors/kafka/Kafka09FetcherTest.java --- @@ -

[jira] [Commented] (FLINK-4702) Kafka consumer must commit offsets asynchronously

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535488#comment-15535488 ] ASF GitHub Bot commented on FLINK-4702: --- Github user StephanEwen commented on a diff

[GitHub] flink issue #2574: [FLINK-4702] [kafka connector] Commit offsets to Kafka as...

2016-09-30 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2574 Thanks for the review. I think some points you mentioned are already addressed, actually. Will add the following: - `commitSpecificOffsets()` can determine precisely when a commit r

[jira] [Commented] (FLINK-4702) Kafka consumer must commit offsets asynchronously

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535493#comment-15535493 ] ASF GitHub Bot commented on FLINK-4702: --- Github user StephanEwen commented on the is

[GitHub] flink issue #2575: 'Id' is the key of the stream and not the id of the event...

2016-09-30 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2575 I originally meant it to be the "id" or something like that. The confusion probably comes because "B" occurs multiple times. That is a copy and paste error, it should be a new letter. --- If

[GitHub] flink issue #2571: [FLINK-4348] Simplify logic of SlotManager

2016-09-30 Thread mxm
Github user mxm commented on the issue: https://github.com/apache/flink/pull/2571 Thanks for the feedback, @beyond1920 and @KurtYoung. You're right, the changes don't allow slots to be released by a TaskExecutor. We can change that by explicitly reporting to the RM if a slot

[jira] [Commented] (FLINK-4348) Implement slot allocation protocol with TaskExecutor

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535527#comment-15535527 ] ASF GitHub Bot commented on FLINK-4348: --- Github user mxm commented on the issue:

[jira] [Created] (FLINK-4719) KryoSerializer random exception

2016-09-30 Thread Flavio Pompermaier (JIRA)
Flavio Pompermaier created FLINK-4719: - Summary: KryoSerializer random exception Key: FLINK-4719 URL: https://issues.apache.org/jira/browse/FLINK-4719 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-4719) KryoSerializer random exception

2016-09-30 Thread Flavio Pompermaier (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535535#comment-15535535 ] Flavio Pompermaier commented on FLINK-4719: --- Using the Flink 1.1.1 code my job f

[GitHub] flink issue #2571: [FLINK-4348] Simplify logic of SlotManager

2016-09-30 Thread KurtYoung
Github user KurtYoung commented on the issue: https://github.com/apache/flink/pull/2571 @mxm I think that situation will happen when RM request slot from TM, TM accept the request, but the response was somehow missed. Typically, when an rpc error occurred, the send could not know whet

[jira] [Commented] (FLINK-4348) Implement slot allocation protocol with TaskExecutor

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535565#comment-15535565 ] ASF GitHub Bot commented on FLINK-4348: --- Github user KurtYoung commented on the issu

[GitHub] flink pull request #2435: [FLINK-4478] [flip-6] Add HeartbeatManager

2016-09-30 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2435#discussion_r81310859 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/heartbeat/HeartbeatManagerImpl.java --- @@ -0,0 +1,328 @@ +/* + * Licensed to the Apache S

[GitHub] flink pull request #2435: [FLINK-4478] [flip-6] Add HeartbeatManager

2016-09-30 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2435#discussion_r81309944 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/slotmanager/SlotProtocolTest.java --- @@ -43,12 +42,9 @@ import org.junit.Bef

[GitHub] flink pull request #2435: [FLINK-4478] [flip-6] Add HeartbeatManager

2016-09-30 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2435#discussion_r81313363 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/heartbeat/HeartbeatManagerImpl.java --- @@ -0,0 +1,328 @@ +/* + * Licensed to the Apache S

[jira] [Commented] (FLINK-4478) Implement heartbeat logic

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535624#comment-15535624 ] ASF GitHub Bot commented on FLINK-4478: --- Github user mxm commented on a diff in the

[GitHub] flink pull request #2435: [FLINK-4478] [flip-6] Add HeartbeatManager

2016-09-30 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2435#discussion_r81312934 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/heartbeat/HeartbeatManagerImpl.java --- @@ -0,0 +1,328 @@ +/* + * Licensed to the Apache S

[jira] [Commented] (FLINK-4478) Implement heartbeat logic

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535623#comment-15535623 ] ASF GitHub Bot commented on FLINK-4478: --- Github user mxm commented on a diff in the

[GitHub] flink pull request #2435: [FLINK-4478] [flip-6] Add HeartbeatManager

2016-09-30 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2435#discussion_r81314113 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/slotmanager/SlotProtocolTest.java --- @@ -43,12 +42,9 @@ import org.junit.Bef

[jira] [Commented] (FLINK-4478) Implement heartbeat logic

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535622#comment-15535622 ] ASF GitHub Bot commented on FLINK-4478: --- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-4478) Implement heartbeat logic

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535625#comment-15535625 ] ASF GitHub Bot commented on FLINK-4478: --- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-4478) Implement heartbeat logic

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535626#comment-15535626 ] ASF GitHub Bot commented on FLINK-4478: --- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-2254) Add Bipartite Graph Support for Gelly

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535642#comment-15535642 ] ASF GitHub Bot commented on FLINK-2254: --- Github user mushketyk commented on the issu

[jira] [Created] (FLINK-4720) Implement an archived version of the execution graph

2016-09-30 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-4720: --- Summary: Implement an archived version of the execution graph Key: FLINK-4720 URL: https://issues.apache.org/jira/browse/FLINK-4720 Project: Flink Issu

[GitHub] flink issue #2564: [FLINK-2254] Add BipartiateGraph class

2016-09-30 Thread mushketyk
Github user mushketyk commented on the issue: https://github.com/apache/flink/pull/2564 Tuple8 does not seem to friendly to me either. What do you mean by "attaching the labels"? Is it something similar to what we do with Edge/Vertex classes right, inheriting Tuple and providing gette

[GitHub] flink issue #2575: 'Id' is the key of the stream and not the id of the event...

2016-09-30 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/2575 Sorry @nderraugh, seems like I misinterpreted the figure then... :-( --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] flink pull request #2576: [FLINK-4315] Remove Hadoop Dependency from flink-j...

2016-09-30 Thread kenmy
GitHub user kenmy opened a pull request: https://github.com/apache/flink/pull/2576 [FLINK-4315] Remove Hadoop Dependency from flink-java This PR breaks public API. Don't merge it before 2.0. I have moved the org.apache.hadoop dependency from flink-java to flink-hadoop-compatibil

[jira] [Commented] (FLINK-4315) Remove Hadoop Dependency from flink-java

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535676#comment-15535676 ] ASF GitHub Bot commented on FLINK-4315: --- GitHub user kenmy opened a pull request:

[jira] [Commented] (FLINK-4604) Add support for standard deviation/variance

2016-09-30 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535709#comment-15535709 ] Anton Mushin commented on FLINK-4604: - Hello. Could I start to resolve this ticket?

[jira] [Commented] (FLINK-1815) Add methods to read and write a Graph as adjacency list

2016-09-30 Thread Faye Beligianni (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535717#comment-15535717 ] Faye Beligianni commented on FLINK-1815: Hello [~greghogan], maybe it would be a

[jira] [Commented] (FLINK-1815) Add methods to read and write a Graph as adjacency list

2016-09-30 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535748#comment-15535748 ] Vasia Kalavri commented on FLINK-1815: -- Hi [~fobeligi], representing a graph as an ad

[GitHub] flink issue #2564: [FLINK-2254] Add BipartiateGraph class

2016-09-30 Thread vasia
Github user vasia commented on the issue: https://github.com/apache/flink/pull/2564 What I meant is simply creating an edge with a Tuple2 label containing the labels of the two edges in the bipartite graph. Makes sense? --- If your project is set up for it, you can reply to this emai

[jira] [Commented] (FLINK-2254) Add Bipartite Graph Support for Gelly

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535760#comment-15535760 ] ASF GitHub Bot commented on FLINK-2254: --- Github user vasia commented on the issue:

[GitHub] flink issue #2575: 'Id' is the key of the stream and not the id of the event...

2016-09-30 Thread nderraugh
Github user nderraugh commented on the issue: https://github.com/apache/flink/pull/2575 OK. That clears it up too. I'll fix it up in a little while. On Sep 30, 2016 6:38 AM, "Fabian Hueske" wrote: > Sorry @nderraugh , seems like I >

[GitHub] flink issue #2564: [FLINK-2254] Add BipartiateGraph class

2016-09-30 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/2564 Agreed, I would amend my earlier suggestion to say we only need to start with two projection methods (for each of top and bottom), something like `public Graph> topProjectionSimple() {` an

[jira] [Commented] (FLINK-2254) Add Bipartite Graph Support for Gelly

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535769#comment-15535769 ] ASF GitHub Bot commented on FLINK-2254: --- Github user greghogan commented on the issu

[GitHub] flink issue #2564: [FLINK-2254] Add BipartiateGraph class

2016-09-30 Thread mushketyk
Github user mushketyk commented on the issue: https://github.com/apache/flink/pull/2564 Makes sense to me. I'll implement this during weekend. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Commented] (FLINK-2254) Add Bipartite Graph Support for Gelly

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535820#comment-15535820 ] ASF GitHub Bot commented on FLINK-2254: --- Github user mushketyk commented on the issu

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535824#comment-15535824 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: Hi [~aljoscha], I'm struggling a

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535824#comment-15535824 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/30/16 12:12 PM: --

[GitHub] flink pull request #2577: [FLINK-4720] Implement archived version of the Exe...

2016-09-30 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/2577 [FLINK-4720] Implement archived version of the ExecutionGraph This PR allows an ExecutionGraph to be archived. The archived version is a serializable snapshot of the EG at the time it was archived.

[jira] [Commented] (FLINK-4720) Implement an archived version of the execution graph

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535878#comment-15535878 ] ASF GitHub Bot commented on FLINK-4720: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request #2512: [FLINK-4379] Rescalable non-partitioned state

2016-09-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2512 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-4573) Potential resource leak due to unclosed RandomAccessFile in TaskManagerLogHandler

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535901#comment-15535901 ] ASF GitHub Bot commented on FLINK-4573: --- Github user asfgit closed the pull request

[GitHub] flink pull request #2556: [FLINK-4573] Fix potential resource leak due to un...

2016-09-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2556 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-4379) Add Rescalable Non-Partitioned State

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535900#comment-15535900 ] ASF GitHub Bot commented on FLINK-4379: --- Github user asfgit closed the pull request

[GitHub] flink pull request #2574: [FLINK-4702] [kafka connector] Commit offsets to K...

2016-09-30 Thread StephanEwen
Github user StephanEwen closed the pull request at: https://github.com/apache/flink/pull/2574 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #2574: [FLINK-4702] [kafka connector] Commit offsets to Kafka as...

2016-09-30 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2574 Merged in 92f4539afc714f7dbd293c3ad677b3b5807c6911 Addresses @tzulitai comments. Fixed the warning log message by using atomic swap when setting the next offsets to be committed. If it sw

[jira] [Commented] (FLINK-4702) Kafka consumer must commit offsets asynchronously

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535913#comment-15535913 ] ASF GitHub Bot commented on FLINK-4702: --- Github user StephanEwen closed the pull req

[jira] [Commented] (FLINK-4720) Implement an archived version of the execution graph

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535915#comment-15535915 ] ASF GitHub Bot commented on FLINK-4720: --- Github user zentol commented on the issue:

[GitHub] flink issue #2577: [FLINK-4720] Implement archived version of the ExecutionG...

2016-09-30 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/2577 Rebasing right now... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[jira] [Commented] (FLINK-4702) Kafka consumer must commit offsets asynchronously

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535912#comment-15535912 ] ASF GitHub Bot commented on FLINK-4702: --- Github user StephanEwen commented on the is

[GitHub] flink issue #2571: [FLINK-4348] Simplify logic of SlotManager

2016-09-30 Thread mxm
Github user mxm commented on the issue: https://github.com/apache/flink/pull/2571 @KurtYoung It is guaranteed that the ResourceManager will receive an RPC response of some sort. Either a reply from the TaskExecutor, or a timeout/error which is returned by the future. If the request is

[jira] [Commented] (FLINK-4348) Implement slot allocation protocol with TaskExecutor

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535918#comment-15535918 ] ASF GitHub Bot commented on FLINK-4348: --- Github user mxm commented on the issue:

[jira] [Updated] (FLINK-4604) Add support for standard deviation/variance

2016-09-30 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther updated FLINK-4604: Assignee: Anton Mushin > Add support for standard deviation/variance > -

[jira] [Commented] (FLINK-4604) Add support for standard deviation/variance

2016-09-30 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535940#comment-15535940 ] Timo Walther commented on FLINK-4604: - [~anmu] yes sure. I assigned the issue to you.

[jira] [Commented] (FLINK-4718) Confusing label in Parallel Streams Diagram

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535963#comment-15535963 ] ASF GitHub Bot commented on FLINK-4718: --- Github user nderraugh closed the pull reque

[GitHub] flink pull request #2575: 'Id' is the key of the stream and not the id of th...

2016-09-30 Thread nderraugh
Github user nderraugh closed the pull request at: https://github.com/apache/flink/pull/2575 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] flink issue #2575: 'Id' is the key of the stream and not the id of the event...

2016-09-30 Thread nderraugh
Github user nderraugh commented on the issue: https://github.com/apache/flink/pull/2575 will reopen a clean PR for this change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] flink pull request #2578: Event B should be unique.

2016-09-30 Thread nderraugh
GitHub user nderraugh opened a pull request: https://github.com/apache/flink/pull/2578 Event B should be unique. FLINK-4718 Confusing label in Parallel Streams Diagram Minor text change to clarify a mildly confusing label in a diagram. You can merge this pull request into a

[jira] [Commented] (FLINK-4718) Confusing label in Parallel Streams Diagram

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535972#comment-15535972 ] ASF GitHub Bot commented on FLINK-4718: --- GitHub user nderraugh opened a pull request

[jira] [Commented] (FLINK-1815) Add methods to read and write a Graph as adjacency list

2016-09-30 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536006#comment-15536006 ] Greg Hogan commented on FLINK-1815: --- Questions: - It feels like we're making up our own

[GitHub] flink issue #2578: Event B should be unique.

2016-09-30 Thread nderraugh
Github user nderraugh commented on the issue: https://github.com/apache/flink/pull/2578 opened a new PR with a single commit to fix the figure. If there's a better way I should have gone about correcting this fix by closing the old PR and opening this one let me know, I can always us

[jira] [Commented] (FLINK-4315) Remove Hadoop Dependency from flink-java

2016-09-30 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536044#comment-15536044 ] Greg Hogan commented on FLINK-4315: --- I think it's great to have this pull request to doc

[jira] [Commented] (FLINK-4315) Remove Hadoop Dependency from flink-java

2016-09-30 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536049#comment-15536049 ] Konstantin Boudnik commented on FLINK-4315: --- Is there a branch for 2.0 release?

[jira] [Commented] (FLINK-4315) Remove Hadoop Dependency from flink-java

2016-09-30 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536077#comment-15536077 ] Chesnay Schepler commented on FLINK-4315: - We decided against a 2.0 branch as it w

[jira] [Commented] (FLINK-4315) Remove Hadoop Dependency from flink-java

2016-09-30 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536083#comment-15536083 ] Greg Hogan commented on FLINK-4315: --- The general challenge would be keeping a 2.0 branch

[jira] [Commented] (FLINK-1815) Add methods to read and write a Graph as adjacency list

2016-09-30 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536120#comment-15536120 ] Vasia Kalavri commented on FLINK-1815: -- The motivation for this issue was to (1) prov

[GitHub] flink pull request #2435: [FLINK-4478] [flip-6] Add HeartbeatManager

2016-09-30 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/2435#discussion_r81348543 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/heartbeat/HeartbeatManagerImpl.java --- @@ -0,0 +1,328 @@ +/* + * Licensed to the

[jira] [Commented] (FLINK-4478) Implement heartbeat logic

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536131#comment-15536131 ] ASF GitHub Bot commented on FLINK-4478: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request #2435: [FLINK-4478] [flip-6] Add HeartbeatManager

2016-09-30 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/2435#discussion_r81348862 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/heartbeat/HeartbeatManagerImpl.java --- @@ -0,0 +1,328 @@ +/* + * Licensed to the

[jira] [Commented] (FLINK-4478) Implement heartbeat logic

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536134#comment-15536134 ] ASF GitHub Bot commented on FLINK-4478: --- Github user tillrohrmann commented on a dif

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535824#comment-15535824 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/30/16 2:35 PM: ---

[GitHub] flink issue #2435: [FLINK-4478] [flip-6] Add HeartbeatManager

2016-09-30 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/2435 Thanks for the review @mxm. Concerning your questions: 1. Double checking is necessary due to concurrent accesses. Of course one could also use locks but that way it is less blocking.

[jira] [Commented] (FLINK-4478) Implement heartbeat logic

2016-09-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536156#comment-15536156 ] ASF GitHub Bot commented on FLINK-4478: --- Github user tillrohrmann commented on the i

[jira] [Commented] (FLINK-4604) Add support for standard deviation/variance

2016-09-30 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536178#comment-15536178 ] Anton Mushin commented on FLINK-4604: - [~twalthr],thanks! I have any question about th

[jira] [Resolved] (FLINK-4702) Kafka consumer must commit offsets asynchronously

2016-09-30 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-4702. - Resolution: Fixed Fixed in - 1.2.0 via 92f4539afc714f7dbd293c3ad677b3b5807c6911 - 1.1.3 via 90

[jira] [Resolved] (FLINK-4573) Potential resource leak due to unclosed RandomAccessFile in TaskManagerLogHandler

2016-09-30 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-4573. - Resolution: Fixed Fix Version/s: 1.2.0 Fixed via 2afc092461cf68cf0f3c26a3ab4c58a7bd68cf71

[jira] [Closed] (FLINK-4573) Potential resource leak due to unclosed RandomAccessFile in TaskManagerLogHandler

2016-09-30 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-4573. --- > Potential resource leak due to unclosed RandomAccessFile in > TaskManagerLogHandler > -

[jira] [Resolved] (FLINK-4379) Add Rescalable Non-Partitioned State

2016-09-30 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-4379. - Resolution: Implemented Fix Version/s: 1.2.0 Implemented in 53ed6adac8cbe6b5dcb692dc9b94970

  1   2   >