[jira] [Comment Edited] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372124#comment-15372124 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4195 at 7/12/16 5:46 AM: ---

[jira] [Comment Edited] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372124#comment-15372124 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4195 at 7/12/16 5:46 AM: ---

[jira] [Comment Edited] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372160#comment-15372160 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4195 at 7/12/16 4:30 AM: ---

[jira] [Commented] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372160#comment-15372160 ] Tzu-Li (Gordon) Tai commented on FLINK-4195: I think I'll open a PR for FLINK-

[jira] [Comment Edited] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372160#comment-15372160 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4195 at 7/12/16 4:30 AM: ---

[jira] [Commented] (FLINK-4018) Configurable idle time between getRecords requests to Kinesis shards

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372134#comment-15372134 ] ASF GitHub Bot commented on FLINK-4018: --- Github user tzulitai commented on the issue

[GitHub] flink issue #2071: [FLINK-4018][streaming-connectors] Configurable idle time...

2016-07-11 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2071 @rmetzger Will you have time to help merge this PR too? I think the changes are good to go. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Comment Edited] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372124#comment-15372124 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4195 at 7/12/16 3:35 AM: ---

[jira] [Comment Edited] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372124#comment-15372124 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4195 at 7/12/16 3:35 AM: ---

[jira] [Comment Edited] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372124#comment-15372124 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4195 at 7/12/16 3:32 AM: ---

[jira] [Commented] (FLINK-4197) Allow Kinesis Endpoint to be Overridden via Config

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372127#comment-15372127 ] ASF GitHub Bot commented on FLINK-4197: --- Github user tzulitai commented on the issue

[GitHub] flink issue #2227: [FLINK-4197] Allow Kinesis endpoint to be overridden via ...

2016-07-11 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2227 Thank you for opening a PR for this @skidder ! I'll review the changes soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[jira] [Comment Edited] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372124#comment-15372124 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4195 at 7/12/16 3:25 AM: ---

[jira] [Comment Edited] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372124#comment-15372124 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4195 at 7/12/16 3:24 AM: ---

[jira] [Comment Edited] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372124#comment-15372124 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4195 at 7/12/16 3:23 AM: ---

[jira] [Commented] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372124#comment-15372124 ] Tzu-Li (Gordon) Tai commented on FLINK-4195: What about keeping the current co

[jira] [Comment Edited] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372124#comment-15372124 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4195 at 7/12/16 3:23 AM: ---

[jira] [Commented] (FLINK-4197) Allow Kinesis Endpoint to be Overridden via Config

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372084#comment-15372084 ] ASF GitHub Bot commented on FLINK-4197: --- GitHub user skidder opened a pull request:

[GitHub] flink pull request #2227: [FLINK-4197] Allow Kinesis endpoint to be overridd...

2016-07-11 Thread skidder
GitHub user skidder opened a pull request: https://github.com/apache/flink/pull/2227 [FLINK-4197] Allow Kinesis endpoint to be overridden via config I perform local testing of my application stack with Flink configured as a consumer on a Kinesis stream provided by Kinesalite, an imp

[jira] [Created] (FLINK-4197) Allow Kinesis Endpoint to be Overridden via Config

2016-07-11 Thread Scott Kidder (JIRA)
Scott Kidder created FLINK-4197: --- Summary: Allow Kinesis Endpoint to be Overridden via Config Key: FLINK-4197 URL: https://issues.apache.org/jira/browse/FLINK-4197 Project: Flink Issue Type: Im

[jira] [Commented] (FLINK-1502) Expose metrics to graphite, ganglia and JMX.

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371842#comment-15371842 ] ASF GitHub Bot commented on FLINK-1502: --- Github user sumitchawla commented on the is

[GitHub] flink issue #1947: [FLINK-1502] [WIP] Basic Metric System

2016-07-11 Thread sumitchawla
Github user sumitchawla commented on the issue: https://github.com/apache/flink/pull/1947 @zentol is there any HTTP interface to these metrics that can be used to query the metrics? Something similar to existing JobManager Accumulators urls? --- If your project is set up for it, you

[jira] [Resolved] (FLINK-3190) Retry rate limits for DataStream API

2016-07-11 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-3190. -- Resolution: Implemented Added via a7274d5661421a66dcb998efd72b547301e1dc0f > Retry rate limits

[jira] [Commented] (FLINK-1501) Integrate metrics library and report basic metrics to JobManager web interface

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371727#comment-15371727 ] ASF GitHub Bot commented on FLINK-1501: --- Github user sumitchawla commented on the is

[jira] [Commented] (FLINK-3190) Retry rate limits for DataStream API

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371729#comment-15371729 ] ASF GitHub Bot commented on FLINK-3190: --- Github user asfgit closed the pull request

[GitHub] flink pull request #1954: [FLINK-3190] failure rate restart strategy

2016-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1954 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] flink issue #421: [FLINK-1501] Add metrics library for monitoring TaskManage...

2016-07-11 Thread sumitchawla
Github user sumitchawla commented on the issue: https://github.com/apache/flink/pull/421 @rmetzger how can i view these metrics? Do i need JMX to be enabled for viewing these metrics? As of now i see only a few numbers in metrics tab for TaskManager --- If your project is set up fo

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-07-11 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371524#comment-15371524 ] Gyula Fora commented on FLINK-4193: --- It happened multiple times in a row on the same clu

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371519#comment-15371519 ] ASF GitHub Bot commented on FLINK-4191: --- Github user rmetzger commented on the issue

[GitHub] flink issue #2225: [FLINK-4191] Expose shard information in kinesis deserial...

2016-07-11 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2225 I fixed the remaining comments. I'll merge the changes tomorrow. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] flink pull request #2225: [FLINK-4191] Expose shard information in kinesis d...

2016-07-11 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2225#discussion_r70327009 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardConsumer.java --- @@

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371512#comment-15371512 ] ASF GitHub Bot commented on FLINK-4191: --- Github user rmetzger commented on a diff in

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-07-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371503#comment-15371503 ] Stephan Ewen commented on FLINK-4193: - Thanks. Does it occur rarely, or can you more o

[jira] [Commented] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371496#comment-15371496 ] Robert Metzger commented on FLINK-4195: --- If we are going to rework the configuration

[jira] [Closed] (FLINK-3515) Make the "file monitoring source" exactly-once

2016-07-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-3515. --- Resolution: Duplicate > Make the "file monitoring source" exactly-once > -

[jira] [Comment Edited] (FLINK-4196) Remove "recoveryTimestamp"

2016-07-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371468#comment-15371468 ] Stephan Ewen edited comment on FLINK-4196 at 7/11/16 7:31 PM: --

[jira] [Commented] (FLINK-4196) Remove "recoveryTimestamp"

2016-07-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371468#comment-15371468 ] Stephan Ewen commented on FLINK-4196: - None of Flink's pre-packages state backends is

[jira] [Created] (FLINK-4196) Remove "recoveryTimestamp"

2016-07-11 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4196: --- Summary: Remove "recoveryTimestamp" Key: FLINK-4196 URL: https://issues.apache.org/jira/browse/FLINK-4196 Project: Flink Issue Type: Bug Components:

[jira] [Closed] (FLINK-3085) Move State Backend Initialization from "registerInputOutput()" to "invoke()"

2016-07-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-3085. --- > Move State Backend Initialization from "registerInputOutput()" to "invoke()" > -

[jira] [Resolved] (FLINK-3085) Move State Backend Initialization from "registerInputOutput()" to "invoke()"

2016-07-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-3085. - Resolution: Invalid Fix Version/s: (was: 1.0.0) There is no distinction between {{regis

[jira] [Updated] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4195: --- Fix Version/s: 1.1.0 > Dedicated Configuration classes for Kinesis Consumer / Producer

[jira] [Assigned] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen reassigned FLINK-3466: --- Assignee: Stephan Ewen > Job might get stuck in restoreState() from HDFS due to interrupt > -

[jira] [Updated] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4195: --- Component/s: Kinesis Connector > Dedicated Configuration classes for Kinesis Consumer

[jira] [Updated] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4195: --- Affects Version/s: 1.1.0 > Dedicated Configuration classes for Kinesis Consumer / Prod

[jira] [Created] (FLINK-4195) Dedicated Configuration classes for Kinesis Consumer / Producer

2016-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4195: -- Summary: Dedicated Configuration classes for Kinesis Consumer / Producer Key: FLINK-4195 URL: https://issues.apache.org/jira/browse/FLINK-4195 Project: Fl

[jira] [Commented] (FLINK-4190) Generalise RollingSink to work with arbitrary buckets

2016-07-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371342#comment-15371342 ] Aljoscha Krettek commented on FLINK-4190: - I'm very happy you're working on this!

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371330#comment-15371330 ] ASF GitHub Bot commented on FLINK-4191: --- Github user tzulitai commented on a diff in

[GitHub] flink pull request #2225: [FLINK-4191] Expose shard information in kinesis d...

2016-07-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2225#discussion_r70308410 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardConsumer.java --- @@

[GitHub] flink pull request #2225: [FLINK-4191] Expose shard information in kinesis d...

2016-07-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2225#discussion_r70305936 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/serialization/KinesisDeserializationSche

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371289#comment-15371289 ] ASF GitHub Bot commented on FLINK-4191: --- Github user tzulitai commented on a diff in

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371284#comment-15371284 ] ASF GitHub Bot commented on FLINK-4191: --- Github user tzulitai commented on a diff in

[GitHub] flink pull request #2225: [FLINK-4191] Expose shard information in kinesis d...

2016-07-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2225#discussion_r70305142 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/serialization/KinesisDeserializationSche

[GitHub] flink pull request #2225: [FLINK-4191] Expose shard information in kinesis d...

2016-07-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2225#discussion_r70304158 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/serialization/KinesisDeserializationSche

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371278#comment-15371278 ] ASF GitHub Bot commented on FLINK-4191: --- Github user tzulitai commented on a diff in

[GitHub] flink issue #2225: [FLINK-4191] Expose shard information in kinesis deserial...

2016-07-11 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2225 Good points on not using Amazon's `Shard` and `Record`, did not think of that! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371279#comment-15371279 ] ASF GitHub Bot commented on FLINK-4191: --- Github user tzulitai commented on the issue

[GitHub] flink pull request #2225: [FLINK-4191] Expose shard information in kinesis d...

2016-07-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2225#discussion_r70303482 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/serialization/KinesisDeserializationSche

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371269#comment-15371269 ] ASF GitHub Bot commented on FLINK-4191: --- Github user tzulitai commented on a diff in

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371264#comment-15371264 ] ASF GitHub Bot commented on FLINK-4191: --- Github user tzulitai commented on a diff in

[GitHub] flink pull request #2225: [FLINK-4191] Expose shard information in kinesis d...

2016-07-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2225#discussion_r70303112 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardConsumer.java --- @@

[jira] [Commented] (FLINK-4015) FlinkKafkaProducer08 fails when partition leader changes

2016-07-11 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371216#comment-15371216 ] Sebastian Klemke commented on FLINK-4015: - For our use case, buffering the in-flig

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371204#comment-15371204 ] ASF GitHub Bot commented on FLINK-4191: --- Github user rmetzger commented on the issue

[GitHub] flink issue #2225: [FLINK-4191] Expose shard information in kinesis deserial...

2016-07-11 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2225 I added the javadoc and did some other changes: - Commented out the `isEndOfStream()` method, because its not respected. - Re-ordered the arguments of the deser schema. The first group is reco

[jira] [Created] (FLINK-4194) KinesisDeserializationSchema.isEndOfStream() is never called

2016-07-11 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-4194: - Summary: KinesisDeserializationSchema.isEndOfStream() is never called Key: FLINK-4194 URL: https://issues.apache.org/jira/browse/FLINK-4194 Project: Flink

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-07-11 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371134#comment-15371134 ] Gyula Fora commented on FLINK-4193: --- We are using a pretty recent version, just a couple

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-07-11 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371139#comment-15371139 ] Gyula Fora commented on FLINK-4193: --- I know that rocks is bundled within the application

[jira] [Commented] (FLINK-4159) Quickstart poms exclude unused dependencies

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371035#comment-15371035 ] ASF GitHub Bot commented on FLINK-4159: --- Github user greghogan commented on the issu

[GitHub] flink issue #2217: [FLINK-4159] Remove Quickstart exclusions for unused depe...

2016-07-11 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/2217 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if t

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-07-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371021#comment-15371021 ] Stephan Ewen commented on FLINK-4193: - On which version are you? I remember that [~alj

[jira] [Closed] (FLINK-4154) Correction of murmur hash breaks backwards compatibility

2016-07-11 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan closed FLINK-4154. - Resolution: Fixed Fixed in 81cf2296683a473db4061dd3bed0aeb249e05058 > Correction of murmur hash breaks ba

[jira] [Commented] (FLINK-4154) Correction of murmur hash breaks backwards compatibility

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370961#comment-15370961 ] ASF GitHub Bot commented on FLINK-4154: --- Github user asfgit closed the pull request

[GitHub] flink pull request #2223: [FLINK-4154] [core] Correction of murmur hash brea...

2016-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2223 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-3163) Configure Flink for NUMA systems

2016-07-11 Thread Saliya Ekanayake (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370933#comment-15370933 ] Saliya Ekanayake commented on FLINK-3163: - In the standalone cluster setup, doing

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370932#comment-15370932 ] ASF GitHub Bot commented on FLINK-4191: --- Github user tzulitai commented on the issue

[GitHub] flink issue #2225: [FLINK-4191] Expose shard information in kinesis deserial...

2016-07-11 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2225 Btw, should we also be adding the info from `Record#getPartitionKey()` to the deserialization schema too? Might be off the scope of this issue, but might as well now that we're on to this? --- If

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370918#comment-15370918 ] ASF GitHub Bot commented on FLINK-4191: --- Github user tzulitai commented on the issue

[jira] [Comment Edited] (FLINK-4190) Generalise RollingSink to work with arbitrary buckets

2016-07-11 Thread Josh Forman-Gornall (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370921#comment-15370921 ] Josh Forman-Gornall edited comment on FLINK-4190 at 7/11/16 2:58 PM: ---

[GitHub] flink issue #2225: [FLINK-4191] Expose shard information in kinesis deserial...

2016-07-11 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2225 LGTM, +1 to merge the change after travis turns green + minor Javadoc update. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[jira] [Commented] (FLINK-4190) Generalise RollingSink to work with arbitrary buckets

2016-07-11 Thread Josh Forman-Gornall (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370921#comment-15370921 ] Josh Forman-Gornall commented on FLINK-4190: I needed this feature and already

[jira] [Issue Comment Deleted] (FLINK-4190) Generalise RollingSink to work with arbitrary buckets

2016-07-11 Thread Josh Forman-Gornall (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Forman-Gornall updated FLINK-4190: --- Comment: was deleted (was: I needed this feature and already have a working solution -

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370889#comment-15370889 ] ASF GitHub Bot commented on FLINK-4191: --- Github user tzulitai commented on a diff in

[GitHub] flink pull request #2225: [FLINK-4191] Expose shard information in kinesis d...

2016-07-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2225#discussion_r70269570 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/serialization/KinesisDeserializationSche

[jira] [Commented] (FLINK-4192) Move Metrics API to separate module

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370885#comment-15370885 ] ASF GitHub Bot commented on FLINK-4192: --- Github user zentol commented on the issue:

[GitHub] flink issue #2226: [FLINK-4192] - Move Metrics API to separate module

2016-07-11 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/2226 Note that this PR will cause a few issues with other metric related Pull Requests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[jira] [Commented] (FLINK-3943) Add support for EXCEPT (set minus)

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370883#comment-15370883 ] ASF GitHub Bot commented on FLINK-3943: --- Github user mushketyk commented on the issu

[GitHub] flink issue #2169: [FLINK-3943] Add support for EXCEPT operator

2016-07-11 Thread mushketyk
Github user mushketyk commented on the issue: https://github.com/apache/flink/pull/2169 @twalthr Thank you for accepting my changes! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[jira] [Commented] (FLINK-4192) Move Metrics API to separate module

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370881#comment-15370881 ] ASF GitHub Bot commented on FLINK-4192: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request #2226: [FLINK-4192] - Move Metrics API to separate module

2016-07-11 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/2226 [FLINK-4192] - Move Metrics API to separate module This PR moves several metrics-related classes into a new module. The new module is located under `flink-metrics/flink-metrics-core`.

[jira] [Created] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-07-11 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-4193: - Summary: Task manager JVM crashes while deploying cancelling jobs Key: FLINK-4193 URL: https://issues.apache.org/jira/browse/FLINK-4193 Project: Flink Issue Type:

[jira] [Created] (FLINK-4192) Move Metrics API to separate module

2016-07-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-4192: --- Summary: Move Metrics API to separate module Key: FLINK-4192 URL: https://issues.apache.org/jira/browse/FLINK-4192 Project: Flink Issue Type: Improveme

[GitHub] flink pull request #2225: [FLINK-4191] Expose shard information in kinesis d...

2016-07-11 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2225 [FLINK-4191] Expose shard information in kinesis deserialization schema @tzulitai please review the change. You can merge this pull request into a Git repository by running: $ git pull https:/

[jira] [Commented] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370701#comment-15370701 ] ASF GitHub Bot commented on FLINK-4191: --- GitHub user rmetzger opened a pull request:

[jira] [Created] (FLINK-4191) Expose shard information in KinesisDeserializationSchema

2016-07-11 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-4191: - Summary: Expose shard information in KinesisDeserializationSchema Key: FLINK-4191 URL: https://issues.apache.org/jira/browse/FLINK-4191 Project: Flink Issu

[jira] [Commented] (FLINK-3190) Retry rate limits for DataStream API

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370686#comment-15370686 ] ASF GitHub Bot commented on FLINK-3190: --- Github user tillrohrmann commented on the i

[GitHub] flink issue #1954: [FLINK-3190] failure rate restart strategy

2016-07-11 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/1954 The changes look good to me. Thanks a lot for your work @fijolekProjects :-) Will be merging your PR. --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] flink pull request #2158: [FLINK-4116] Metrics documentation

2016-07-11 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/2158#discussion_r70246597 --- Diff: docs/apis/metrics.md --- @@ -0,0 +1,441 @@ +--- +title: "Metrics" +# Top-level navigation +top-nav-group: apis +top-nav-pos:

[jira] [Commented] (FLINK-4116) Document metrics

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370634#comment-15370634 ] ASF GitHub Bot commented on FLINK-4116: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-4157) FlinkKafkaMetrics cause TaskManager shutdown during cancellation

2016-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370616#comment-15370616 ] ASF GitHub Bot commented on FLINK-4157: --- Github user asfgit closed the pull request

[GitHub] flink pull request #2206: [FLINK-4157] Catch Kafka metrics serialization exc...

2016-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2206 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (FLINK-4157) FlinkKafkaMetrics cause TaskManager shutdown during cancellation

2016-07-11 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-4157. --- Resolution: Fixed Resolved in http://git-wip-us.apache.org/repos/asf/flink/commit/36aad48e >

  1   2   >