[GitHub] flink pull request #2260: [FLINK-4222] Allow Kinesis configuration to get cr...

2016-07-15 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2260#discussion_r71062232 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/util/AWSUtil.java --- @@ -50,8 +50,

[jira] [Commented] (FLINK-4222) Allow Kinesis configuration to get credentials from AWS Metadata

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380570#comment-15380570 ] ASF GitHub Bot commented on FLINK-4222: --- Github user tzulitai commented on a diff in

[jira] [Created] (FLINK-4223) Rearrange scaladoc and javadoc for Scala API

2016-07-15 Thread Chiwan Park (JIRA)
Chiwan Park created FLINK-4223: -- Summary: Rearrange scaladoc and javadoc for Scala API Key: FLINK-4223 URL: https://issues.apache.org/jira/browse/FLINK-4223 Project: Flink Issue Type: Improvemen

[jira] [Commented] (FLINK-4222) Allow Kinesis configuration to get credentials from AWS Metadata

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380312#comment-15380312 ] ASF GitHub Bot commented on FLINK-4222: --- GitHub user chadnickbok opened a pull reque

[GitHub] flink pull request #2260: [FLINK-4222] Allow Kinesis configuration to get cr...

2016-07-15 Thread chadnickbok
GitHub user chadnickbok opened a pull request: https://github.com/apache/flink/pull/2260 [FLINK-4222] Allow Kinesis configuration to get credentials from AWS Metadata When called without credentials, the AmazonKinesisClient tries to configure itself automatically, searching

[jira] [Created] (FLINK-4222) Allow Kinesis configuration to get credentials from AWS Metadata

2016-07-15 Thread Nick Chadwick (JIRA)
Nick Chadwick created FLINK-4222: Summary: Allow Kinesis configuration to get credentials from AWS Metadata Key: FLINK-4222 URL: https://issues.apache.org/jira/browse/FLINK-4222 Project: Flink

[jira] [Updated] (FLINK-4209) Fix issue on docker with multiple NICs and remove supervisord dependency

2016-07-15 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated FLINK-4209: Summary: Fix issue on docker with multiple NICs and remove supervisord dependency (was: Docker imag

[jira] [Closed] (FLINK-4208) Support Running Flink processes in foreground mode

2016-07-15 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía closed FLINK-4208. --- Resolution: Fixed I decided to remove the issue for foreground mode and change the docker script to u

[jira] [Commented] (FLINK-4208) Support Running Flink processes in foreground mode

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380064#comment-15380064 ] ASF GitHub Bot commented on FLINK-4208: --- Github user iemejia closed the pull request

[GitHub] flink pull request #2239: [FLINK-4208] Support Running Flink processes in fo...

2016-07-15 Thread iemejia
Github user iemejia closed the pull request at: https://github.com/apache/flink/pull/2239 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[jira] [Commented] (FLINK-4209) Docker image breaks with multiple NICs

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380060#comment-15380060 ] ASF GitHub Bot commented on FLINK-4209: --- Github user iemejia commented on the issue:

[GitHub] flink issue #2240: [FLINK-4209] Fix issue on docker with multiple NICs and r...

2016-07-15 Thread iemejia
Github user iemejia commented on the issue: https://github.com/apache/flink/pull/2240 I added this last commit to remove the dependency on supervisord, thanks to @greghogan for the 'wait' idea. Now flink has the thinnest docker image possible :). --- If your project is set up for it

[GitHub] flink issue #2239: [FLINK-4208] Support Running Flink processes in foregroun...

2016-07-15 Thread iemejia
Github user iemejia commented on the issue: https://github.com/apache/flink/pull/2239 Thanks Greg, I was probably too tired last night because I put the wait in a weird place, I just tried now and everything is working, it is still not 'real' foreground, since Ctrl-C gets captured by

[jira] [Commented] (FLINK-4208) Support Running Flink processes in foreground mode

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380057#comment-15380057 ] ASF GitHub Bot commented on FLINK-4208: --- Github user iemejia commented on the issue:

[GitHub] flink issue #1947: [FLINK-1502] [WIP] Basic Metric System

2016-07-15 Thread sumitchawla
Github user sumitchawla commented on the issue: https://github.com/apache/flink/pull/1947 Thanks a lot @zentol .. this is great.. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[jira] [Commented] (FLINK-1502) Expose metrics to graphite, ganglia and JMX.

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379850#comment-15379850 ] ASF GitHub Bot commented on FLINK-1502: --- Github user sumitchawla commented on the is

[jira] [Commented] (FLINK-1502) Expose metrics to graphite, ganglia and JMX.

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379835#comment-15379835 ] ASF GitHub Bot commented on FLINK-1502: --- Github user zentol commented on the issue:

[GitHub] flink issue #1947: [FLINK-1502] [WIP] Basic Metric System

2016-07-15 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/1947 @sumitchawla sure you can, as described here: https://ci.apache.org/projects/flink/flink-docs-master/apis/metrics.html#registering-metrics --- If your project is set up for it, you can reply to this

[jira] [Commented] (FLINK-1502) Expose metrics to graphite, ganglia and JMX.

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379829#comment-15379829 ] ASF GitHub Bot commented on FLINK-1502: --- Github user sumitchawla commented on the is

[GitHub] flink issue #1947: [FLINK-1502] [WIP] Basic Metric System

2016-07-15 Thread sumitchawla
Github user sumitchawla commented on the issue: https://github.com/apache/flink/pull/1947 @zentol .. by job writer i meant end user writing jobs using Flink API. As of now i can create custom accumulators using `getRuntimeContext().addAccumulator(ACCUMULATOR_NAME,...` can i do someth

[jira] [Commented] (FLINK-1267) Add crossGroup operator

2016-07-15 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379790#comment-15379790 ] Stephan Ewen commented on FLINK-1267: - Should we move the discussion to one of the two

[jira] [Commented] (FLINK-3397) Failed streaming jobs should fall back to the most recent checkpoint/savepoint

2016-07-15 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379767#comment-15379767 ] Ufuk Celebi commented on FLINK-3397: Thanks for the reminder! :-) The description of

[GitHub] flink pull request #2259: [hotfix] Fixes broken TopSpeedWindowing scala exam...

2016-07-15 Thread kl0u
GitHub user kl0u opened a pull request: https://github.com/apache/flink/pull/2259 [hotfix] Fixes broken TopSpeedWindowing scala example The problem was that in the case where no input file was provided, the `fromCollection()` source was never exiting and the actual program was never

[jira] [Commented] (FLINK-4201) Checkpoints for jobs in non-terminal state (e.g. suspended) get deleted

2016-07-15 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379639#comment-15379639 ] Ufuk Celebi commented on FLINK-4201: The shut down hook is actually not a problem, bec

[jira] [Assigned] (FLINK-4201) Checkpoints for jobs in non-terminal state (e.g. suspended) get deleted

2016-07-15 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi reassigned FLINK-4201: -- Assignee: Ufuk Celebi > Checkpoints for jobs in non-terminal state (e.g. suspended) get deleted

[jira] [Commented] (FLINK-4213) Provide CombineHint in Gelly algorithms

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379631#comment-15379631 ] ASF GitHub Bot commented on FLINK-4213: --- Github user greghogan commented on the issu

[GitHub] flink issue #2248: [FLINK-4213] [gelly] Provide CombineHint in Gelly algorit...

2016-07-15 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/2248 Yes, and the job plan attached to the ticket shows the only combine as a "Sorted Combine" (from distinct). --- If your project is set up for it, you can reply to this email and have your reply app

[GitHub] flink issue #2256: [FLINK-4150] [runtime] Don't clean up BlobStore on BlobSe...

2016-07-15 Thread uce
Github user uce commented on the issue: https://github.com/apache/flink/pull/2256 I don't know if we "want to", but it is the current behaviour. A job should only fail if its restart strategy is exhausted though. Do you think we should change that behaviour? --- If your project is

[jira] [Commented] (FLINK-4150) Problem with Blobstore in Yarn HA setting on recovery after cluster shutdown

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379618#comment-15379618 ] ASF GitHub Bot commented on FLINK-4150: --- Github user uce commented on the issue:

[jira] [Commented] (FLINK-3279) Optionally disable DistinctOperator combiner

2016-07-15 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379606#comment-15379606 ] Greg Hogan commented on FLINK-3279: --- I fixed the wording of my comment. I think Fabian's

[jira] [Comment Edited] (FLINK-3279) Optionally disable DistinctOperator combiner

2016-07-15 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379599#comment-15379599 ] Gabor Gevay edited comment on FLINK-3279 at 7/15/16 4:00 PM: -

[jira] [Commented] (FLINK-3279) Optionally disable DistinctOperator combiner

2016-07-15 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379599#comment-15379599 ] Gabor Gevay commented on FLINK-3279: https://issues.apache.org/jira/browse/FLINK-3479?

[jira] [Comment Edited] (FLINK-3279) Optionally disable DistinctOperator combiner

2016-07-15 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379590#comment-15379590 ] Greg Hogan edited comment on FLINK-3279 at 7/15/16 3:54 PM: Do

[jira] [Commented] (FLINK-3279) Optionally disable DistinctOperator combiner

2016-07-15 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379590#comment-15379590 ] Greg Hogan commented on FLINK-3279: --- Do we have a ticket for porting groupReduce to redu

[jira] [Resolved] (FLINK-4196) Remove "recoveryTimestamp"

2016-07-15 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-4196. - Resolution: Fixed Fix Version/s: 1.1.0 Fixed via de6a3d33ecfa689fd0da1ef661bbf6edb68e9d0b

[jira] [Closed] (FLINK-4196) Remove "recoveryTimestamp"

2016-07-15 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-4196. --- > Remove "recoveryTimestamp" > -- > > Key: FLINK-4196 >

[jira] [Commented] (FLINK-1267) Add crossGroup operator

2016-07-15 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379563#comment-15379563 ] Greg Hogan commented on FLINK-1267: --- I think my FLINK-3910 is a duplicate of this idea.

[jira] [Commented] (FLINK-4213) Provide CombineHint in Gelly algorithms

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379557#comment-15379557 ] ASF GitHub Bot commented on FLINK-4213: --- Github user StephanEwen commented on the is

[jira] [Resolved] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-15 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-3466. - Resolution: Fixed Fix Version/s: 1.1.0 Fixed in e9f660d1ff5540c7ef829f2de5bb870b787c18b7 >

[GitHub] flink issue #2248: [FLINK-4213] [gelly] Provide CombineHint in Gelly algorit...

2016-07-15 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2248 Does the deadlock occur only with the combiner, or also with the sorter? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[jira] [Closed] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-15 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-3466. --- > Job might get stuck in restoreState() from HDFS due to interrupt > -

[jira] [Commented] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379553#comment-15379553 ] ASF GitHub Bot commented on FLINK-3466: --- Github user StephanEwen closed the pull req

[jira] [Commented] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379552#comment-15379552 ] ASF GitHub Bot commented on FLINK-3466: --- Github user StephanEwen commented on the is

[GitHub] flink pull request #2252: [FLINK-3466] [runtime] Cancel state handled on sta...

2016-07-15 Thread StephanEwen
Github user StephanEwen closed the pull request at: https://github.com/apache/flink/pull/2252 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-15 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-3466: Affects Version/s: (was: 0.10.2) (was: 1.0.0) 1

[jira] [Updated] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-15 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-3466: Priority: Blocker (was: Major) > Job might get stuck in restoreState() from HDFS due to interrupt >

[GitHub] flink issue #2252: [FLINK-3466] [runtime] Cancel state handled on state rest...

2016-07-15 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2252 Manually merged in e9f660d1ff5540c7ef829f2de5bb870b787c18b7 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[jira] [Commented] (FLINK-3204) TaskManagers are not shutting down properly on YARN

2016-07-15 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379516#comment-15379516 ] Robert Metzger commented on FLINK-3204: --- I think this error still persists and also

[jira] [Updated] (FLINK-3204) TaskManagers are not shutting down properly on YARN

2016-07-15 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-3204: -- Labels: test-stability (was: ) > TaskManagers are not shutting down properly on YARN >

[jira] [Updated] (FLINK-3204) TaskManagers are not shutting down properly on YARN

2016-07-15 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-3204: -- Affects Version/s: 1.1.0 > TaskManagers are not shutting down properly on YARN > ---

[jira] [Commented] (FLINK-4186) Expose Kafka metrics through Flink metrics

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379474#comment-15379474 ] ASF GitHub Bot commented on FLINK-4186: --- Github user asfgit closed the pull request

[jira] [Resolved] (FLINK-4186) Expose Kafka metrics through Flink metrics

2016-07-15 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-4186. --- Resolution: Fixed Fix Version/s: 1.1.0 Resolved in http://git-wip-us.apache.org/repos/a

[GitHub] flink pull request #2236: [FLINK-4186] Use Flink metrics to report Kafka met...

2016-07-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2236 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] flink issue #2236: [FLINK-4186] Use Flink metrics to report Kafka metrics

2016-07-15 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2236 I'm merging the change ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[jira] [Commented] (FLINK-4186) Expose Kafka metrics through Flink metrics

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379463#comment-15379463 ] ASF GitHub Bot commented on FLINK-4186: --- Github user rmetzger commented on the issue

[GitHub] flink issue #2220: [FLINK-4184] [metrics] Replace invalid characters in Sche...

2016-07-15 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/2220 I would appreciate it if you would give me time to answer to your response before going ahead with a merge. --- If your project is set up for it, you can reply to this email and have your reply appea

[jira] [Commented] (FLINK-4184) Ganglia and GraphiteReporter report metric names with invalid characters

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379459#comment-15379459 ] ASF GitHub Bot commented on FLINK-4184: --- Github user zentol commented on the issue:

[jira] [Commented] (FLINK-4104) Restructure Gelly docs

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379458#comment-15379458 ] ASF GitHub Bot commented on FLINK-4104: --- Github user greghogan commented on the issu

[GitHub] flink issue #2258: [FLINK-4104] [docs] Restructure Gelly docs

2016-07-15 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/2258 What do you think, @vasia? Is it a problem to rename `gelly_guide.html` to `gelly/index.html` as done with ML? Also, I manufactured a TOC on the top-level Gelly page. --- If your project

[jira] [Commented] (FLINK-4104) Restructure Gelly docs

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379454#comment-15379454 ] ASF GitHub Bot commented on FLINK-4104: --- GitHub user greghogan opened a pull request

[GitHub] flink pull request #2258: [FLINK-4104] [docs] Restructure Gelly docs

2016-07-15 Thread greghogan
GitHub user greghogan opened a pull request: https://github.com/apache/flink/pull/2258 [FLINK-4104] [docs] Restructure Gelly docs Split the Gelly documentation into five sub-pages. You can merge this pull request into a Git repository by running: $ git pull https://github.com/g

[jira] [Commented] (FLINK-4150) Problem with Blobstore in Yarn HA setting on recovery after cluster shutdown

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379447#comment-15379447 ] ASF GitHub Bot commented on FLINK-4150: --- Github user tillrohrmann commented on the i

[jira] [Commented] (FLINK-4184) Ganglia and GraphiteReporter report metric names with invalid characters

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379445#comment-15379445 ] ASF GitHub Bot commented on FLINK-4184: --- Github user zentol commented on a diff in t

[GitHub] flink issue #2256: [FLINK-4150] [runtime] Don't clean up BlobStore on BlobSe...

2016-07-15 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/2256 Just a quick question. Do we want to remove also failed jobs from the BlobStore and ZK? Or only finished or cancelled jobs? --- If your project is set up for it, you can reply to this email and

[GitHub] flink pull request #2220: [FLINK-4184] [metrics] Replace invalid characters ...

2016-07-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2220#discussion_r70979472 --- Diff: flink-metrics/flink-metrics-dropwizard/src/main/java/org/apache/flink/dropwizard/ScheduledDropwizardReporter.java --- @@ -74,6 +75,15 @@ protected S

[jira] [Closed] (FLINK-4184) Ganglia and GraphiteReporter report metric names with invalid characters

2016-07-15 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-4184. Resolution: Fixed Fixed via 70094a1818b532f4e0ff31f5debc550ed4336286 > Ganglia and GraphiteReporter

[jira] [Commented] (FLINK-4184) Ganglia and GraphiteReporter report metric names with invalid characters

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379416#comment-15379416 ] ASF GitHub Bot commented on FLINK-4184: --- Github user asfgit closed the pull request

[GitHub] flink pull request #2220: [FLINK-4184] [metrics] Replace invalid characters ...

2016-07-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2220 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] flink issue #2220: [FLINK-4184] [metrics] Replace invalid characters in Sche...

2016-07-15 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/2220 Thanks for the review @zentol. Will be merging this PR then. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[jira] [Commented] (FLINK-4184) Ganglia and GraphiteReporter report metric names with invalid characters

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379409#comment-15379409 ] ASF GitHub Bot commented on FLINK-4184: --- Github user tillrohrmann commented on the i

[jira] [Commented] (FLINK-4184) Ganglia and GraphiteReporter report metric names with invalid characters

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379407#comment-15379407 ] ASF GitHub Bot commented on FLINK-4184: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request #2220: [FLINK-4184] [metrics] Replace invalid characters ...

2016-07-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/2220#discussion_r70977551 --- Diff: flink-metrics/flink-metrics-dropwizard/src/main/java/org/apache/flink/dropwizard/ScheduledDropwizardReporter.java --- @@ -74,6 +75,15 @@ prote

[GitHub] flink pull request #2257: [FLINK-4152] Allow re-registration of TMs at resou...

2016-07-15 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/2257 [FLINK-4152] Allow re-registration of TMs at resource manager The `YarnFlinkResourceManager` does not allow the `JobManager` to re-register task managers have had been registered at the resourc

[jira] [Commented] (FLINK-4152) TaskManager registration exponential backoff doesn't work

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379396#comment-15379396 ] ASF GitHub Bot commented on FLINK-4152: --- GitHub user tillrohrmann opened a pull requ

[jira] [Commented] (FLINK-4150) Problem with Blobstore in Yarn HA setting on recovery after cluster shutdown

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379374#comment-15379374 ] ASF GitHub Bot commented on FLINK-4150: --- GitHub user uce opened a pull request:

[GitHub] flink pull request #2256: [FLINK-4150] [runtime] Don't clean up BlobStore on...

2016-07-15 Thread uce
GitHub user uce opened a pull request: https://github.com/apache/flink/pull/2256 [FLINK-4150] [runtime] Don't clean up BlobStore on BlobServer shut down The `BlobServer` acts as a local cache for uploaded BLOBs. The life-cycle of each BLOB is bound to the life-cycle of the `BlobServ

[jira] [Assigned] (FLINK-4150) Problem with Blobstore in Yarn HA setting on recovery after cluster shutdown

2016-07-15 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi reassigned FLINK-4150: -- Assignee: Ufuk Celebi > Problem with Blobstore in Yarn HA setting on recovery after cluster shu

[jira] [Closed] (FLINK-4142) Recovery problem in HA on Hadoop Yarn 2.4.1

2016-07-15 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi closed FLINK-4142. -- Added note to docs about this in d08b189 (master). > Recovery problem in HA on Hadoop Yarn 2.4.1 >

[jira] [Commented] (FLINK-4211) Dynamic Properties not working for jobs submitted to Yarn session

2016-07-15 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379336#comment-15379336 ] Ufuk Celebi commented on FLINK-4211: The problem is that the YARN session config and t

[jira] [Closed] (FLINK-4182) HA recovery not working properly under ApplicationMaster failures.

2016-07-15 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi closed FLINK-4182. -- Resolution: Duplicate The quoted stack trace is a duplicate of FLINK-4150. The inconsistent result migh

[jira] [Commented] (FLINK-4218) Sporadic "java.lang.RuntimeException: Error triggering a checkpoint..." causes task restarting

2016-07-15 Thread Sergii Koshel (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379330#comment-15379330 ] Sergii Koshel commented on FLINK-4218: -- According to https://github.com/Aloisius/had

[GitHub] flink issue #2251: [FLINK-4212] [scripts] Lock PID file when starting daemon...

2016-07-15 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/2251 Looks like it is available in Linux and BSD but not MacOS. We can skip locking if `flock` is not available. The race condition only manifests when starting duplicate managers on the same system in

[jira] [Commented] (FLINK-4212) Lock PID file when starting daemons

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379313#comment-15379313 ] ASF GitHub Bot commented on FLINK-4212: --- Github user greghogan commented on the issu

[jira] [Commented] (FLINK-4212) Lock PID file when starting daemons

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379288#comment-15379288 ] ASF GitHub Bot commented on FLINK-4212: --- Github user StephanEwen commented on the is

[GitHub] flink issue #2251: [FLINK-4212] [scripts] Lock PID file when starting daemon...

2016-07-15 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2251 Is the `flock` command available by default on the common UNIX-style OSs? Ubuntu has it by default, what about MacOS? --- If your project is set up for it, you can reply to this email an

[jira] [Commented] (FLINK-4210) Move close()/isClosed() out of MetricGroup interface

2016-07-15 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379276#comment-15379276 ] Chesnay Schepler commented on FLINK-4210: - initially there was a separate group fo

[jira] [Commented] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379270#comment-15379270 ] ASF GitHub Bot commented on FLINK-3466: --- Github user StephanEwen commented on the is

[GitHub] flink issue #2252: [FLINK-3466] [runtime] Cancel state handled on state rest...

2016-07-15 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2252 Thanks, I'll address your comments and merge this... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Commented] (FLINK-3397) Failed streaming jobs should fall back to the most recent checkpoint/savepoint

2016-07-15 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379266#comment-15379266 ] ramkrishna.s.vasudevan commented on FLINK-3397: --- [~uce] Just a gentle remind

[jira] [Commented] (FLINK-4210) Move close()/isClosed() out of MetricGroup interface

2016-07-15 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379258#comment-15379258 ] Stephan Ewen commented on FLINK-4210: - So, the Flink runtime metrics for an operator a

[jira] [Commented] (FLINK-4218) Sporadic "java.lang.RuntimeException: Error triggering a checkpoint..." causes task restarting

2016-07-15 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379254#comment-15379254 ] Stephan Ewen commented on FLINK-4218: - The read-after-write consistency seems to hold

[jira] [Commented] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379249#comment-15379249 ] ASF GitHub Bot commented on FLINK-3466: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request #2252: [FLINK-3466] [runtime] Cancel state handled on sta...

2016-07-15 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/2252#discussion_r70956813 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/tasks/InterruptSensitiveRestoreTest.java --- @@ -0,0 +1,223 @@ +/*

[GitHub] flink pull request #2252: [FLINK-3466] [runtime] Cancel state handled on sta...

2016-07-15 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/2252#discussion_r70956861 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/AbstractFileStateHandle.java --- @@ -20,18 +20,21 @@ import or

[jira] [Commented] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379248#comment-15379248 ] ASF GitHub Bot commented on FLINK-3466: --- Github user StephanEwen commented on a diff

[jira] [Commented] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379247#comment-15379247 ] ASF GitHub Bot commented on FLINK-3466: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request #2252: [FLINK-3466] [runtime] Cancel state handled on sta...

2016-07-15 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/2252#discussion_r70956828 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/AbstractCloseableHandle.java --- @@ -0,0 +1,131 @@ +/* + * Licensed to the A

[jira] [Commented] (FLINK-3466) Job might get stuck in restoreState() from HDFS due to interrupt

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379245#comment-15379245 ] ASF GitHub Bot commented on FLINK-3466: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request #2252: [FLINK-3466] [runtime] Cancel state handled on sta...

2016-07-15 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/2252#discussion_r70956526 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/memory/AbstractMemStateSnapshot.java --- @@ -54,6 +56,8 @@ /** The ser

[GitHub] flink issue #2226: [FLINK-4192] - Move Metrics API to separate module

2016-07-15 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/2226 @StephanEwen I've changed the `MetricConfig`to extend `Properties` and remove the `setString()` method. I've kept the other methods for now. --- If your project is set up for it, you can reply to thi

  1   2   >