[GitHub] flink pull request #4176: [FLINK-6916][blob] add API to allow job-related BL...

2017-06-23 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4176 [FLINK-6916][blob] add API to allow job-related BLOBs to be stored This PR is the fourth in a series for FLIP-19, based upon #4174. It allows (CONTENT_ADDRESSABLE) BLOBs to not only be stored

[GitHub] flink pull request #4146: [FLINK-6008][blob] collection of BlobServer improv...

2017-06-28 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4146#discussion_r124584383 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobClient.java --- @@ -593,9 +594,7 @@ private void sendPutHeader(OutputStream

[GitHub] flink pull request #4146: [FLINK-6008][blob] collection of BlobServer improv...

2017-06-28 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4146#discussion_r124585333 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobUtils.java --- @@ -227,7 +227,7 @@ static File getStorageLocation(File storageDir

[GitHub] flink pull request #4146: [FLINK-6008][blob] collection of BlobServer improv...

2017-06-28 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4146#discussion_r124586418 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/blob/BlobServerPutTest.java --- @@ -59,6 +60,110 @@ private final Random rnd

[GitHub] flink pull request #4146: [FLINK-6008][blob] collection of BlobServer improv...

2017-06-28 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4146#discussion_r124587248 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobServerConnection.java --- @@ -509,21 +509,7 @@ private void delete(InputStream

[GitHub] flink pull request #4146: [FLINK-6008][blob] collection of BlobServer improv...

2017-06-29 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4146#discussion_r124734798 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/blob/BlobServerPutTest.java --- @@ -59,6 +60,110 @@ private final Random rnd

[GitHub] flink pull request #4174: [FLINK-6916][blob] more code style and test improv...

2017-06-30 Thread NicoK
Github user NicoK closed the pull request at: https://github.com/apache/flink/pull/4174 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #4174: [FLINK-6916][blob] more code style and test improvements

2017-06-30 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4174 let's split this up into two parts... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] flink pull request #4234: [FLINK-7053] improve code quality in some tests

2017-06-30 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4234 [FLINK-7053] improve code quality in some tests * `BlobClientTest` and `BlobClientSslTest` share a lot of common code * the received buffers there are currently not verified for being equal to

[GitHub] flink pull request #4235: [FLINK-7054] [blob] remove LibraryCacheManager#get...

2017-06-30 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4235 [FLINK-7054] [blob] remove LibraryCacheManager#getFile() `LibraryCacheManager#getFile()` was only used in tests where it is avoidable but if used anywhere else, it may have caused cleanup issues

[GitHub] flink pull request #4236: [FLINK-7055][blob] refactor BlobService#getURL() m...

2017-06-30 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4236 [FLINK-7055][blob] refactor BlobService#getURL() methods to return a File object As a relic from its use by the `URLClassLoader`, `BlobService#getURL()` methods always returned URL objects although

[GitHub] flink pull request #4237: [FLINK-7056][blob] add API to allow job-related BL...

2017-06-30 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4237 [FLINK-7056][blob] add API to allow job-related BLOBs to be stored To ease cleanup, we will make job-related BLOBs be reflected in the blob storage so that they may be removed along with the job

[GitHub] flink pull request #4176: [FLINK-6916][blob] add API to allow job-related BL...

2017-06-30 Thread NicoK
Github user NicoK closed the pull request at: https://github.com/apache/flink/pull/4176 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #4176: [FLINK-6916][blob] add API to allow job-related BLOBs to ...

2017-06-30 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4176 superseeded by #4237 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink pull request #4238: [FLINK-7057][blob] move BLOB ref-counting from Lib...

2017-06-30 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4238 [FLINK-7057][blob] move BLOB ref-counting from LibraryCacheManager to BlobCache Currently, the `LibraryCacheManager` is doing some ref-counting for JAR files managed by it. Instead, we want the

[GitHub] flink pull request #4245: [FLINK-7012] remove user-JAR upload when disposing...

2017-07-03 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4245 [FLINK-7012] remove user-JAR upload when disposing a savepoint the old way Inside `CliFrontend#disposeSavepoint()`, user JAR files are being uploaded to the `BlobServer` but they are actually not

[GitHub] flink pull request #4146: [FLINK-6008][blob] collection of BlobServer improv...

2017-07-03 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4146#discussion_r125243142 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobServerConnection.java --- @@ -540,7 +526,7 @@ else if (type == NAME_ADDRESSABLE

[GitHub] flink pull request #4146: [FLINK-6008][blob] collection of BlobServer improv...

2017-07-03 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4146#discussion_r125244675 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/blob/BlobServerDeleteTest.java --- @@ -92,6 +99,69 @@ public void testDeleteSingle

[GitHub] flink issue #4238: [FLINK-7057][blob] move BLOB ref-counting from LibraryCac...

2017-07-03 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4238 I wonder how that slipped throughanyway, should be fixed now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] flink pull request #4238: [FLINK-7057][blob] move BLOB ref-counting from Lib...

2017-07-04 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4238#discussion_r125404358 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobCache.java --- @@ -107,146 +133,268 @@ public BlobCache

[GitHub] flink pull request #4238: [FLINK-7057][blob] move BLOB ref-counting from Lib...

2017-07-04 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4238#discussion_r125406639 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/execution/librarycache/BlobServerLibraryManager.java --- @@ -0,0 +1,55

[GitHub] flink pull request #4238: [FLINK-7057][blob] move BLOB ref-counting from Lib...

2017-07-04 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4238#discussion_r125430028 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobUtils.java --- @@ -162,105 +164,116 @@ static File initStorageDirectory(String

[GitHub] flink pull request #4238: [FLINK-7057][blob] move BLOB ref-counting from Lib...

2017-07-04 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4238#discussion_r125430786 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobServerConnection.java --- @@ -477,97 +406,96 @@ else if (contentAddressable

[GitHub] flink pull request #4255: [FLINK-7102] improve ClassLoaderITCase

2017-07-04 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4255 [FLINK-7102] improve ClassLoaderITCase * ClassLoaderITCase unnecessarily runs multiple tests in a single test case * ClassLoaderITCase#testDisposeSavepointWithCustomKvState() does not cancel its

[GitHub] flink pull request #4238: [FLINK-7057][blob] move BLOB ref-counting from Lib...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4238#discussion_r125827511 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobServerConnection.java --- @@ -477,97 +406,96 @@ else if (contentAddressable

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125910462 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/utils/ParameterTool.java --- @@ -548,6 +565,7 @@ protected Object clone() throws

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125911549 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125914354 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125911613 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125912201 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125911760 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125911804 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125911011 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -78,18 +79,12 @@ public void testMultipleNoValMixed

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125911852 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125911839 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125911637 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125910930 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -78,18 +79,12 @@ public void testMultipleNoValMixed

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125911372 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125910799 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -34,8 +36,7 @@ @Test(expected

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125911520 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-06 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r125912602 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -154,4 +149,149 @@ public void testFromGenericOptionsParser

[GitHub] flink issue #4110: [FLINK-6900] [metrics] Limit size of metric name componen...

2017-07-06 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4110 just for clarification, `a.b..c.d` would then be stored in `a/b//c/d` so that each component/file/directory is not larger than 80? --- If your project is set up for it, you can reply to this email

[GitHub] flink issue #3742: [FLINK-6046] Add support for oversized messages during de...

2017-07-10 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/3742 I'll rebase it on top of FLIP-19 once ready - or should I open a new PR for this then? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] flink issue #4158: [FLINK-7052][blob] remove (unused) NAME_ADDRESSABLE mode

2017-07-10 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4158 there you go --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] flink pull request #4293: [FLINK-7141][build] enable travis cache again

2017-07-10 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4293 [FLINK-7141][build] enable travis cache again this re-enables the Travis CI cache with a safety net in place that should prevent failing builds because of invalid jar files: 1) we give each

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-10 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r126401183 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -34,8 +36,7 @@ @Test(expected

[GitHub] flink issue #4110: [FLINK-6900] [metrics] Limit size of metric name componen...

2017-07-10 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4110 @zentol then +1 after addressing @greghogan's comments (adding a warning + using a constant for the `80`) --- If your project is set up for it, you can reply to this email and have your reply a

[GitHub] flink pull request #4158: [FLINK-7052][blob] remove (unused) NAME_ADDRESSABL...

2017-07-10 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4158#discussion_r126398901 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobClient.java --- @@ -551,33 +425,17 @@ else if (response == RETURN_ERROR

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-10 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r126413188 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -278,6 +518,26 @@ public void testUnrequestedRequired

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-10 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r126412849 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -187,35 +252,122 @@ public void testUnrequestedShort

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-10 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r126413856 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -174,9 +210,38 @@ public void testUnrequestedByte

[GitHub] flink issue #4293: [FLINK-7141][build] enable travis cache again

2017-07-10 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4293 that's actually hard to know in advance - I had only 3 builds that went under the limit by chance so I was able to use the cache henceforth in those three which constantly were below the 49min.

[GitHub] flink pull request #4246: [FLINK-7063] [checkpoint] Call super.cancel(...) b...

2017-07-10 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4246#discussion_r126437776 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/async/AsyncStoppableTaskWithCallback.java --- @@ -21,6 +21,7 @@ import

[GitHub] flink pull request #4110: [FLINK-6900] [metrics] Limit size of metric name c...

2017-07-10 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4110#discussion_r126443486 --- Diff: flink-metrics/flink-metrics-statsd/src/test/java/org/apache/flink/metrics/statsd/StatsDReporterTest.java --- @@ -60,6 +60,20 @@ public class

[GitHub] flink pull request #4110: [FLINK-6900] [metrics] Limit size of metric name c...

2017-07-10 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4110#discussion_r126442516 --- Diff: flink-metrics/flink-metrics-dropwizard/src/main/java/org/apache/flink/dropwizard/ScheduledDropwizardReporter.java --- @@ -184,7 +188,10 @@ public

[GitHub] flink pull request #4110: [FLINK-6900] [metrics] Limit size of metric name c...

2017-07-10 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4110#discussion_r126443494 --- Diff: flink-metrics/flink-metrics-statsd/src/main/java/org/apache/flink/metrics/statsd/StatsDReporter.java --- @@ -193,7 +198,10 @@ private void send

[GitHub] flink pull request #4112: [FLINK-6901] Flip checkstyle configuration files

2017-07-10 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4112#discussion_r126451783 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/netty/NettyBufferPool.java --- @@ -61,7 +60,9 @@ public NettyBufferPool(int

[GitHub] flink issue #4293: [FLINK-7141][build] enable travis cache again

2017-07-11 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4293 to be honest, I think the cache was used in the second build of the PR as indicated by these lines (of the first build profile): ``` attempting to download cache archive - 3.41s fetching

[GitHub] flink pull request #4169: [FLINK-6357] [java] ParameterTool get unrequested ...

2017-07-11 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4169#discussion_r126634784 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/utils/ParameterToolTest.java --- @@ -174,9 +210,38 @@ public void testUnrequestedByte

[GitHub] flink issue #4169: [FLINK-6357] [java] ParameterTool get unrequested paramet...

2017-07-11 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4169 thanks for the code and the additions +1 if/when the tests pass :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] flink issue #4293: [FLINK-7141][build] enable travis cache again

2017-07-11 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4293 Looks like with the cache it is only downloading flink artefacts from earlier versions for API comparisons (I excluded `$HOME/.m2/repository/org/apache/flink/` from the cache). Also, it seems

[GitHub] flink issue #4293: [FLINK-7141][build] enable travis cache again

2017-07-12 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4293 sounds like a good plan but in the past it wasn't clear where the caches got corrupted, i.e. by travis during cache restore, or by mvn during the build. If the former is still possible, we could

[GitHub] flink issue #4293: [FLINK-7141][build] enable travis cache again

2017-07-12 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4293 Once we are able to delete the travis cache on our own, we may experiment a bit more and try without the cleanup task or just running it for failed jobs. For now, though, @StephanEwen has a

[GitHub] flink pull request #4309: [FLINK-7166][avro] cleanup generated test classes ...

2017-07-12 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4309 [FLINK-7166][avro] cleanup generated test classes in the cleanup phase Maven neither cleaned up generated avro classes used by tests nor did it replace them with new ones after the avro

[GitHub] flink pull request #4110: [FLINK-6900] [metrics] Limit size of metric name c...

2017-07-12 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4110#discussion_r126940120 --- Diff: flink-metrics/flink-metrics-statsd/src/test/java/org/apache/flink/metrics/statsd/StatsDReporterTest.java --- @@ -60,6 +60,20 @@ public class

[GitHub] flink issue #4234: [FLINK-7053][blob] improve code quality in some tests

2017-07-12 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4234 ok, I rebased this and all following PRs for FLINK-6916 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink pull request #4354: [FLINK-7212][tests] re-enable JobManagerLeaderSess...

2017-07-17 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4354 [FLINK-7212][tests] re-enable JobManagerLeaderSessionIDITCase This test was previously named JobManagerLeaderSessionIDITSuite and has not been executed for a while by maven because of it having

[GitHub] flink pull request #4358: [FLINK-7068][blob] change BlobService sub-classes ...

2017-07-18 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4358 [FLINK-7068][blob] change BlobService sub-classes for permanent and transient BLOBs This splits up the BLOB store classes into two different use cases which is the biggest change of FLIP-19: * a

[GitHub] flink pull request #4359: [FLINK-7140][blob] add an additional random compon...

2017-07-18 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4359 [FLINK-7140][blob] add an additional random component into the BlobKey This should guard us from uploading (and deleting) the same file more than once and also from hash collisions. This PR

[GitHub] flink pull request #4342: [FLINK-7181] Activate checkstyle flink-java/operat...

2017-07-18 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4342#discussion_r127988555 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/operators/CoGroupRawOperator.java --- @@ -95,9 +96,8 @@ public CoGroupRawOperator(DataSet input1

[GitHub] flink issue #4255: [FLINK-7102] improve ClassLoaderITCase

2017-07-18 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4255 you're right - wasn't looking thoroughly enough (and only recently learned about `ExpectedException`). Additionally, I found out that this ignored exception was actually required to

[GitHub] flink pull request #4359: [FLINK-7140][blob] add an additional random compon...

2017-07-18 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4359#discussion_r128165494 --- Diff: flink-core/src/main/java/org/apache/flink/util/AbstractID.java --- @@ -46,7 +46,7 @@ /** The lower part of the actual ID */ protected

[GitHub] flink issue #4309: [FLINK-7166][avro] cleanup generated test classes in the ...

2017-07-18 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4309 That would make sense and I was going that way at first. It is spread over some of the project files though and there was something about eclipse having problems with it (although the last time, we

[GitHub] flink issue #4255: [FLINK-7102] improve ClassLoaderITCase

2017-07-19 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4255 ...that's how wrong the original implementation was - let me add this to the description of the PR --- If your project is set up for it, you can reply to this email and have your reply appe

[GitHub] flink pull request #4358: [FLINK-7068][blob] change BlobService sub-classes ...

2017-07-19 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4358#discussion_r128296027 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/PermanentBlobCache.java --- @@ -0,0 +1,391 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4378: [FLINK-7233][tests] fix instable TaskManagerHeapSi...

2017-07-20 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4378 [FLINK-7233][tests] fix instable TaskManagerHeapSizeCalculationJavaBashTest This fixes `getRandomConfig()` being prone to integer overflows and creating invalid configuration values. - [X

[GitHub] flink issue #4330: [FLINK-7176] [travis] Improve error handling

2017-07-20 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4330 +1 I wouldn't say, `return`is uncommon inside a bash function! `exit` in these methods would immediately exit the bash script while `return` does what is expected here which still a

[GitHub] flink pull request #3742: [FLINK-6046] Add support for oversized messages du...

2017-07-21 Thread NicoK
Github user NicoK closed the pull request at: https://github.com/apache/flink/pull/3742 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request #4381: [FLINK-7196][blob] add a TTL to all transient BLOB...

2017-07-21 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4381 [FLINK-7196][blob] add a TTL to all transient BLOBs ## What is the purpose of the change Transient BLOB files are currently only deleted manually and may thus linger around if not cleaned up

[GitHub] flink pull request #4346: [FLINK-7199] [gelly] Graph simplification does not...

2017-07-25 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4346#discussion_r129231293 --- Diff: flink-libraries/flink-gelly-examples/src/main/java/org/apache/flink/graph/drivers/parameter/Simplify.java --- @@ -109,21 +109,23 @@ public Ordering

[GitHub] flink pull request #4346: [FLINK-7199] [gelly] Graph simplification does not...

2017-07-25 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4346#discussion_r129231234 --- Diff: flink-libraries/flink-gelly-examples/src/main/java/org/apache/flink/graph/drivers/parameter/Simplify.java --- @@ -109,21 +109,23 @@ public Ordering

[GitHub] flink pull request #4346: [FLINK-7199] [gelly] Graph simplification does not...

2017-07-25 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4346#discussion_r129231269 --- Diff: flink-libraries/flink-gelly-examples/src/main/java/org/apache/flink/graph/drivers/parameter/Simplify.java --- @@ -109,21 +109,23 @@ public Ordering

[GitHub] flink pull request #4346: [FLINK-7199] [gelly] Graph simplification does not...

2017-07-25 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4346#discussion_r129231080 --- Diff: flink-libraries/flink-gelly/src/main/java/org/apache/flink/graph/library/linkanalysis/HITS.java --- @@ -168,7 +168,6 @@ protected void

[GitHub] flink pull request #4346: [FLINK-7199] [gelly] Graph simplification does not...

2017-07-25 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4346#discussion_r129231099 --- Diff: flink-libraries/flink-gelly/src/main/java/org/apache/flink/graph/library/linkanalysis/HITS.java --- @@ -192,7 +191,6 @@ protected void

[GitHub] flink pull request #4346: [FLINK-7199] [gelly] Graph simplification does not...

2017-07-25 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4346#discussion_r129230954 --- Diff: flink-libraries/flink-gelly-examples/src/main/java/org/apache/flink/graph/drivers/input/InputBase.java --- @@ -32,6 +35,9 @@ extends

[GitHub] flink issue #4390: [FLINK-7256] [travis] Only run end-to-end tests if no pre...

2017-07-25 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4390 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] flink issue #4385: wrong parameter check

2017-07-25 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4385 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] flink issue #4374: repalce map.put with putIfAbsent

2017-07-25 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4374 Although this totally makes sense and would be nice to change, we cannot merge it until Java 7 has been dropped (as you see from the TravisCI runs). --- If your project is set up for it, you can

[GitHub] flink pull request #4346: [FLINK-7199] [gelly] Graph simplification does not...

2017-07-25 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4346#discussion_r129295166 --- Diff: flink-libraries/flink-gelly-examples/src/main/java/org/apache/flink/graph/drivers/parameter/Simplify.java --- @@ -109,21 +109,23 @@ public Ordering

[GitHub] flink pull request #4346: [FLINK-7199] [gelly] Graph simplification does not...

2017-07-25 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4346#discussion_r129295984 --- Diff: flink-libraries/flink-gelly-examples/src/main/java/org/apache/flink/graph/drivers/input/InputBase.java --- @@ -32,6 +35,9 @@ extends

[GitHub] flink pull request #4346: [FLINK-7199] [gelly] Graph simplification does not...

2017-07-25 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4346#discussion_r129296867 --- Diff: flink-libraries/flink-gelly/src/main/java/org/apache/flink/graph/library/linkanalysis/HITS.java --- @@ -168,7 +168,6 @@ protected void

[GitHub] flink pull request #4401: [hotfix][tests] minor test improvements in TaskMan...

2017-07-26 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4401 [hotfix][tests] minor test improvements in TaskManagerConfigurationTest * use a proper JUnit temporary folder that ensures uniqueness * do not catch an exception just to fail with its message - if

[GitHub] flink pull request #4402: [FLINK-7261][blob] extend BlobStore#get/put with b...

2017-07-26 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4402 [FLINK-7261][blob] extend BlobStore#get/put with boolean return values ## What is the purpose of the change We'd like the `PermanentBlobCache` to be able to distinguish between HA and n

[GitHub] flink pull request #4403: [FLINK-7262][blob] remove the unused FallbackLibra...

2017-07-26 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4403 [FLINK-7262][blob] remove the unused FallbackLibraryCacheManager ## What is the purpose of the change Remove `FallbackLibraryCacheManager` which was basically only used in unit tests and is

[GitHub] flink pull request #4409: [FLINK-7283][python] fix PythonPlanBinderTest issu...

2017-07-27 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4409 [FLINK-7283][python] fix PythonPlanBinderTest issues with python paths ## What is the purpose of the change Fix Python 2/3 path issues in `PythonPlanBinderTest`. ## Brief change log

[GitHub] flink pull request #4412: [FLINK-6046][jobmanager] add support for oversized...

2017-07-27 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4412 [FLINK-6046][jobmanager] add support for oversized messages during deployment ## What is the purpose of the change This pull request makes big parts of the task deployment descriptor (TDD

[GitHub] flink pull request #4414: [FLINK-7287][tests] fix test instabilities in Kafk...

2017-07-27 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4414 [FLINK-7287][tests] fix test instabilities in KafkaConsumerTestBase ## What is the purpose of the change fix test instabilities in KafkaConsumerTestBase ## Brief change log

[GitHub] flink issue #4414: [FLINK-7287][tests] fix test instabilities in KafkaConsum...

2017-07-28 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4414 Yes, both your observations are correct. The pattern in most tests inside `KafkaConsumerTestBase` is to 1) start a job, 2) do some processing, e.g. until some offset or another finish

[GitHub] flink pull request #4416: [FLINK-7279][minicluster] fix a deadlock between T...

2017-07-28 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4416 [FLINK-7279][minicluster] fix a deadlock between TM and cluster shutdown ## What is the purpose of the change The `MiniCluster` can deadlock if the fatal error handler is called while the

[GitHub] flink pull request #4417: [hotfix][tests] fix Invokable subclasses being pri...

2017-07-28 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4417 [hotfix][tests] fix Invokable subclasses being private ## What is the purpose of the change Recently, some `Invokable` subclasses became `private` and thus failed to be executed at the task

<    2   3   4   5   6   7   8   9   10   11   >