[jira] [Commented] (FLINK-1421) Implement a SAMOA Adapter for Flink Streaming

2015-02-17 Thread Fay Beligianni (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325088#comment-14325088 ] Fay Beligianni commented on FLINK-1421: --- Hello, I am trying to run a SAMOA task on

[jira] [Commented] (FLINK-947) Add support for "Named Datasets"

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325060#comment-14325060 ] ASF GitHub Bot commented on FLINK-947: -- Github user rmetzger commented on the pull req

[GitHub] flink pull request: [FLINK-947] Add a declarative expression API

2015-02-17 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/405#issuecomment-74773124 Very very nice work! I've played around a bit with it and the first impression is very good. +1 to merge the pull request. The change is very big, but stable enou

[jira] [Commented] (FLINK-947) Add support for "Named Datasets"

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325036#comment-14325036 ] ASF GitHub Bot commented on FLINK-947: -- Github user rmetzger commented on a diff in th

[GitHub] flink pull request: [FLINK-947] Add a declarative expression API

2015-02-17 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/405#discussion_r24862039 --- Diff: flink-staging/flink-linq/src/main/scala/org/apache/flink/api/scala/expressions/package.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the

[jira] [Resolved] (FLINK-1574) Flink fails due to non-initialized RuntimeContext in CombiningUnilateralSortMerger

2015-02-17 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske resolved FLINK-1574. -- Resolution: Fixed Fixed with 30e3893bdb80ba148abdcb981fc92d176d05e15a > Flink fails due to non-

[jira] [Commented] (FLINK-1388) POJO support for writeAsCsv

2015-02-17 Thread Adnan Khan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325020#comment-14325020 ] Adnan Khan commented on FLINK-1388: --- Hey thanks. * What exactly do you mean by integra

[jira] [Comment Edited] (FLINK-1388) POJO support for writeAsCsv

2015-02-17 Thread Adnan Khan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324987#comment-14324987 ] Adnan Khan edited comment on FLINK-1388 at 2/17/15 10:11 PM: -

[jira] [Commented] (FLINK-1388) POJO support for writeAsCsv

2015-02-17 Thread Adnan Khan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324987#comment-14324987 ] Adnan Khan commented on FLINK-1388: --- Oh that makes sense, I'll look at that. I don't see

[jira] [Issue Comment Deleted] (FLINK-1388) POJO support for writeAsCsv

2015-02-17 Thread Adnan Khan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adnan Khan updated FLINK-1388: -- Comment: was deleted (was: Oh that makes sense, I'll look at that. I don't see any tests for {{org.apac

[jira] [Commented] (FLINK-1388) POJO support for writeAsCsv

2015-02-17 Thread Adnan Khan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324989#comment-14324989 ] Adnan Khan commented on FLINK-1388: --- Oh that makes sense, I'll look at that. I don't see

[GitHub] flink pull request: [FLINK-947] Add a declarative expression API

2015-02-17 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/405#discussion_r24858527 --- Diff: docs/linq.md --- @@ -0,0 +1,65 @@ +--- +title: "Language-Integrated Queries" +--- + + +* This will be replaced by the TOC

[jira] [Commented] (FLINK-947) Add support for "Named Datasets"

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324968#comment-14324968 ] ASF GitHub Bot commented on FLINK-947: -- Github user rmetzger commented on a diff in th

[jira] [Commented] (FLINK-947) Add support for "Named Datasets"

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324948#comment-14324948 ] ASF GitHub Bot commented on FLINK-947: -- Github user rmetzger commented on a diff in th

[GitHub] flink pull request: [FLINK-947] Add a declarative expression API

2015-02-17 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/405#discussion_r24857326 --- Diff: flink-staging/flink-linq/pom.xml --- @@ -0,0 +1,227 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSch

[GitHub] flink pull request: [FLINK-1417] Automatically register types with...

2015-02-17 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/393#issuecomment-74754391 No, its basically CoGrouping two "big" files (~50 and ~75 GB) https://github.com/project-flink/flink-perf/blob/master/flink-jobs/src/main/java/com/github/projectflink

[jira] [Commented] (FLINK-1417) Automatically register nested types at Kryo

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324893#comment-14324893 ] ASF GitHub Bot commented on FLINK-1417: --- Github user rmetzger commented on the pull

[jira] [Commented] (FLINK-1417) Automatically register nested types at Kryo

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324810#comment-14324810 ] ASF GitHub Bot commented on FLINK-1417: --- Github user aljoscha commented on the pull

[GitHub] flink pull request: [FLINK-1417] Automatically register types with...

2015-02-17 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/393#issuecomment-74744132 What exactly are you running? TPC-H Query 3? Maybe we should test how fast Kryo would be with the PojoComparator. --- If your project is set up for it, you can reply to

[jira] [Updated] (FLINK-1576) Change the Gelly examples to be consistent with the other Flink examples

2015-02-17 Thread Andra Lungu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andra Lungu updated FLINK-1576: --- Summary: Change the Gelly examples to be consistent with the other Flink examples (was: Change the ex

[jira] [Created] (FLINK-1576) Change the examples to be consistent with the other Flink examples

2015-02-17 Thread Andra Lungu (JIRA)
Andra Lungu created FLINK-1576: -- Summary: Change the examples to be consistent with the other Flink examples Key: FLINK-1576 URL: https://issues.apache.org/jira/browse/FLINK-1576 Project: Flink

[jira] [Commented] (FLINK-1522) Add tests for the library methods and examples

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324596#comment-14324596 ] ASF GitHub Bot commented on FLINK-1522: --- Github user andralungu commented on the pul

[GitHub] flink pull request: [FLINK-1522][gelly] Added test for SSSP Exampl...

2015-02-17 Thread andralungu
Github user andralungu commented on the pull request: https://github.com/apache/flink/pull/414#issuecomment-74719038 @rmetzger , thanks for the heads up! Now, instead of returining null, I have a default vertex data set and a default edge data set. Tell me what you think :). ---

[jira] [Created] (FLINK-1575) JobManagerConnectionTest.testResolveUnreachableActorRemoteHost times out on travis

2015-02-17 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1575: - Summary: JobManagerConnectionTest.testResolveUnreachableActorRemoteHost times out on travis Key: FLINK-1575 URL: https://issues.apache.org/jira/browse/FLINK-1575 P

[jira] [Created] (FLINK-1574) Flink fails due to non-initialized RuntimeContext in CombiningUnilateralSortMerger

2015-02-17 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-1574: Summary: Flink fails due to non-initialized RuntimeContext in CombiningUnilateralSortMerger Key: FLINK-1574 URL: https://issues.apache.org/jira/browse/FLINK-1574 Proj

[jira] [Commented] (FLINK-1417) Automatically register nested types at Kryo

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324527#comment-14324527 ] ASF GitHub Bot commented on FLINK-1417: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-1417] Automatically register types with...

2015-02-17 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/393#issuecomment-74712141 The pull request now also contains changes to fix two classloading issues with the newly added `ExecutionConfig`. Also, it fixes the Web interface for YARN. I

[GitHub] flink pull request: [FLINK-1466] Add HCatInputFormats to read from...

2015-02-17 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/411#issuecomment-74710618 I wonder how much work it would be to add support for the last three missing types. With Kryo we should be able to serialize all of them easily. --- If your project

[jira] [Commented] (FLINK-1466) Add InputFormat to read HCatalog tables

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324509#comment-14324509 ] ASF GitHub Bot commented on FLINK-1466: --- Github user rmetzger commented on the pull

[jira] [Commented] (FLINK-1466) Add InputFormat to read HCatalog tables

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324499#comment-14324499 ] ASF GitHub Bot commented on FLINK-1466: --- Github user rmetzger commented on a diff in

[GitHub] flink pull request: [FLINK-1466] Add HCatInputFormats to read from...

2015-02-17 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/411#discussion_r24833839 --- Diff: flink-staging/flink-hcatalog/src/main/java/org/apache/flink/hcatalog/HCatInputFormatBase.java --- @@ -0,0 +1,413 @@ +/* + * Licensed to the

[jira] [Created] (FLINK-1573) Add per-job metrics to flink.

2015-02-17 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1573: - Summary: Add per-job metrics to flink. Key: FLINK-1573 URL: https://issues.apache.org/jira/browse/FLINK-1573 Project: Flink Issue Type: Sub-task Affect

[GitHub] flink pull request: [FLINK-1522][gelly] Added test for SSSP Exampl...

2015-02-17 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/414#discussion_r24829996 --- Diff: flink-staging/flink-gelly/src/main/java/org/apache/flink/graph/example/SingleSourceShortestPathsExample.java --- @@ -56,4 +63,77 @@ public static v

[jira] [Commented] (FLINK-1561) Improve build server robustness by not reusing JVMs in integration tests

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324424#comment-14324424 ] ASF GitHub Bot commented on FLINK-1561: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-1561] [build system] Use a fresh fork f...

2015-02-17 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/412#issuecomment-74700668 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[jira] [Commented] (FLINK-1522) Add tests for the library methods and examples

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324429#comment-14324429 ] ASF GitHub Bot commented on FLINK-1522: --- Github user rmetzger commented on a diff in

[jira] [Created] (FLINK-1572) Output directories are created before input paths are checked

2015-02-17 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1572: - Summary: Output directories are created before input paths are checked Key: FLINK-1572 URL: https://issues.apache.org/jira/browse/FLINK-1572 Project: Flink

[jira] [Comment Edited] (FLINK-1556) JobClient does not wait until a job failed completely if submission exception

2015-02-17 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324364#comment-14324364 ] Robert Metzger edited comment on FLINK-1556 at 2/17/15 4:15 PM:

[jira] [Commented] (FLINK-1556) JobClient does not wait until a job failed completely if submission exception

2015-02-17 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324364#comment-14324364 ] Robert Metzger commented on FLINK-1556: --- Also, it seems that these "failearily" jobs

[jira] [Reopened] (FLINK-1556) JobClient does not wait until a job failed completely if submission exception

2015-02-17 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reopened FLINK-1556: --- Assignee: Till Rohrmann The issue hasn't been implemented/tested properly. I'm reopening it

[jira] [Commented] (FLINK-1556) JobClient does not wait until a job failed completely if submission exception

2015-02-17 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324359#comment-14324359 ] Robert Metzger commented on FLINK-1556: --- I think showing the whole stacktrace of the

[jira] [Commented] (FLINK-1566) WindowIntegrationTest fails

2015-02-17 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324356#comment-14324356 ] Gyula Fora commented on FLINK-1566: --- it is a concurrency issue while adding to an ArrayL

[jira] [Assigned] (FLINK-1522) Add tests for the library methods and examples

2015-02-17 Thread Daniel Bali (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Bali reassigned FLINK-1522: -- Assignee: Daniel Bali (was: Andra Lungu) > Add tests for the library methods and examples > --

[jira] [Commented] (FLINK-1515) [Gelly] Enable access to aggregators and broadcast sets in vertex-centric iteration

2015-02-17 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324250#comment-14324250 ] Vasia Kalavri commented on FLINK-1515: -- Sounds good to me, thanks :) > [Gelly] Enabl

[jira] [Commented] (FLINK-1522) Add tests for the library methods and examples

2015-02-17 Thread Daniel Bali (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324239#comment-14324239 ] Daniel Bali commented on FLINK-1522: Hi Andra! Vasia said you have other issues to wo

[jira] [Issue Comment Deleted] (FLINK-1522) Add tests for the library methods and examples

2015-02-17 Thread Daniel Bali (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Bali updated FLINK-1522: --- Comment: was deleted (was: Hi Andra! Vasia said you have other issues to work on, so I'd happily cont

[jira] [Commented] (FLINK-1522) Add tests for the library methods and examples

2015-02-17 Thread Daniel Bali (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324238#comment-14324238 ] Daniel Bali commented on FLINK-1522: Hi Andra! Vasia said you have other issues to wo

[jira] [Commented] (FLINK-1522) Add tests for the library methods and examples

2015-02-17 Thread Daniel Bali (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324237#comment-14324237 ] Daniel Bali commented on FLINK-1522: Hi Andra! Vasia said you have other issues to wo

[jira] [Issue Comment Deleted] (FLINK-1522) Add tests for the library methods and examples

2015-02-17 Thread Daniel Bali (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Bali updated FLINK-1522: --- Comment: was deleted (was: Hi Andra! Vasia said you have other issues to work on, so I'd happily cont

[jira] [Commented] (FLINK-1552) Allow secondary sorts in Vertex Centric Iteration

2015-02-17 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324184#comment-14324184 ] Vasia Kalavri commented on FLINK-1552: -- No problem, let's see if someone picks it up

[jira] [Commented] (FLINK-1522) Add tests for the library methods and examples

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324166#comment-14324166 ] ASF GitHub Bot commented on FLINK-1522: --- GitHub user andralungu opened a pull reques

[GitHub] flink pull request: [FLINK-1522][gelly] Added test for SSSP Exampl...

2015-02-17 Thread andralungu
GitHub user andralungu opened a pull request: https://github.com/apache/flink/pull/414 [FLINK-1522][gelly] Added test for SSSP Example You can merge this pull request into a Git repository by running: $ git pull https://github.com/andralungu/flink test_sssp Alternatively you

[jira] [Commented] (FLINK-1567) Add option to switch between Avro and Kryo serialization for GenericTypes

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324164#comment-14324164 ] ASF GitHub Bot commented on FLINK-1567: --- GitHub user rmetzger opened a pull request:

[GitHub] flink pull request: [FLINK-1567] Add switch to use the AvroSeriali...

2015-02-17 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/413 [FLINK-1567] Add switch to use the AvroSerializer for GenericTypeInfo Note this is a fix for 0.8 only. The fix for master is contained in #393 You can merge this pull request into a Git reposito

[jira] [Commented] (FLINK-1417) Automatically register nested types at Kryo

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324162#comment-14324162 ] ASF GitHub Bot commented on FLINK-1417: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-1417] Automatically register types with...

2015-02-17 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/393#issuecomment-74665100 Thank you for reviewing the pull request. I've addressed your remark, added a fix for another issue (FLINK-1567) and now I'll run the performance tests. --- If

[jira] [Closed] (FLINK-1351) Inconclusive error when TaskManager cannot connect to JobManager

2015-02-17 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-1351. Resolution: Cannot Reproduce Once we can reproduce this error, we'll open the issue again. > Inconc

[jira] [Created] (FLINK-1571) Add failure-case tests for blocking data exchange

2015-02-17 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-1571: -- Summary: Add failure-case tests for blocking data exchange Key: FLINK-1571 URL: https://issues.apache.org/jira/browse/FLINK-1571 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-1570) Add failure-case tests for pipelined data exchange

2015-02-17 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-1570: -- Summary: Add failure-case tests for pipelined data exchange Key: FLINK-1570 URL: https://issues.apache.org/jira/browse/FLINK-1570 Project: Flink Issue Type: Sub-

[jira] [Created] (FLINK-1569) Object reuse mode is not working with KeySelector functions.

2015-02-17 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1569: - Summary: Object reuse mode is not working with KeySelector functions. Key: FLINK-1569 URL: https://issues.apache.org/jira/browse/FLINK-1569 Project: Flink

[jira] [Commented] (FLINK-1552) Allow secondary sorts in Vertex Centric Iteration

2015-02-17 Thread Martin Kiefer (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324142#comment-14324142 ] Martin Kiefer commented on FLINK-1552: -- The feature would have been great for the alg

[jira] [Assigned] (FLINK-952) TypeExtractor requires the argument types of the UDF to be identical to the parameter types

2015-02-17 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann reassigned FLINK-952: --- Assignee: (was: Till Rohrmann) > TypeExtractor requires the argument types of the UDF to b

[GitHub] flink pull request: Add auto-parallelism to Jobs (0.8 branch)

2015-02-17 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/410#issuecomment-74661555 But currently the system does not support multi-user/multi-job scenarios so well either. If I'm not mistaken, then the scheduler schedules the tasks eagerly whi

[jira] [Commented] (FLINK-1566) WindowIntegrationTest fails

2015-02-17 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324135#comment-14324135 ] Márton Balassi commented on FLINK-1566: --- Most of the time the test passes, sometimes

[GitHub] flink pull request: [FLINK-1561] [build system] Use a fresh fork f...

2015-02-17 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/412#issuecomment-74660789 Looks good to me. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[jira] [Commented] (FLINK-1561) Improve build server robustness by not reusing JVMs in integration tests

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324134#comment-14324134 ] ASF GitHub Bot commented on FLINK-1561: --- Github user uce commented on the pull reque

[jira] [Created] (FLINK-1568) Add failure-case tests for data exchange

2015-02-17 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-1568: -- Summary: Add failure-case tests for data exchange Key: FLINK-1568 URL: https://issues.apache.org/jira/browse/FLINK-1568 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-1515) [Gelly] Enable access to aggregators and broadcast sets in vertex-centric iteration

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324128#comment-14324128 ] ASF GitHub Bot commented on FLINK-1515: --- Github user martinkiefer commented on the p

[GitHub] flink pull request: [FLINK-1515]Splitted runVertexCentricIteration...

2015-02-17 Thread martinkiefer
Github user martinkiefer commented on the pull request: https://github.com/apache/flink/pull/402#issuecomment-74660459 I could change `PageRank` to read the number of vertices by broadcasting the result of `numberofVertices()` instead of providing it in the constructor of the algorith

[jira] [Closed] (FLINK-1554) LocalFlinkMiniCluster cannot start multiple local TaskManagers

2015-02-17 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-1554. Resolution: Fixed Fixed via 649f158391aebcefcaabcdaa02d5c8b95be45777 > LocalFlinkMiniCluster cannot

[jira] [Closed] (FLINK-1563) NullPointer during state update call

2015-02-17 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-1563. Resolution: Fixed Fixed via ac7bf427900e60abef3ff4344a5873349e6d108e. > NullPointer during state up

[jira] [Closed] (FLINK-1549) Add proper exception handling for YarnJobManager

2015-02-17 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-1549. Resolution: Fixed Fixed via 447ce0aa60358212a9716f6b4319f7e9566d6eaa > Add proper exception handlin

[jira] [Closed] (FLINK-1556) JobClient does not wait until a job failed completely if submission exception

2015-02-17 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-1556. Resolution: Fixed Fixed via ac7bf427900e60abef3ff4344a5873349e6d108e > JobClient does not wait unti

[jira] [Commented] (FLINK-1556) JobClient does not wait until a job failed completely if submission exception

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324122#comment-14324122 ] ASF GitHub Bot commented on FLINK-1556: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-1549) Add proper exception handling for YarnJobManager

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324120#comment-14324120 ] ASF GitHub Bot commented on FLINK-1549: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-1554) LocalFlinkMiniCluster cannot start multiple local TaskManagers

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324121#comment-14324121 ] ASF GitHub Bot commented on FLINK-1554: --- Github user asfgit closed the pull request

[GitHub] flink pull request: [FLINK-1554] Allows the LocalFlinkMiniCluster ...

2015-02-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/403 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] flink pull request: [FLINK-1549] Adds proper exception handling to...

2015-02-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/397 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] flink pull request: [FLINK-1556] Corrects faulty JobClient behavio...

2015-02-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/406 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Created] (FLINK-1567) Add option to switch between Avro and Kryo serialization for GenericTypes

2015-02-17 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1567: - Summary: Add option to switch between Avro and Kryo serialization for GenericTypes Key: FLINK-1567 URL: https://issues.apache.org/jira/browse/FLINK-1567 Project: Fl

[GitHub] flink pull request: Add auto-parallelism to Jobs (0.8 branch)

2015-02-17 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/410#issuecomment-74651790 +1 I think setup via `ExecutionConfig` is the way to go. I agree with @rmetzger that we should merge it to master as well. The important thing is to document

[jira] [Created] (FLINK-1566) WindowIntegrationTest fails

2015-02-17 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1566: Summary: WindowIntegrationTest fails Key: FLINK-1566 URL: https://issues.apache.org/jira/browse/FLINK-1566 Project: Flink Issue Type: Bug Component

[jira] [Commented] (FLINK-1563) NullPointer during state update call

2015-02-17 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324057#comment-14324057 ] Till Rohrmann commented on FLINK-1563: -- Will be fixed as part of FLINK-1556. > NullP

[GitHub] flink pull request: [FLINK-1521] Chained operators respect reuse

2015-02-17 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/392#issuecomment-74650731 +1 I opened FLINK-1565 for documenting object reuse behavior. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Created] (FLINK-1565) Document object reuse behavior

2015-02-17 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-1565: Summary: Document object reuse behavior Key: FLINK-1565 URL: https://issues.apache.org/jira/browse/FLINK-1565 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-1521) Some Chained Drivers do not respect object-reuse/non-reuse flag

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324052#comment-14324052 ] ASF GitHub Bot commented on FLINK-1521: --- Github user fhueske commented on the pull r

[jira] [Commented] (FLINK-1564) Make sure BLOB client downloads files only once

2015-02-17 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324045#comment-14324045 ] Stephan Ewen commented on FLINK-1564: - This is currently not happening, since the Libr

[jira] [Updated] (FLINK-1564) Make sure BLOB client downloads files only once

2015-02-17 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-1564: Priority: Minor (was: Major) > Make sure BLOB client downloads files only once > --

[jira] [Created] (FLINK-1564) Make sure BLOB client downloads files only once

2015-02-17 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1564: --- Summary: Make sure BLOB client downloads files only once Key: FLINK-1564 URL: https://issues.apache.org/jira/browse/FLINK-1564 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-1563) NullPointer during state update call

2015-02-17 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1563: --- Summary: NullPointer during state update call Key: FLINK-1563 URL: https://issues.apache.org/jira/browse/FLINK-1563 Project: Flink Issue Type: Bug Co

[GitHub] flink pull request: [FLINK-1561] [build system] Use a fresh fork f...

2015-02-17 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/412 [FLINK-1561] [build system] Use a fresh fork for each integration test run Helps the build stability on Travis for integration tests. You can merge this pull request into a Git repository by runn

[jira] [Commented] (FLINK-1561) Improve build server robustness by not reusing JVMs in integration tests

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324027#comment-14324027 ] ASF GitHub Bot commented on FLINK-1561: --- GitHub user StephanEwen opened a pull reque

[jira] [Created] (FLINK-1562) Introduce retries for fetching data from the BLOB manager

2015-02-17 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1562: --- Summary: Introduce retries for fetching data from the BLOB manager Key: FLINK-1562 URL: https://issues.apache.org/jira/browse/FLINK-1562 Project: Flink Issue T

[jira] [Created] (FLINK-1561) Improve build server robustness by not reusing JVMs in integration tests

2015-02-17 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1561: --- Summary: Improve build server robustness by not reusing JVMs in integration tests Key: FLINK-1561 URL: https://issues.apache.org/jira/browse/FLINK-1561 Project: Flink

[GitHub] flink pull request: Add auto-parallelism to Jobs (0.8 branch)

2015-02-17 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/410#issuecomment-74643785 I agree with Fabian that it is not a good default behavior to grab everything that is possible. It should be an explicit request by the user. For YARN single job se

[GitHub] flink pull request: Add auto-parallelism to Jobs (0.8 branch)

2015-02-17 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/410#issuecomment-74643360 Using max parallelism basically prohibits to run more than one program at a time. I don't think that would be a good default mode. --- If your project is set up for it,

[GitHub] flink pull request: Add auto-parallelism to Jobs (0.8 branch)

2015-02-17 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/410#discussion_r24804242 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/jobmanager/JobManager.java --- @@ -374,6 +375,8 @@ public JobSubmissionResult submitJob(JobGraph jo

[GitHub] flink pull request: Add auto-parallelism to Jobs (0.8 branch)

2015-02-17 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/410#issuecomment-74642763 Right now, the user has to set the parallelism to `ExecutionConfig.PARALLELISM_AUTO_MAX`. Why not use all available task slots by default? I understand, that we shouldn't simp

[jira] [Resolved] (FLINK-1557) Move WebFrontend out of JobManager Actor

2015-02-17 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-1557. - Resolution: Fixed Fixed via c1e326707a6c5b3cc550945f010eb4cabea24ad3 > Move WebFrontend out of Jo

[jira] [Commented] (FLINK-1557) Move WebFrontend out of JobManager Actor

2015-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324000#comment-14324000 ] ASF GitHub Bot commented on FLINK-1557: --- Github user asfgit closed the pull request

  1   2   >