[jira] [Created] (FLINK-1597) VertexCentricIterations create inefficient execution plans

2015-02-22 Thread Martin Kiefer (JIRA)
Martin Kiefer created FLINK-1597: Summary: VertexCentricIterations create inefficient execution plans Key: FLINK-1597 URL: https://issues.apache.org/jira/browse/FLINK-1597 Project: Flink Issu

Re: [DISCUSS] Gelly iteration abstractions

2015-02-22 Thread Vasiliki Kalavri
Hi, yes, I was referring to the parallel Boruvka algorithm. There are several ways to implement this one in Flink and I believe that the one described in the paper (vertex-centric) is not the most elegant one :) Andra is now working on an idea that uses the delta iteration abstraction and we beli

Re: Could not build up connection to JobManager - Error

2015-02-22 Thread Dulaj Viduranga
It seams the problem is with running WordCount.jar. I could run KMeans.jar without any problems. May be I’ve passed the arguments incorrect. bin/flink run ./examples/flink-java-examples-0.9-SNAPSHOT-WordCount.jar file://'pwd'/hemlet.txt file://'pwd'/wordcount-result.txt > On Feb 22, 2015, at 9

Re: Could not build up connection to JobManager - Error

2015-02-22 Thread Dulaj Viduranga
I can’t see any problems there. Can you? Do I need hadoop libraries? 20:59:30,832 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager 20:59:31,255 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started 20:59:31,306 INFO R

Re: [DISCUSS] Should we improve the structure of our Gelly test suite?

2015-02-22 Thread Vasiliki Kalavri
Hi Andra, not every test has to be a MultipleProgramsTestBase. We're just using this for our convenience, it's not a rule :-) If the case you want to test doesn't fit the format of this test, you can just make a separate standalone test. I found some examples for testing exceptions in Flink operat

Re: Could not build up connection to JobManager - Error

2015-02-22 Thread Robert Metzger
Hi, can you have a look at the jobmanager log file in the "log/" directory? I suspect there was an issue when you've started the JobManager. On Sun, Feb 22, 2015 at 4:35 PM, Dulaj Viduranga wrote: > I tried to run an example program to the first time in FLINK and I got > this error. I have alre

Could not build up connection to JobManager - Error

2015-02-22 Thread Dulaj Viduranga
I tried to run an example program to the first time in FLINK and I got this error. I have already started FLINK with bin/start-local.sh. Can someone please help? 21:01:19,898 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your plat

Re: [DISCUSS] Gelly iteration abstractions

2015-02-22 Thread Andra Lungu
Hi Alex, Vasia is talking about the second version(presented Friday) of Parallel Boruvka, which can be found here: https://github.com/TU-Berlin-DIMA/IMPRO-3.WS14/pull/59 I will propose the third, non-Pregel like approach directly to Gelly soon. If you have additional questions, I will be happy t

Re: [DISCUSS] Gelly iteration abstractions

2015-02-22 Thread Alexander Alexandrov
Hi Vasia, I am trying to look at the problem in more detail. Which version of the MST are you talking about? Right now in the Gelly repository I can only find the SSSP example (parallel Bellman-Ford) from Section 4.2 in [1]. However, it seems that the issues encountered by Andra are related to t

Re: Deprecated error building flink

2015-02-22 Thread Dulaj Viduranga
hmm……… I didn’t see that… Thanks for the help! :) > On Feb 22, 2015, at 6:53 PM, Chiwan Park wrote: > > You can change java version by setting JAVA_HOME var in .mavenrc file. > http://stackoverflow.com/questions/18813828/why-maven-use-jdk-1-6-but-my-java-version-is-1-7 > >

Re: Deprecated error building flink

2015-02-22 Thread Chiwan Park
You can change java version by setting JAVA_HOME var in .mavenrc file. http://stackoverflow.com/questions/18813828/why-maven-use-jdk-1-6-but-my-java-version-is-1-7 Regards. Chiwan Park (Sent with iPhon

Re: Deprecated error building flink

2015-02-22 Thread Robert Metzger
Seems like you have to set the JAVA_HOME variable properly ( http://stackoverflow.com/questions/18813828/why-maven-use-jdk-1-6-but-my-java-version-is-1-7 ) On Sun, Feb 22, 2015 at 2:11 PM, Dulaj Viduranga wrote: > Oh yes. :) It runs on 1.6. How could I fix that? > > > On Feb 22, 2015, at 6:37 PM

Re: Deprecated error building flink

2015-02-22 Thread Dulaj Viduranga
I haven’t set JAVA_HOME env. Java path is set in PATH env. Is this the problem? > On Feb 22, 2015, at 6:35 PM, Dulaj Viduranga wrote: > > Hi, > But I’m using Oracle java 8 (javac 1.8.0_05). > >> On Feb 22, 2015, at 6:32 PM, Robert Metzger wrote: >> >> Hi Dulaj, >> >> you are using an

Re: Deprecated error building flink

2015-02-22 Thread Dulaj Viduranga
Oh yes. :) It runs on 1.6. How could I fix that? > On Feb 22, 2015, at 6:37 PM, Robert Metzger wrote: > > Can you run "mvn -version" to verify that? > Maybe maven is using a different java version? > > On Sun, Feb 22, 2015 at 2:05 PM, Dulaj Viduranga > wrote: > >> Hi, >>But I’m using

Re: Deprecated error building flink

2015-02-22 Thread Robert Metzger
Can you run "mvn -version" to verify that? Maybe maven is using a different java version? On Sun, Feb 22, 2015 at 2:05 PM, Dulaj Viduranga wrote: > Hi, > But I’m using Oracle java 8 (javac 1.8.0_05). > > > On Feb 22, 2015, at 6:32 PM, Robert Metzger wrote: > > > > Hi Dulaj, > > > > you

Re: Deprecated error building flink

2015-02-22 Thread Dulaj Viduranga
Hi, But I’m using Oracle java 8 (javac 1.8.0_05). > On Feb 22, 2015, at 6:32 PM, Robert Metzger wrote: > > Hi Dulaj, > > you are using an unsupported compiler to compile Flink. You can compile > Flink only with OpenJDK 6 and all JDKs above 6. The Oracle JDK 6's compiler > contains a bu

Re: Deprecated error building flink

2015-02-22 Thread Robert Metzger
Hi Dulaj, you are using an unsupported compiler to compile Flink. You can compile Flink only with OpenJDK 6 and all JDKs above 6. The Oracle JDK 6's compiler contains a bug. You can run Flink with all JREs 6+ (including Oracle JDK 6). I would recommend you to upgrade your Java version to 7 anywa

Deprecated error building flink

2015-02-22 Thread Dulaj Viduranga
Hi all, I’m new here. I had some problems building flink on my mac. Could someone please take a look and help me out..? Dulaj Viduranga. [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.flink:flink-streaming-ex

Re: Flink GZip support

2015-02-22 Thread Robert Metzger
Hi Karim, also have a look at this old discussion from the user@ list: http://apache-flink-incubator-user-mailing-list-archive.2336050.n4.nabble.com/read-gz-files-td760.html On Sun, Feb 22, 2015 at 10:33 AM, Felix Neutatz wrote: > Hi Karim, > > you can use a Hadoop Input Format and read the f

Re: Flink GZip support

2015-02-22 Thread Felix Neutatz
Hi Karim, you can use a Hadoop Input Format and read the files using flink-hadoop-compatibility classes like here: http://flink.apache.org/docs/0.7-incubating/hadoop_compatibility.html Have a nice Sunday, Felix 2015-02-22 10:02 GMT+01:00 Karim Alaa : > Hi All, > > I’m currently working with Fl

Flink GZip support

2015-02-22 Thread Karim Alaa
Hi All, I’m currently working with Flink 0.8.0 and I would like to know if there is or will be any support for handling Gzipped files Thanks!