Re: Error due to Hadoop version mismatch

2016-01-04 Thread Kashmar, Ali
Looking at the lib folder revealed the problem. The lib folder on one of the nodes had libraries for both hadoop 1 and 2. I’m not sure how I ended up with that but it must have happened while I was copying the dependency jars to each node. I removed all the jars and started with a fresh copy and re

Re: Error due to Hadoop version mismatch

2016-01-04 Thread Robert Metzger
Okay, then, my previous statement is false. From the stack trace, it seems that Flink is using an older Hadoop version. The DFSClient and RPC classes look different in Hadoop 2.6.0. Max checked already for some environment variables. Is $CLASSPATH set? Did you install Hadoop only by downloading the

Re: Error due to Hadoop version mismatch

2016-01-04 Thread Kashmar, Ali
Hi Robert, On the ubuntu host, the port 9000 is up: ubuntu@ubuntu-171:~$ netstat -tulpn tcp0 0 10.13.182.171:9000 0.0.0.0:* LISTEN 8849/java And the process using this port is: ubuntu@ubuntu-171:~$ ps -ef | grep 8849 ubuntu8849 1 0 2015 ?

[jira] [Created] (FLINK-3199) KafkaITCase.testOneToOneSources

2016-01-04 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created FLINK-3199: -- Summary: KafkaITCase.testOneToOneSources Key: FLINK-3199 URL: https://issues.apache.org/jira/browse/FLINK-3199 Project: Flink Issue Type: Bug C

Re: Error due to Hadoop version mismatch

2016-01-04 Thread Robert Metzger
Your Flink installation has Hadoop 2.6.0 included, on the other machine, there is a Hadoop version installed, which is most likely a 1.x or even a 0.x version. Are you sure that the host "ubuntu-171" has the ip 10.13.182.171 and that the hadoop installation in the "/home/ubuntu/Documents/hadoop-2.6

Re: [gelly] Spargel model rework

2016-01-04 Thread Vasiliki Kalavri
Hello squirrels and happy new year! I'm reviving this thread to share some results and discuss next steps. Using the Either type I was able to get rid of redundant messages and vertex state. During the past few weeks, I have been running experiments, which show that the performance of this "Prege

Re: Checkpointing to S3

2016-01-04 Thread Stephan Ewen
Hey! Nice to hear that it works. A bit of info is now visible in the web dashboard now, as of that PR: https://github.com/apache/flink/pull/1453 Is that what you had in mind? Greetings, Stephan On Sat, Jan 2, 2016 at 4:53 PM, Gyula Fóra wrote: > Ok, I could figure out the problem, it was my

Re: Error due to Hadoop version mismatch

2016-01-04 Thread Kashmar, Ali
Hi Max, Both commands return nothing. Those variables aren’t set. The only software I installed on these machines is Flink and Java. -Ali On 2015-12-28, 6:42 AM, "Maximilian Michels" wrote: >Hi Ali, > >The warning about the native Hadoop libraries is nothing to worry >about. The native module

Re: 2015: A Year in Review for Apache Flink

2016-01-04 Thread Till Rohrmann
Happy New Year :-) Hope everyone had a great start into the new year. On Thu, Dec 31, 2015 at 12:57 PM, Slim Baltagi wrote: > Happy New Year to you and your families! > Let’s make 2016 the year of Flink: General Availability, faster growth, > wider industry adoption, … > Slim Baltagi > Chicago,