Re: yarnship option

2017-05-23 Thread Mikhail Pryakhin
gt;>> Hi, >>> >>> this issue is unexpected :) Can you double check if the >>> job-libs/flink-connector-kafka-0.9_2.11-1.2.1.jar contains >>> org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer09 ? >>> Also, were there any previo

Re: yarnship option

2017-05-23 Thread Robert Metzger
e classical > classNotFoundException, but a bit differenT: https:// > stackoverflow.com/a/5756989/568695 > > On Mon, May 22, 2017 at 5:12 PM, Mikhail Pryakhin > wrote: > >> Hi all! >> >> I'm playing with flink streaming job on yarn cluster. The job con

Re: yarnship option

2017-05-23 Thread Mikhail Pryakhin
re any previous Kafka09 related exceptions in the log?? >> >> From this SO answer, it seems that this is not really the classical >> classNotFoundException, but a bit differenT: >> https://stackoverflow.com/a/5756989/568695 >> <https://stackoverflow.com/a/5756989

Re: yarnship option

2017-05-22 Thread Mikhail Pryakhin
ing job on yarn cluster. The job consumes events from kafka and prints them to the standard out. The job uses flink-connector-kafka-0.9_2.11-1.2.1.jar library that is passed via the --yarnship option. Here is the way I run the job: export HADOOP_USER_NAME=hdfs; \ export HADOOP_CONF_DIR=/etc/had

Re: yarnship option

2017-05-22 Thread Robert Metzger
a and prints them to the standard out. > The job uses flink-connector-kafka-0.9_2.11-1.2.1.jar library that is > passed via the --yarnship option. > Here is the way I run the job: > > export HADOOP_USER_NAME=hdfs; \ > export HADOOP_CONF_DIR=/etc/hadoop/conf/; \ > /opt/f

yarnship option

2017-05-22 Thread Mikhail Pryakhin
Hi all! I'm playing with flink streaming job on yarn cluster. The job consumes events from kafka and prints them to the standard out. The job uses flink-connector-kafka-0.9_2.11-1.2.1.jar library that is passed via the --yarnship option. Here is the way I run the job: export HADOOP_USER