Re: ElasticsearchSink Exception

2017-02-25 Thread Flavio Pompermaier
The exception you have (NoClassDefFoundError: org/elasticsearch/index/mapper/MapperParsingException) is usually caused by elasticsearch version conflict or a bad shading when creating the uber jar. Can you check if one of the 2 is causing the problem? On 25 Feb 2017 23:13, "Govindarajan Srinivasar

Re: ElasticsearchSink Exception

2017-02-25 Thread Govindarajan Srinivasaraghavan
Hi Flavio, I tried with both http port 9200 and tcp port 9300 and I see incoming connections in the elasticserach node. Also I see the below errors in taskmanager out logs. Below are the dependencies I have on my gradle project. Am I missing something? Exception in thread "elasticsearch[Madame Me

Re: Checkpointing with RocksDB as statebackend

2017-02-25 Thread vinay patil
HI Stephan, Just to avoid the confusion here, I am using S3 sink for writing the data, and using HDFS for storing checkpoints. There are 2 core nodes (HDFS) and two task nodes on EMR I replaced s3 sink with HDFS for writing data in my last test. Let's say the checkpoint interval is 5 minutes, no

Re: ElasticsearchSink Exception

2017-02-25 Thread Flavio Pompermaier
Are you sure that in elasticsearch.yml you've enabled ES to listen to the http port 9300? On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" < govindragh...@gmail.com> wrote: Hi All, I'm getting the below exception when I start my flink job. I have verified the elastic search host and it see