Hi Gordon/Flavio,
Found out the issue was because of elastic search version mismatch. Another
person upgraded ES version to 5.x but I was using 2.x. After changing the
version it worked. Thanks for the help.
On Mon, Feb 27, 2017 at 6:12 AM, Tzu-Li (Gordon) Tai <tzuli...@apache.org>
wrote:
> Hi!
>
> Like wha Flavio suggested, at a first glance this looks like a problem
> with building the uber jar.
>
> I haven’t bumped into the problem while testing out the connector on
> cluster submitted test jobs before, but I can try to test this quickly to
> make sure.
>
> Could you tell me what your installed Elasticsearch version is? Also, how
> are you building your uber jar?
>
> Cheers,
> Gordon
>
>
> On February 27, 2017 at 9:40:02 PM, Aljoscha Krettek (aljos...@apache.org)
> wrote:
>
> +Tzu-Li (Gordon) Tai <tzuli...@apache.org> Do you have any idea what
> could be causing this? I'm asking because you recently worked on the
> Elasticsearch connectors, right?
>
> On Sun, 26 Feb 2017 at 04:26 Govindarajan Srinivasaraghavan <
> govindragh...@gmail.com> wrote:
>
>> Thanks Flavio. I tried with multiple versions but still the same exception
>> and I was able to locate the class file inside my jar. Am I missing
>> something? Thanks for all the help.
>>
>> On Sat, Feb 25, 2017 at 3:09 PM, Flavio Pompermaier <pomperma...@okkam.it
>> >
>> wrote:
>>
>> > The exception you have (NoClassDefFoundError:
>> > org/elasticsearch/index/mapper/MapperParsingException) is usually
>> caused
>> > by
>> > elasticsearch version conflict or a bad shading when creating the uber
>> jar.
>> > Can you check if one of the 2 is causing the problem?
>> >
>> > On 25 Feb 2017 23:13, "Govindarajan Srinivasaraghavan" <
>> > govindragh...@gmail.com> wrote:
>> >
>> > > Hi Flavio,
>> > >
>> > > I tried with both http port 9200 and tcp port 9300 and I see incoming
>> > > connections in the elasticserach node. Also I see the below errors in
>> > > taskmanager out logs. Below are the dependencies I have on my gradle
>> > > project. Am I missing something?
>> > >
>> > > Exception in thread "elasticsearch[Madame Menace][generic][T#2]"
>> > > java.lang.NoClassDefFoundError:
>> > > org/elasticsearch/index/mapper/MapperParsingException
>> > > at
>> > > org.elasticsearch.ElasticsearchException.<clinit>(
>> > > ElasticsearchException.java:597)
>> > > at
>> > > org.elasticsearch.transport.TransportService$Adapter$3.
>> > > run(TransportService.java:622)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > Caused by: java.lang.ClassNotFoundException:
>> > > org.elasticsearch.index.mapper.MapperParsingException
>> > > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>> > > ... 5 more
>> > >
>> > >
>> > > Exception in thread "elasticsearch[Saint Elmo][generic][T#2]"
>> > > java.lang.NoClassDefFoundError: Could not initialize class
>> > > org.elasticsearch.transport.NodeDisconnectedException
>> > > at
>> > > org.elasticsearch.transport.TransportService$Adapter$3.
>> > > run(TransportService.java:622)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > >
>> > >
>> > > compile group: 'org.apache.flink', name: 'flink-core', version:
>> '1.2.0'
>> > > compile group: 'org.apache.flink', name: 'flink-streaming-java_2.10',
>> > > version: '1.2.0'
>> > > compile group: 'org.apache.flink', name: 'flink-java', version:
>> '1.2.0'
>> > > compile group: 'org.apache.flink', name:
>> > > 'flink-connector-kafka-0.10_2.10', version: '1.2.0'
>> > > compile group: 'org.apache.flink', name: 'flink-clients_2.10',
>> version:
>> > > '1.2.0'
>> > >
>> > > compile group: 'org.apache.flink', name:
>> > > 'flink-connector-elasticsearch2_2.10', version: '1.2.0'
>> > >
>> > >
>> > > On Sat, Feb 25, 2017 at 1:26 AM, Flavio Pompermaier <
>> > pomperma...@okkam.it>
>> > > wrote:
>> > >
>> > > > Are you sure that in elasticsearch.yml you've enabled ES to listen
>> to
>> > the
>> > > > http port 9300?
>> > > >
>> > > > On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
>> > > > govindragh...@gmail.com> wrote:
>> > > >
>> > > > Hi All,
>> > > >
>> > > > I'm getting the below exception when I start my flink job. I have
>> > > verified
>> > > > the elastic search host and it seems to be working well. I have also
>> > > tried
>> > > > including the below dependecies to my project but nothing works.
>> Need
>> > > some
>> > > > help. Thanks.
>> > > >
>> > > > compile group: 'org.apache.lucene', name: 'lucene-core', version:
>> > '5.5.0'
>> > > > compile group: 'org.elasticsearch', name: 'elasticsearch', version:
>> > > '2.3.5'
>> > > >
>> > > >
>> > > > *Sink Code:*
>> > > >
>> > > > List<InetSocketAddress> transportAddresses = new ArrayList<>();
>> > > > transportAddresses.add(new
>> > > > InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
>> > > >
>> > > > output.addSink(new ElasticsearchSink<>(config, transportAddresses,
>> new
>> > > > ElasticsearchSinkFunction<Object>() {
>> > > >
>> > > > }
>> > > >
>> > > >
>> > > > *Exception:*
>> > > >
>> > > > java.lang.RuntimeException: Client is not connected to any
>> > Elasticsearch
>> > > > nodes!
>> > > > at org.apache.flink.streaming.connectors.elasticsearch2.
>> > > > ElasticsearchSink.open(ElasticsearchSink.java:172)
>> > > > at org.apache.flink.api.common.
>> functions.util.FunctionUtils.
>> > > > openFunction(FunctionUtils.java:36)
>> > > > at org.apache.flink.streaming.api.operators.
>> > > > AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
>> > > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
>> > > > openAllOperators(StreamTask.java:386)
>> > > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
>> > > > invoke(StreamTask.java:262)
>> > > > at org.apache.flink.runtime.taskmanager.Task.run(Task.
>> > java:655)
>> > > > at java.lang.Thread.run(Thread.java:745)
>> > > >
>> > >
>> >
>>
>
