Re: Flink Elastic Sink AWS ES

We also had same setup where ES cluster was behind a proxy server for which port 80 was used which redirected it to ES cluster 9200 port. For using Flink we got the actual ip address of the ES nodes and put that in ips below. transportAddresses.add(new InetSocketAddress(InetAddress.getByName("127

Re: Flink Elastic Sink AWS ES

Hi Ted, Changing the port from 9300 to 9200 in the example you provides causes the error in the my original message my apologies for not providing context in the form of code in my original message, to confirm I am using the example you provided in my application and have it working using port

Re: Flink Elastic Sink AWS ES

If port 9300 in the following example is replaced by 9200, would that work ? https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/connectors/elasticsearch.html Please use Flink 1.3.1+ On Sat, Aug 26, 2017 at 3:00 PM, ant burton wrote: > Hello, > > Has anybody been able to use the Fl

Flink Elastic Sink AWS ES

Hello, Has anybody been able to use the Flink Elasticsearch connector to sink data to AWS ES. I don’t believe this is possible as AWS ES only allows access to port 9200 (via port 80) on the master node of the ES cluster, and not port 9300 used by the the Flink Elasticsearch connector. The err

Re: Distribute crawling of a URL list using Flink

Thank you Aljoscha :-) I actually need it for a Kafka stream, so I use DataStream API anyway. Regards, Eranga Heshan *Undergraduate* Computer Science & Engineering University of Moratuwa Mobile: +94 71 138 2686 <%2B94%2071%20552%202087> Email: eranga@gmail.com

Flink AggregateFunction Help

Hello! I'm unable to see any results from .print() after performing an AggregateFunction over a timeWindow. I made a very detailed post on StackOverflow: https://stackoverflow.com/questions/45898849/flink-aggregatefunction Thank you!

Re: Serialization issues with DataStreamUtils

Hi Robert, The test case code is as follows: GenericRecord testData = new GenericData.Record(avroSchema); SingleOutputStreamOperator testStream = env.fromElements(testData) .map(new DummyOperator(...)); Iterator

Specific sink behaviour based on tuple key

Hi all, I am looking to customize a sink behaviour based on tuple key. My goal is to have each sink partition to write to a specific output. My job will be something like : input -> keyBy() -> outputSink This output should be something like './base/path/keyValue/'. But I was not able to f