Running multiple streaming jobs in same cluster

2017-02-10 Thread Ozan DENİZ
Hi everyone, We have a huge execution graph for one streaming job. To update this execution graph, we take the snapshot of the job and start the job with snapshot. However this can take too much time. One option is splitting this huge streaming job into smaller ones. We can cancel or run new

Ynt: Flink 1.2-SNAPSHOT Bucketing Sink problem

2016-10-26 Thread Ozan DENİZ
version mismatch. Since you are using a SNAPSHOT build it is likely that dependencies changed when you recompiled Flink or your job. You should make sure that you are using the same version (on SNAPSHOT the same commit) for jobs and cluster. Best, Fabian 2016-10-26 18:30 GMT+02:00 Ozan DENİZ : >

Flink 1.2-SNAPSHOT Bucketing Sink problem

2016-10-26 Thread Ozan DENİZ
Hi everyone, We are currently using BucketingSink (Flink 1.2-SNAPSHOT) function for sink operation. The BucketingSink function was working correctly. However today, when I put the job on cluster I got this error; java.lang.NoSuchMethodError: org.apache.flink.streaming.api.operators.Streaming

Ynt: No support for request PutMappingRequest

2016-09-26 Thread Ozan DENİZ
sent using IndicesAdminClient. In my understanding this is an administrative command that isn't related to actually storing data in an index. What are you trying to store with the PutMappingRequest? Cheers, Aljoscha On Mon, 26 Sep 2016 at 15:16 Ozan DENİZ wrote: > Hi, > &

Ynt: No support for request PutMappingRequest

2016-09-26 Thread Ozan DENİZ
e complete stack trace to figure out where the problem comes from? I've also pulled in Aljoscha, the original author of the elasticsearch sink. Maybe he can give you a detailed answer. Cheers, Till On Fri, Sep 23, 2016 at 1:41 PM, Ozan DENİZ wrote: > Hi everyone, > > > We are

No support for request PutMappingRequest

2016-09-23 Thread Ozan DENİZ
Hi everyone, We are trying to use elasticsearch (2.x) connector for Flink application. However, we encounter a problem when we try to add mapping to elasticsearch index. The error message is below when we run the Flink application. No support for request [org.elasticsearch.action.admin.in

RE: Apache Flink Web Monitor Api

2016-06-06 Thread Ozan DENİZ
ssion. Cancellation should be straight forward. > > Restart is currently not supported via the REST API and I'm not aware > of any plans to add this. > > – Ufuk > > > On Mon, Jun 6, 2016 at 9:57 AM, Ozan DENİZ wrote: > > Hi everyone, > > We need to implement api

Apache Flink Web Monitor Api

2016-06-06 Thread Ozan DENİZ
Hi everyone, We need to implement api functions to cancel, restart and start the flink job. Is there any way to add these functions to WebMonitor api?Is there any plan to implement these functions to WebMonitor api? Thanks. Ozan

RE: Savepoint for time windows

2016-04-18 Thread Ozan DENİZ
am, you probably need to assign > persistent names to the operators. See > https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/streaming/savepoints.html#changes-to-your-program > > Stephan > > > On Mon, Apr 18, 2016 at 5:43 PM, Ufuk Celebi wrote: > > >

Savepoint for time windows

2016-04-18 Thread Ozan DENİZ
Hi everyone, I am trying to implement savepoint mechanism for my Flink project. Here is the scenario: I got the snapshot of Flink application by using "flink savepoint " command while the application is running. After saving snapshot of application, I canceled the job from web ui than I cha

Apache Flink: aligning watermark among parallel tasks

2016-03-25 Thread Ozan DENİZ
We are using periodic event time window with watermark. We have currently 4 parallel tasks in our Flink App. During the streaming process, all the 4 tasks' watermark values must be close to trigger window event. For example; Task 1 watermark value = 8 Task 2 watermark value =

Apache Flink: aligning watermark among parallel tasks

2016-03-24 Thread Ozan DENİZ
We are using periodic event time window with watermark. We have currently 4 parallel tasks in our Flink App. During the streaming process, all the 4 tasks' watermark values must be close to trigger window event. For example; Task 1 watermark value = 8 Task 2 watermark value =