Re: MapState in flink

2020-06-13 Thread Oytun Tez
Correct me @everyone if I'm wrong, but you cannot keep State inside State in that way. So change your signature to: MapState> The underlying mechanism wouldn't make sense in this state-inside-state shape. -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder o

Re: [ANNOUNCE] Apache Flink Stateful Functions 2.1.0 released

2020-06-09 Thread Oytun Tez
thank all contributors of the Apache Flink community who > made this release possible! > > Cheers, > Gordon > -- -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog>

Re: Window processing in Stateful Functions

2020-05-06 Thread Oytun Tez
Oops – will follow the thread 🙊 -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog> On Wed, May 6, 2020 at 5:37 PM m@xi wrote: > Hello Tez, > > With all the respect, I doubt your answer is r

Re: Window processing in Stateful Functions

2020-05-06 Thread Oytun Tez
I think this is also related to my question about CEP in Statefun. @Annemarie Burger , I was looking into using Siddhi library within the Function's context. -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/bl

Re: Using Stateful Functions within a Flink pipeline

2020-04-22 Thread Oytun Tez
@Igal, this sounds more comprehensive (better) than just opening DataStreams: "basically exposing the core Flink job that is the heart of stateful functions. " Great! -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.

Re: Using Stateful Functions within a Flink pipeline

2020-04-22 Thread Oytun Tez
Hi Annemarie, Unfortunately this is not possible at the moment, but DataStream as in/egress is in the plans as much as I know. -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog> On Wed, Apr 22, 2020 a

Re: Enable custom REST APIs in Flink

2020-04-21 Thread Oytun Tez
ch work on Flink's side, but of course I can't tell confidently. -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog> On Tue, Apr 21, 2020 at 11:12 AM Jeff Zhang wrote: > I know some users do the same th

Re: Enable custom REST APIs in Flink

2020-04-21 Thread Oytun Tez
definitely, this is for me about making Flink an "application framework" rather than solely a "dataflow framework". -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog> On Tue, A

Re: Enable custom REST APIs in Flink

2020-04-21 Thread Oytun Tez
I would LOVE this. We had to hack our way a lot to achieve something similar. @Flavio, we basically added a new entrypoint to the same codebase and ran that separately in its own container. -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com &l

Re: [Stateful Functions] Using Flink CEP

2020-04-14 Thread Oytun Tez
x27;s needed to fit our problems within Statefun (e.g., from a CEP-like expression to the ridesharing example you shared) Oytun -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog> On Tue, Apr 14, 2020 at 5:

Re: [Stateful Functions] Using Flink CEP

2020-04-14 Thread Oytun Tez
using protobuf. Even if we talk via DataStreams, this would still bring us some level of separation between our Flink API code and statefun. -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog> On Mon, Apr 13, 2020 at

Re: [Stateful Functions] Using Flink CEP

2020-04-13 Thread Oytun Tez
I am leaning towards using Siddhi as a library, but I would really love to stick with Flink CEP, or at least the specific CEP mechanism that Flink CEP uses. Exploring the codebase of Flink CEP wasn't much promising on this end. -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & C

[Stateful Functions] Using Flink CEP

2020-04-13 Thread Oytun Tez
Hi there, I was wondering if I could somehow use CEP within a Function. Have you experimented with this before? Or, do you have any suggestions to do CEP within a Function? I am looking for a standalone library now. Oytun -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founde

[Stateful Functions] Using statefun for E2E testing

2020-04-09 Thread Oytun Tez
used a similar approach? This is just a general question to see resources about integration testing via Flink. -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog>

StateFun - Multiple modules example

2020-04-08 Thread Oytun Tez
Hi there, Does anyone have any statefun 2.0 examples with multiple modules? -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog>

Re: [ANNOUNCE] Apache Flink Stateful Functions 2.0.0 released

2020-04-07 Thread Oytun Tez
-- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog> On Tue, Apr 7, 2020 at 12:26 PM Oytun Tez wrote: > Great news! Thank you all. > > On Tue, Apr 7, 2020 at 12:23 PM Marta Paes Moreira > wrote: &g

Re: [ANNOUNCE] Apache Flink Stateful Functions 2.0.0 released

2020-04-07 Thread Oytun Tez
;>> https://github.com/docker-library/official-images/pull/7749 >>> >>> The full release notes are available in Jira: >>> >>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12346878 >>> >>> We would like to thank all contributors of the Apache Flink community >>> who made this release possible! >>> >>> Cheers, >>> Gordon >>> >> -- -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog>

Re: FlinkCEP questions - architecture

2020-02-21 Thread Oytun Tez
s. Will the state still be found, despite it being stored >> in another node? I read that I need to be equally careful when changing >> rules? Or is that a different issue? >> > >> > 9) How does garbage collection of temp CEP state work, or will it stay >> foreve

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-13 Thread Oytun Tez
;> >>> [1] >>> >>> https://github.com/apache/flink/blob/release-1.10/flink-container/docker/Dockerfile >>> [2] >>> >>> https://ci.apache.org/projects/flink/flink-docs-stable/ops/deployment/docker.html >>> >>> >>> >>> -- >>> Sent from: >>> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ >>> >> -- -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog>

Re: [ANNOUNCE] Apache Flink 1.9.2 released

2020-01-31 Thread Oytun Tez
Thank you! -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog> On Fri, Jan 31, 2020 at 8:47 AM Till Rohrmann wrote: > Thanks for being our release manager Hequn and thanks for everyone who > made t

Re: SANSA 0.7.1 (Scalable Semantic Analytics Stack) Released

2020-01-16 Thread Oytun Tez
Looks interesting, Hajira. Thank you for sharing. We should add this to flink-packages.org. -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog> On Thu, Jan 16, 2020 at 5:01 PM Hajira Jabeen wrote: &g

Re: [ANNOUNCE] Launch of flink-packages.org: A website to foster the Flink Ecosystem

2019-11-18 Thread Oytun Tez
Congratulations! This is exciting. -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com <https://www.motaword.com/blog> On Mon, Nov 18, 2019 at 11:07 AM Robert Metzger wrote: > Hi all, > > I would like to announce that Ververica,

Re: Broadcast state

2019-09-30 Thread Oytun Tez
aflow programming or Flink framework? --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Mon, Sep 30, 2019 at 8:40 PM Oytun Tez wrote: > You can re-use the broadcasted state (along with its descriptor) that >

Re: Broadcast state

2019-09-30 Thread Oytun Tez
You can re-use the broadcasted state (along with its descriptor) that comes into your KeyedBroadcastProcessFunction, in another operator downstream. that's basically duplicating the broadcasted state whichever operator you want to use, every time. --- Oytun Tez *M O T A W O R D* The Wo

Re: Best way to link static data to event data?

2019-09-27 Thread Oytun Tez
Hi, You should look broadcast state pattern in Flink docs. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Fri, Sep 27, 2019 at 2:42 PM John Smith wrote: > Using 1.8 > > I have a list of phone area cod

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-12 Thread Oytun Tez
Hi Zhu, We are using custom restart strategy like this: environment.setRestartStrategy(failureRateRestart(2, Time.minutes(1), Time.minutes(10))); --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Thu, Sep 12, 2019

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

2019-09-11 Thread Oytun Tez
Congratulations! --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Wed, Sep 11, 2019 at 6:36 AM bupt_ljy wrote: > Congratulations! > > > Best, > > Jiayi Liao > > Original Message > *Sen

Re: Making broadcast state queryable?

2019-09-06 Thread Oytun Tez
into a DB-like place). So the case for QS for us is centralization of input, output, presentation. State Processor API for instance also counts as a presentation tool for us (on top of migration tool). This kind of all-in-one (in, out, ui) packaging helps with small teams. --- Oytun Tez *M O T

Re: [ANNOUNCE] Kostas Kloudas joins the Flink PMC

2019-09-06 Thread Oytun Tez
It was only natural! I already thought Kostas was PMC member! 🎶 --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Fri, Sep 6, 2019 at 9:51 AM Zili Chen wrote: > Congrats Klou! > > Best, > tison. >

Re: [ANNOUNCE] Apache Flink 1.9.0 released

2019-08-27 Thread Oytun Tez
Thank you, Fabian! We are migrating soon once 2.12 is available. Cheers, --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Tue, Aug 27, 2019 at 8:11 AM Fabian Hueske wrote: > Hi all, > > Flink 1.9 Doc

Re: [ANNOUNCE] Apache Flink 1.9.0 released

2019-08-26 Thread Oytun Tez
Thanks Till and Zili! I see that docker-flink repo now has 1.9 set up, we are only waiting for it to be pushed to Docker Hub. We should be fine once that is done. Thanks again! --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motawor

Re: [ANNOUNCE] Apache Flink 1.9.0 released

2019-08-23 Thread Oytun Tez
Hi all, We also had to rollback our upgrade effort for 2 reasons: - Official Docker container is not ready yet - This artefact is not published with scala: org.apache.flink:flink-queryable-state-client-java_2.11:jar:1.9.0 --- Oytun Tez *M O T A W O R D* The World's Fastest

Re: [ANNOUNCE] Apache Flink 1.9.0 released

2019-08-22 Thread Oytun Tez
s see. :) This is a great update, thank you again! --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Thu, Aug 22, 2019 at 8:11 AM Jark Wu wrote: > Congratulations! > > Thanks Gordon and Kurt for being the release m

Re: [ANNOUNCE] Apache Flink 1.9.0 released

2019-08-22 Thread Oytun Tez
Congratulations team; thanks for the update, Gordon. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Thu, Aug 22, 2019 at 8:03 AM Tzu-Li (Gordon) Tai wrote: > The Apache Flink community is very happy to anno

Re: Questions for platform to choose

2019-08-21 Thread Oytun Tez
Flink 💅💂 --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Wed, Aug 21, 2019 at 2:42 AM Eliza wrote: > Hello, > > We have all of spark, flink, storm, kafka installed. > For realtime streaming calculat

Re: [VOTE] Apache Flink 1.9.0, release candidate #3

2019-08-19 Thread Oytun Tez
Thanks, Gordon, will do tomorrow. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Mon, Aug 19, 2019 at 7:21 PM Tzu-Li (Gordon) Tai wrote: > Hi! > > Voting on RC3 for Apache Flink 1.9.0 has started: >

RabbitMQ - ConsumerCancelledException

2019-08-19 Thread Oytun Tez
eadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more We've tried limiting prefetch count 100 and 500, didn't change. We can try 1 by 1, but that doesn't really sound efficient. Is anyone familiar with possible causes? --- Oytun Tez *M O T A W O R D* The Wor

Re: Using S3 as a sink (StreamingFileSink)

2019-08-16 Thread Oytun Tez
integrity). This leaves us in the state with the failed files, partial files etc. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Fri, Aug 16, 2019 at 6:02 PM Swapnil Kumar wrote: > Hello, We are using Flink to proce

Re: Product Evaluation

2019-08-16 Thread Oytun Tez
Hi Ajit, I believe many of us use CEP – we use it extensively. If you can be more specific, we'll try to respond more directly. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Fri, Aug 16, 2019 at 5:06 PM A

Re: [ANNOUNCE] Andrey Zagrebin becomes a Flink committer

2019-08-14 Thread Oytun Tez
Congratulations Andrey! I am glad the Flink committer team is growing at such a pace! --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Wed, Aug 14, 2019 at 9:29 AM Zili Chen wrote: > Congratulations Andrey!

Re: Making broadcast state queryable?

2019-08-13 Thread Oytun Tez
tate... Thanks again! --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Tue, Aug 13, 2019 at 6:29 PM Yu Li wrote: > Hi Oytun, > > Sorry but TBH such support will probably not be added in the foreseeabl

Making broadcast state queryable?

2019-08-13 Thread Oytun Tez
oes around ctx.getBroadcastState and making it queryable in the operator level (I'd rather not). --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Oytun Tez
Congratulations Hequn! --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Wed, Aug 7, 2019 at 9:03 AM Jark Wu wrote: > Congratulations Hequn! It's great to have you in the community! > > > > On

Re: Best way to access a Flink state entry from another Flink application

2019-08-06 Thread Oytun Tez
Hi Mohammad, Queryable State works in some cases: https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/stream/state/queryable_state.html As much as I know, this is the only way to access Flink's state from outside, until we have Savepoint API coming in 1.9. --- Oytun Tez *M O

Re: Best pattern to signal a watermark > t across all tasks?

2019-08-02 Thread Oytun Tez
This bit of info is very useful, Fabian, thank you: You can get the parallel task id from the > RuntimeContext.getIndexOfThisSubtask(). > RuntimeContext.getNumberOfParallelSubtasks() gives the total number of > tasks. --- Oytun Tez *M O T A W O R D* The World's

Re: Best pattern to signal a watermark > t across all tasks?

2019-08-01 Thread Oytun Tez
keys. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Thu, Aug 1, 2019 at 1:06 PM Eduardo Winpenny Tejedor < eduardo.winpe...@gmail.com> wrote: > Hi all, > > I have a keyed operator with an hourly even

Re: Is Queryable State not working in standalone cluster with 1 task manager?

2019-07-30 Thread Oytun Tez
[image: image.png] --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Tue, Jul 30, 2019 at 9:04 AM Oytun Tez wrote: > We extend the official container and the jar is available under ./lib – so > it wasn&#

Re: Is Queryable State not working in standalone cluster with 1 task manager?

2019-07-30 Thread Oytun Tez
We extend the official container and the jar is available under ./lib – so it wasn't enabled by default, we moved the jar under ./lib and then build the container+application. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.mo

Re: Is Queryable State not working in standalone cluster with 1 task manager?

2019-07-29 Thread Oytun Tez
And, Flink version: 1.8, incl. Docker container (official flink:1.8 tag) --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Mon, Jul 29, 2019 at 4:32 PM Oytun Tez wrote: > Hi there, > > We have a job that

Is Queryable State not working in standalone cluster with 1 task manager?

2019-07-29 Thread Oytun Tez
itself and provide queryable-state.enable: true config directly via Configuration, then I can at least see that the queryable state server is spinning up. Any pointers? With standalone-job.sh, it seems that it doesn't care about queryable-state.enable config inside flink-conf.yaml. --- Oytun

Re: question for handling db data

2019-07-26 Thread Oytun Tez
dates, will do its calculation via the latest geofence data from processBroadcastElement. when geofence data is updated, user location updates from that point on will use the new geofence data. i hope this is more clear... --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translatio

Re: Extending REST API with new endpoints

2019-07-26 Thread Oytun Tez
Scary! :) I would heartily hate to maintain our own fork. Should I make a feature request to discuss further and then send a PR for this? Is this the normal way to push for a feature? --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motawor

Re: question for handling db data

2019-07-25 Thread Oytun Tez
ingle stream item), broadcast the stream to downstream operators, which will now have geofence data in their state as their slow changing data (processBroadcastElement), and the user location regularly coming to the operator (processElement). --- Oytun Tez *M O T A W O R D* The World's Fas

Re: 1.9 Release Timeline

2019-07-23 Thread Oytun Tez
Thank you for responding! I'll subscribe to dev@ --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Tue, Jul 23, 2019 at 10:25 AM Timo Walther wrote: > Hi Oytun, > > the community is working hard to r

Re: 1.9 Release Timeline

2019-07-23 Thread Oytun Tez
Ping, any estimates? --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Thu, Jul 18, 2019 at 11:07 AM Oytun Tez wrote: > Hi team, > > 1.9 is bringing very exciting updates, State Processor API and MapStat

Re: Extending REST API with new endpoints

2019-07-23 Thread Oytun Tez
Ping, any ideas? --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Mon, Jul 22, 2019 at 9:39 AM Oytun Tez wrote: > I did take a look at it, but things got out of hand very quickly from > there on :D >

Re: [DISCUSS] Create a Flink ecosystem website

2019-07-23 Thread Oytun Tez
ystem where we understand the popularity of a package, it helps to pick among similar packages if any. Something like the popularity figure here that we can fetch from somewhere: https://mvnrepository.com/popular --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Pl

Re: Flink SinkFunction for WebSockets

2019-07-23 Thread Oytun Tez
extension/plugin/library. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Tue, Jul 23, 2019 at 7:07 AM Fabian Hueske wrote: > Hi Tim, > > One thing that might be interesting is that Flink might emit results mo

Re: Extending REST API with new endpoints

2019-07-22 Thread Oytun Tez
nsion into the dispatcher? --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Mon, Jul 22, 2019 at 9:37 AM Seth Wiesman wrote: > Would the `WebMonitorExtension` work? > > [1] > https://github

Re: Extending REST API with new endpoints

2019-07-22 Thread Oytun Tez
a lot. As there already is a http server in this codebase, we'd like to attach to that instead. Especially queryable state is tightly coupled with Flink code, so it doesn't make much sense to host another http application to bridge into Flink. --- Oytun Tez *M O T A W O R D* The W

Re: Extending REST API with new endpoints

2019-07-19 Thread Oytun Tez
nters? --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Fri, Jul 19, 2019 at 3:53 PM Oytun Tez wrote: > Hi there, > > I am trying to add a new endpoint to the REST API, by > extending AbstractRestHandler

Extending REST API with new endpoints

2019-07-19 Thread Oytun Tez
Hi there, I am trying to add a new endpoint to the REST API, by extending AbstractRestHandler. But this new handler needs to be added in WebMonitorEndpoint, which has no interface for outside. Can I do this with 1.8? Any other way or plans to make this possible? --- Oytun Tez *M O T A W O R D

1.9 Release Timeline

2019-07-18 Thread Oytun Tez
/RapidBoard.jspa?projectKey=FLINK&rapidView=328 --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com

Re: Migrating existing application to Flink

2019-07-12 Thread Oytun Tez
I am so excited with 1.9, State Processor API is single handedly the most important update for me. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Sun, Jul 7, 2019 at 4:34 AM Konstantin Knauf wrote: > Hi

Re: [ANNOUNCE] Rong Rong becomes a Flink committer

2019-07-11 Thread Oytun Tez
Congratulations Rong! --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Thu, Jul 11, 2019 at 1:44 PM Peter Huang wrote: > Congrats Rong! > > On Thu, Jul 11, 2019 at 10:40 AM Becket Qin wrote: >

Re: Flink Forward Europe 2019 - Call for Presentations open until 17th May

2019-05-17 Thread Oytun Tez
he weekend, I should be ready to submit CFP. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Fri, May 17, 2019 at 11:02 AM Robert Metzger wrote: > Hey all, > > Short update on the Flink Forward Call For P

Re: PatternFlatSelectAdapter - Serialization issue after 1.8 upgrade

2019-04-30 Thread Oytun Tez
Hi all, Making the tag a static element worked out, thank you! --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Tue, Apr 23, 2019 at 10:37 AM Oytun Tez wrote: > Thank you Guowei and Dawid! I am trying your sug

Re: Flink CLI

2019-04-25 Thread Oytun Tez
I had come across flink-deployer actually, but somehow didn't want to "learn" it... (versus just a bunch of lines in a script) At some time with more bandwidth, we should migrate to this one and standardize flink-deployer (and later take this to mainstream Flink :P). --- Oytun Te

Re: Flink CLI

2019-04-24 Thread Oytun Tez
this soon. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Wed, Apr 24, 2019 at 11:06 AM Steven Nelson wrote: > Hello! > > I am working on automating our deployments to our Flink cluster. I had a > coupl

Re: May be useful: our reference document for "Understanding State in Flink"

2019-04-24 Thread Oytun Tez
Thank you all! @David and @Fabian can guide me (or Deepak as well) to maintain this document if they'd like. I can export HTML from this that we can easily play with and put in docs. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@mo

Re: Sinking messages in RabbitMQ

2019-04-23 Thread Oytun Tez
I think you should exchangeDeclare when you open the sink. When invoked, you can channel.basicPublish(exchangeName). Would this work? We have a single exchange, so didn't explore this method. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@mo

May be useful: our reference document for "Understanding State in Flink"

2019-04-23 Thread Oytun Tez
We keep a document with state-related use cases in our application, useful for onboarding new engineers in the application. See attached PDF. May be useful for others. And of course, corrections are welcome. (Couldn't share our Wiki page) --- Oytun Tez *M O T A W O R D* The World'

Re: PatternFlatSelectAdapter - Serialization issue after 1.8 upgrade

2019-04-23 Thread Oytun Tez
? --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Tue, Apr 23, 2019 at 2:56 AM Dawid Wysakowicz wrote: > Hi Oytun, > > I think there is a regression introduced in 1.8 how we handle output tags. > The pro

Re: PatternFlatSelectAdapter - Serialization issue after 1.8 upgrade

2019-04-19 Thread Oytun Tez
Forgot to answer one of your points: the parent class compiles well without this CEP selector (with timeout signature)... --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Fri, Apr 19, 2019 at 9:40 AM Oytun Tez

Re: PatternFlatSelectAdapter - Serialization issue after 1.8 upgrade

2019-04-19 Thread Oytun Tez
utStream.writeObject(ObjectOutputStream.java:348) at org.apache.flink.util.InstantiationUtil.serializeObject(InstantiationUtil.java:576) at org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:81) ... 9 more --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Pla

PatternFlatSelectAdapter - Serialization issue after 1.8 upgrade

2019-04-18 Thread Oytun Tez
, Collector collector) { } } ).name("Select pending projects for invitation").*getSideOutput* (pendingProjectsTag); } --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com

Re: Sink data into java stream variable

2019-04-15 Thread Oytun Tez
/state.html#using-managed-operator-state --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Mon, Apr 15, 2019 at 3:01 PM Soheil Pourbafrani wrote: > Hi, > > In Flink Stream processing can we sink data into java stream array? >

Re: [DISCUSS] Create a Flink ecosystem website

2019-03-21 Thread Oytun Tez
Thank you, all! If there are operational tasks about the ecosystem page(s), let me know (organizing the content etc, whatever). --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Thu, Mar 21, 2019 at 2:14 PM Becke

Re: Technical consulting resources

2019-03-14 Thread Oytun Tez
Here is a better link from a service buyer perspective: https://touk.pl/ --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Thu, Mar 14, 2019 at 1:02 PM Oytun Tez wrote: > Hi Ron, > > I've been

Re: Technical consulting resources

2019-03-14 Thread Oytun Tez
Hi Ron, I've been experimenting with Nussknacker, a Flink application, which is built by TouK: https://touk.pl/esp/ It looks like they have experience with large deployments (telecom), so they may be helpful. I am CC'ing 2 engineers from their team. --- Oytun Tez *M O T A W

Re: Calculating over multiple streams...

2019-02-22 Thread Oytun Tez
Restructuring with your tip now, Michael, thank you! --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Fri, Feb 22, 2019 at 11:23 AM Michael Latta wrote: > You may want to union the 3 streams prior to the process