Re: Flink ML Use cases

2019-05-25 Thread Abhishek Singh
> environment based on the Table API. This will be supported for batch and > streaming sources. > However, this effort just started and the features is not available yet. > > Best, Fabian > > Am So., 19. Mai 2019 um 11:54 Uhr schrieb Abhishek Singh < > asingh2...@gm

Re: Flink ML Use cases

2019-05-19 Thread Abhishek Singh
wrong. *Regards,* *Abhishek Kumar Singh* *Search Engine Engineer* *Mob :+91 7709735480 * *...* On Wed, May 15, 2019 at 11:25 AM Abhishek Singh wrote: > > Thanks a lot Rong and Sameer. > > Looks like this is what I wanted. > > I will try the above projects. > > *Rega

Re: Flink ML Use cases

2019-05-14 Thread Abhishek Singh
at 4:44 PM Sameer Wadkar wrote: > >> If you can save the model as a PMML file you can apply it on a stream >> using one of the java pmml libraries. >> >> Sent from my iPhone >> >> On May 14, 2019, at 4:44 PM, Abhishek Singh wrote: >> >> I was l

Flink ML Use cases

2019-05-14 Thread Abhishek Singh
I was looking forward to using Flink ML for my project where I think I can use SVM. I have been able to run a bath job using flink ML and trained and tested my data. Now I want to do the following:- 1. Applying the above-trained model to a stream of events from Kafka (Using Data Streams) :For

Re: rocksdb without checkpointing

2017-02-15 Thread Abhishek Singh
Sorry, that was a red herring. Checkpointing was not getting triggered because we never enabled it. Our application is inherently restartable because we can use our own output to rebuild state. All that is working fine for us - including restart semantics - without having to worry about upgrading

Re: Further aggregation possible after sink?

2017-02-13 Thread Abhishek Singh
You can keep adding stages, but then your sink is no more a sink - it would have transformed into a map or a flatmap ! On Mon, Feb 13, 2017 at 12:34 PM Mohit Anchlia wrote: > Is it possible to further add aggregation after the sink task executes? Or > is the sink the last stage of the workflow?

Re: weird client failure/timeout

2017-01-23 Thread Abhishek Singh
Hi Stephan, This did not work. For the working case I do see a better utilization of available slots. However the non working case still doesn't work. Basically I assigned a unique group to the sources in my for loop - given I have way more slots than the parallelism I seek. I know about the par

Re: checkpoint notifier not found?

2016-12-12 Thread Abhishek Singh
Will be happy to. Could you guide me a bit in terms of what I need to do? I am a newbie to open source contributing. And currently at Frankfurt airport. When I hit ground will be happy to contribute back. Love the project !! Thanks for the awesomeness. On Mon, Dec 12, 2016 at 12:29 PM Stephan E

Re: custom sources

2016-05-20 Thread Abhishek Singh
Thanks. I am still in theory/evaluation mode. Will try to code this up to see if checkpoint will become an issue. I do have a high rate of ingest and lots of in flight data. Hopefully flink back pressure keeps this nicely bounded. I doubt it will be a problem for me - because even spark is writing

Re: flink async snapshots

2016-05-20 Thread Abhishek Singh
Yes. Thanks for explaining. On Friday, May 20, 2016, Ufuk Celebi wrote: > On Thu, May 19, 2016 at 8:54 PM, Abhishek R. Singh > > wrote: > > If you can take atomic in-memory copies, then it works (at the cost of > > doubling your instantaneous memory). For larger state (say rocks DB), > won’t > >