Model serving in Flink DataStream

2017-11-14 Thread Adarsh Jain
Hi, I have a Flink Streaming system and I need to use couple of models trained on other systems with Flink Streaming i.e. need to do model serving. Is PMML the best way to do it? Any inputs on Flink-JPMML performance? Any other suggested alternatives? Regards, Adarsh

Re: Using Flink Ml with DataStream

2017-11-03 Thread Adarsh Jain
I. > > > On 30.10.2017 12:52, Adarsh Jain wrote: > > > Hi, > > Is there a way to use Stochastic Outlier Selection (SOS) and/or SVM using > CoCoA with streaming data. > > Please suggest and give pointers. > > Regards, > Adarsh > > ‌ > > >

Using Flink Ml with DataStream

2017-10-30 Thread Adarsh Jain
Hi, Is there a way to use Stochastic Outlier Selection (SOS) and/or SVM using CoCoA with streaming data. Please suggest and give pointers. Regards, Adarsh ‌

Binary encoding of categorical variables for input in ML algorithm

2017-09-05 Thread Adarsh Jain
Hi, We use Flink to process our streaming data and need to convert categorical variables to binary encoding for input in ML algo, any references on how to do it in Flink? Regards, Adarsh

Re: Recursive Traversal of the Input Path Directory, Not working

2017-06-27 Thread Adarsh Jain
ing > the improvement idea. That should be the fastest way to get this changed. > > Best, > Stefan > > Am 23.06.2017 um 15:08 schrieb Adarsh Jain : > > Hi Stefan, > > I think I found the problem, try it with a file which starts with > underscore in the name like "_part-1-

Re: Recursive Traversal of the Input Path Directory, Not working

2017-06-23 Thread Adarsh Jain
ting so that it does not pre appends underscore while saving a file. Regards, Adarsh On Fri, Jun 23, 2017 at 3:24 PM, Stefan Richter wrote: > No, that doesn’t make a difference and also works. > > Am 23.06.2017 um 11:40 schrieb Adarsh Jain : > > I am using "val env = Exec

Re: Recursive Traversal of the Input Path Directory, Not working

2017-06-23 Thread Adarsh Jain
asted your code, adding the missing "val env > = LocalEnvironment.createLocalEnvironment()" and exchanged the string > with a local directory for some test files that I created. No other changes. > > Am 23.06.2017 um 11:25 schrieb Adarsh Jain : > > Hi Stefan, > > Th

Re: Recursive Traversal of the Input Path Directory, Not working

2017-06-23 Thread Adarsh Jain
> Hi, > > I tried this out on the current master and the 1.3 release and both work > for me everything works exactly as expected, for file names, a directory, > and even nested directories. > > Best, > Stefan > > Am 22.06.2017 um 21:13 schrieb Adarsh Jain : > > Hi St

Re: Recursive Traversal of the Input Path Directory, Not working

2017-06-22 Thread Adarsh Jain
exceptions? > > Best, > Stefan > > Am 22.06.2017 um 17:01 schrieb Adarsh Jain : > > Hi, > > I am trying to use "Recursive Traversal of the Input Path Directory" in > Flink 1.3 using scala. Snippet of my code below. If I give exact file name > it is wo

Recursive Traversal of the Input Path Directory, Not working

2017-06-22 Thread Adarsh Jain
Hi, I am trying to use "Recursive Traversal of the Input Path Directory" in Flink 1.3 using scala. Snippet of my code below. If I give exact file name it is working fine. Ref https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/batch/index.html import org.apache.flink.api.java.utils.Pa

Re: Flink support for DeepLearning4j or other deep learning library

2017-03-11 Thread Adarsh Jain
google brought up: > https://www.slideshare.net/FlinkForward/suneel-marthi- > deep-learning-with-apache-flink-and-dl4j > > But in general, I don't think that it should be terribly hard to get > started with something, since both Flink and dl4j are JVM based. > > On F

Flink support for DeepLearning4j or other deep learning library

2017-03-10 Thread Adarsh Jain
Hi, I am trying to use Deep AutoEncoders for anomaly detection in my data stream using Flink. Any pointers/examples on the same. Regards, Adarsh

Re: Unable to use Scala's BeanProperty with classes

2017-02-15 Thread Adarsh Jain
o the cassandra > sinks: https://github.com/apache/flink/pull/2633 > > You would have to checkout the branch and build it yourself. If this works > for you it would be great if you could also give some > feedback either here or in the PR. > > Regards, > Chesnay > > On 15.0

Re: Unable to use Scala's BeanProperty with classes

2017-02-15 Thread Adarsh Jain
k this is the same bug. I'm afraid you have to wait until the > problem is fixed. > The only workaround would be to use a different data type, for example a > case class. > > Best, Fabian > > 2017-02-15 6:08 GMT+01:00 Adarsh Jain : > >> Any help will

Re: Unable to use Scala's BeanProperty with classes

2017-02-14 Thread Adarsh Jain
Nico > > On Tuesday, 14 February 2017 21:11:21 CET Adarsh Jain wrote: > > I am getting the same problem when trying to do FlatMap operation on my > > POJO class. > > > > Exception in thread "main" java.lang.IllegalStateException: Detected > > more than

Unable to use Scala's BeanProperty with classes

2017-02-14 Thread Adarsh Jain
I am getting the same problem when trying to do FlatMap operation on my POJO class. Exception in thread "main" java.lang.IllegalStateException: Detected more than one setter Am using Flink 1.2, the exception is coming when using FlatMap https://issues.apache.org/jira/browse/FLINK-5070