Re: [SUGGESTION] Stack Overflow Documentation for Apache Flink

2016-09-05 Thread Ravikumar Hawaldar
Hi, I just committed to apache-flink documentation on SO, one more commit required. Nice idea to document on SO Vishnu. Regards, Ravikumar On 5 September 2016 at 14:22, Maximilian Michels wrote: > Hi! > > This looks neat. Let's try it out. I just voted. > > Cheers, > Max > > On Sun, Sep 4,

Re: How to maintain the state of a variable in a map transformation.

2016-06-14 Thread Ravikumar Hawaldar
allelism 1 or an external data store to keep that global state. > > Is it possible to break up your global state into a set of local > states which can be combined in the end? That way, you can take > advantage of distributed parallel processing. > > Cheers, > Max > >

Re: How to maintain the state of a variable in a map transformation.

2016-06-09 Thread Ravikumar Hawaldar
operator [1]. > 4) Yes, that should work. > > [1] > https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/iterations.html > > 2016-06-09 15:01 GMT+02:00 Ravikumar Hawaldar < > ravikumar.hawal...@gmail.com>: > >> Hi Fabian, Thank you for your answe

Re: How to maintain the state of a variable in a map transformation.

2016-06-09 Thread Ravikumar Hawaldar
ogram is executed > via the CLI client and shipped to a remote cluster. > 5) A map operator processes records one after the other, i.e., as a > sequence. If you need a certain order, you can call DataSet.sortPartition() > to locally sort the partition. > > Hope that helps

Re: How to maintain the state of a variable in a map transformation.

2016-06-09 Thread Ravikumar Hawaldar
is state is determined by the records which are sent to > this mapper instance. If you need a global state, then you have to set the > parallelism to 1. > > Cheers, > Till > > On Wed, Jun 8, 2016 at 5:08 PM, Ravikumar Hawaldar < > ravikumar.hawal...@gmail.com> wrote:

How to maintain the state of a variable in a map transformation.

2016-06-08 Thread Ravikumar Hawaldar
Hello, I have an DataSet which is roughly a record in a DataSet Or a file. Now I am using map transformation on this DataSet to compute a variable (coefficients of linear regression parameters and data structure used is a double[]). Now the issue is that, per record the variable will get updated