Re: Random Shuffling

2015-06-24 Thread Maximilian Alber
|filter| operation to filter the individual splits. >> Depending on you >> > split ID distribution you will have differently sized >> splits. >> > >> > Cheers, >> > Till >>

Re: Random Shuffling

2015-06-24 Thread Sebastian
element in the > data set has an unique id. Is there a nice way to do it with the > flink api? > (It would be nice to have guaranteed random shuffling.) > Thanks! > > Cheers, > Max > > ​ > >

Re: Random Shuffling

2015-06-24 Thread Maximilian Alber
gt; |filter| operation to filter the individual splits. Depending on >>> you >>> > split ID distribution you will have differently sized splits. >>> > >>> > Cheers, >>> > Till >>> > >>> > On Mon, Jun 15, 2015 at 1:50 PM Maximilian Alber >>> > alber.maximil...@gmail.com >>> > <http://mailto:alber.maximil...@gmail.com> wrote: >>> > >>> > Hi Flinksters, >>> > >>> > I would like to shuffle my elements in the data set and then >>> > split it in two according to some ratio. Each element in the >>> > data set has an unique id. Is there a nice way to do it with >>> the >>> > flink api? >>> > (It would be nice to have guaranteed random shuffling.) >>> > Thanks! >>> > >>> > Cheers, >>> > Max >>> > >>> > ​ >>> > >>> > >>> >>> >> >

Re: Random Shuffling

2015-06-24 Thread Stephan Ewen
on you >> > split ID distribution you will have differently sized splits. >> > >> > Cheers, >> > Till >> > >> > On Mon, Jun 15, 2015 at 1:50 PM Maximilian Alber >> > alber.maximil...@gmail.com >> > <http://mailto:alber.maximil...@gmail.com> wrote: >> > >> > Hi Flinksters, >> > >> > I would like to shuffle my elements in the data set and then >> > split it in two according to some ratio. Each element in the >> > data set has an unique id. Is there a nice way to do it with the >> > flink api? >> > (It would be nice to have guaranteed random shuffling.) >> > Thanks! >> > >> > Cheers, >> > Max >> > >> > ​ >> > >> > >> >> >

Re: Random Shuffling

2015-06-23 Thread Maximilian Alber
Mon, Jun 15, 2015 at 1:50 PM Maximilian Alber > > alber.maximil...@gmail.com > > <http://mailto:alber.maximil...@gmail.com> wrote: > > > > Hi Flinksters, > > > > I would like to shuffle my elements in the data set and then > > split it in two according to some ratio. Each element in the > > data set has an unique id. Is there a nice way to do it with the > > flink api? > > (It would be nice to have guaranteed random shuffling.) > > Thanks! > > > > Cheers, > > Max > > > > ​ > > > > > >

Re: Random Shuffling

2015-06-15 Thread Matthias J. Sax
: > > Hi Flinksters, > > I would like to shuffle my elements in the data set and then > split it in two according to some ratio. Each element in the > data set has an unique id. Is there a nice way to do it with the > flink api? > (

Re: Random Shuffling

2015-06-15 Thread Maximilian Alber
; Hi Flinksters, >> >> I would like to shuffle my elements in the data set and then split it in >> two according to some ratio. Each element in the data set has an unique id. >> Is there a nice way to do it with the flink api? >> (It would be nice to have guaranteed random shuffling.) >> Thanks! >> >> Cheers, >> Max >> > ​ >

Re: Random Shuffling

2015-06-15 Thread Till Rohrmann
ments in the data set and then split it in > two according to some ratio. Each element in the data set has an unique id. > Is there a nice way to do it with the flink api? > (It would be nice to have guaranteed random shuffling.) > Thanks! > > Cheers, > Max > ​

Re: Random Shuffling

2015-06-15 Thread Matthias J. Sax
data set has an unique > id. Is there a nice way to do it with the flink api? > (It would be nice to have guaranteed random shuffling.) > Thanks! > > Cheers, > Max signature.asc Description: OpenPGP digital signature

Random Shuffling

2015-06-15 Thread Maximilian Alber
Hi Flinksters, I would like to shuffle my elements in the data set and then split it in two according to some ratio. Each element in the data set has an unique id. Is there a nice way to do it with the flink api? (It would be nice to have guaranteed random shuffling.) Thanks! Cheers, Max