Re: bucketing in RollingSink

2016-10-13 Thread robert.lancaster
BucketingSink without any problems. Thanks! From: Robert Metzger Reply-To: "user@flink.apache.org" Date: Thursday, October 13, 2016 at 11:35 AM To: "user@flink.apache.org" Subject: Re: bucketing in RollingSink Hi, Let me know if you come across any issues with approach #2.

Re: bucketing in RollingSink

2016-10-13 Thread Robert Metzger
tion where I could follow its progress? > > > > Thanks again! > > > > *From: *Robert Metzger > *Reply-To: *"user@flink.apache.org" > *Date: *Wednesday, October 12, 2016 at 5:50 PM > *To: *"user@flink.apache.org" > *Subject: *Re: bucketin

Re: bucketing in RollingSink

2016-10-12 Thread robert.lancaster
;user@flink.apache.org" Date: Wednesday, October 12, 2016 at 5:50 PM To: "user@flink.apache.org" Subject: Re: bucketing in RollingSink Hi Robert, I see two possible workarounds: 1) You use the unreleased Flink 1.2-SNAPSHOT version. From time to time, there are some unstable com

Re: bucketing in RollingSink

2016-10-12 Thread Robert Metzger
Hi Robert, I see two possible workarounds: 1) You use the unreleased Flink 1.2-SNAPSHOT version. From time to time, there are some unstable commits in that version, but most of the time, its quite stable. We provide nightly binaries and maven artifacts for snapshot versions here: http://flink.apac

bucketing in RollingSink

2016-10-12 Thread robert.lancaster
Hi Flinksters, At one stage in my data stream, I want to save the stream to a set of rolling files where the file name used (i.e. the bucket) is chosen based on an attribute of each data record. Specifically, I’m using a windowing function to create aggregates of certain metrics and I want to