cessing is dependent on
watermarks.
Please could you suggest how we can solve this?
Thank you.
*Sujit Sakre*
On 27 February 2017 at 22:55, Nico Kruber wrote:
> Hi Sujit,
> actually, according to
> https://ci.apache.org/projects/flink/flink-docs-release-1.2/dev/
> windows.html#
window not process the record that is present even
after not receiving a record for more than a substantial amount of time,
e.g. 30 minutes?
How do we resolve this situation?
Please could you suggest how to resolve this.
Many thanks.
*Sujit Sakre*
--
This email is sent on behalf of Northgate
identification of error difficult, as
sometimes it works i.e. results of pattern #1 and sometimes results of
pattern #2 or #3 (#3 occurs less frequently, however it does take place.
*Sujit Sakre*
Senior Technical Architect
Tel: +91 22 6660 6600
Ext:
247
Direct: 6740 5247
Mobile: +91 98672 01204
what could be the cause of this inconsistent behaviour. How
do we resolve it. We have integrated 1.2 and Kafka 0.10 now, the problem
persists.
Please could you suggest about what the problem could be and how to resolve
this.
Many thanks.
*Sujit Sakre*
--
This email is sent on behalf of Northgate
Implementing this formula seems to have solved our problem now. Thanks.
On 2 February 2017 at 21:21, Sujit Sakre
wrote:
> Hi Aljoscha,
>
> Thanks for your response.
>
> We wanted to customize the watermark period calculation since we were not
> getting the de
() {
Watermark watermark = new Watermark(currentMaxTimestamp +
maxOutOfOrderness);
return watermark;
}
*Sujit Sakre*
On 2 February 2017 at 21:09, Aljoscha Krettek wrote:
> Hi,
> what about using BoundedOutOfOrdernessGenerator? Why did that not work
> for your case?
>
> Cheers,
&g
generating watermarks,
however, we are unable to find the right combination and end up not
processing at least one record from our dataset.
Is there a formula or algorithm for generating the right watermark? Please
could suggest.
Thanks again.
*Sujit Sakre*
On 26 January 2017 at 20:17, Robert
does // in future this may be multiple of 3 or more if
necessary to cover the gap in records received return new
Watermark(currentMaxTimestamp * 2 - maxOutOfOrderness); } }
*Sujit Sakre*
On 24 January 2017 at 22:34, Aljoscha Krettek wrote:
> Hi,
> a bit more information would be useful. Are you u
records once. When we add again, it does not
work, Flink produces no result, even though the records are added to same
Kafka topic from the same command line instance.
Please could you suggest what could be wrong.
Many thanks.
*Sujit Sakre*
--
This email is sent on behalf of Northgate Public
.
*Sujit Sakre*
On 10 January 2017 at 22:10, Sujit Sakre
wrote:
> Hi Aljoscha,
>
> Thanks.
>
> I have used the following code for testing:
>
> main
>
> keyedStream.keyBy(4)
> .window(SlidingEventTimeWindows.of(Time.minutes6), Time.minutes(2))) //
> 6 min window w
ecords instead of those windows selected by
the condition. Is there something I am doing wrong? Does this need to be
done in a different way?
Please let me know.
Thanks.
*Sujit Sakre*
Senior Technical Architect
Tel: +91 22 6660 6600
Ext:
247
Direct: 6740 5247
Mobile: +91 98672 01204
ww
ggest.
*Sujit Sakre*
On 9 January 2017 at 22:27, Sujit Sakre wrote:
> Hi,
>
> We are using Sliding Event Time Window with Kafka Consumer. The window
> size is 6 minutes, and slide is 2 minutes. We have written a window
> function to select a particular window out of multiple
les with corresponding window
records, which is the correct behavior.
However sometimes only 4 files get created or 1 file or any number less
than 16 gets created randomly, this is anomalous behavior.
What could be the cause of such behavior? How do we resolve this?
Please, could you identify and s
les with corresponding window
records, which is the correct behavior.
However sometimes only 4 files get created or 1 file or any number less
than 16 gets created randomly, this is anomalous behavior.
What could be the cause of such behavior? How do we resolve this?
Please, could you identify and s
.
Thanks.
*Sujit Sakre*
Senior Technical Architect
Tel: +91 22 6660 6600
Ext:
247
Direct: 6740 5247
Mobile: +91 98672 01204
www.rave-tech.com
Follow us on: Twitter <https://twitter.com/Rave_Tech> / LinkedIn
<https://in.linkedin.com/in/ravetechnologies> / YouTube
<https://
15 matches
Mail list logo
