;d be delighted to discuss and
contribute to the flink state migration utility alongside you.
Best,
Xu Huang
David Radley 于2024年11月12日周二 07:02写道：
> Hi Gabor,
> That sounds very reasonable. I will put this on my list to try, hopefully
> in the next few days.
>
> I think the “opera
am V1 and DataSet. So we thought it would
make sense to provide this capability in the form of an extension rather
than a base API.
Best
Xu Huang
[1]
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=284789682#FLIP408:[Umbrella]IntroduceDataStreamAPIV2-Fundamentalprimitives
Fabia
Hi, Junrui
Thanks for your question.
In this FLIP, once the data is received, it tries to do Join with the data
on the other side, so it can be used for both bounded and unbounded streams.
Best,
Xu Huang
Junrui Lee 于2025年1月6日周一 16:25写道：
> Hi Xu,
>
> Thanks for your work. I hav
Hi, Anil
I don't understand what you mean by Global Watermark, are you trying to
have all Sources emit a special event with the same epoch at the same time?
Is there a specific user case for this question?
Happy new year!
Best,
Xu Huang
Anil Dasari 于2025年1月3日周五 14:02写道：
> Hello XU,H
ded by Flink.
To make it easy for users to use event time in DataStream V2, this FLIP
will implement event time extension in DataStream V2 based on Generalized
Watermark.
For more details, please refer to FLIP-499 [1]. We look forward to your
feedback.
Best,
Xu Huang
[1] https://cwiki.apac
e.org/confluence/display/FLINK/FLIP-217%3A+Support+watermark+alignment+of+source+splits
[2]
https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/dev/datastream/event-time/generating_watermarks/#watermark-alignment
Best,
Xu Huang
Anil Dasari 于2025年1月3日周五 22:41写道：
>
> Hi Xu,Tha
add it to the JavaDoc or FLIP to clarify this, thanks for the
question!
Best,
Xu Huang
Junrui Lee 于2025年1月6日周一 11:01写道：
> Hi, Xu
>
> Thanks for your work, I noticed that in this FLIP, event-time watermark is
> created and sent through a separate WatermarkGenerator. I would like to
>
which indirectly increases the complexity of writing jobs. I believe it is
sufficient to encapsulate all extensions in Built-In Functions rather than
in the fundamental primitives of the stream. Users will not be affected by
these extensions if they do not explicitly utilize them.
Best,
Xu Huang
[1]
Hi, all.
I'd like to start a vote on FLIP-499: Support Event Time by Generalized
Watermark in DataStream V2 [1].
You can find the discussion in here [2].
The vote will last for at least 72 hours unless there is objection or
insufficient votes.
Best regards,
Xu Huang
[1]
ck.
Best,
Xu Huang
[1] https://cwiki.apache.org/confluence/x/z4kgF
ackage names and
scopes (DataStream V1 or V2) are different between original event time
watermark and Generalized Watermark, which should help clarify potential
confusion.
Best,
Xu Huang
Hongshun Wang 于2024年12月29日周日 16:08写道：
> Hi Xu Hang,
> Sorry, it's late to join this. Thanks for
feature only worked for DataStream V2.
For more details, please refer to FLIP-467 [1]. We look forward to your
feedback.
Best,
Jeyhun Karimov, Weijie Guo and Xu Huang
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-467%3A+Introduce+Generalized+Watermarks
[2]
https://cwiki.apache.org
est, Xu Huang
Junrui Lee 于2024年12月16日周一 19:40写道：
> Hi Xu Huang,
>
> Thanks for the proposal!
>
> I have a question: If I have a large number of generalized watermarks that
> need to be created, where should they be declared? Should they be declared
> only once in a single Sou
XXX," such as "INTERNAL_RUNTIME_BACKLOG" or
"INTERNAL_CONNECTOR_KAFKA_IDLE."
What do you think? I will incorporate this naming strategy into the FLIP if
you're okay with it.
Thanks for your suggestion again!
Best,
Xu Huang
Yunfeng Zhou 于2024年12月18日周三 19:10写道：
> Hi Xu Huang,
Hi Yunfeng, The watermark identifiers are case-sensitive, and we cannot
distinguish which connectors are internal. Therefore, the naming strategy
could be "CONNECTOR_KAFKA_IDLE." I have added the naming strategy to FLIP,
PTAL. Thanks again! Best, Xu Huang
Yunfeng Zhou 于2024年12月19日
Hi, all.
I'd like to start a vote on FLIP-467: Introduce Generalized Watermarks [1].
You can find the discussion in here [2].
The vote will last for at least 72 hours unless there is objection or
insufficient votes.
Best regards,
Xu Huang
[1]
https://cwiki.apache.org/confluence/di
only the aggregated results in the Window, instead of all input
data. In addition, we have provided a default implementation that allows
users to use the Window API proposed in FLIP in a similar way to DataStream
V1, thus providing greater flexibility to users. Best, Xu Huang
wenjin 于2025年1月10日周五
Hi all,
I'm glad to announce that the FLIP-499[1] has been accepted. The voting
thread is here[2].
The proposal received 4 approving votes, 3 of which are binding:
- Weijie Guo (binding)
- Yuepeng Pan
- Junrui Lee (binding)
- Xintong Song (binding)
And there is no disapproving one.
Thanks to al
. For
users with highly customized needs, they can implement their own solutions
using ProcessFunction. Furthermore, we have provided the most commonly used
types of windows. If we find that users do need custom windows, we can
introduce relevant interfaces to support this in the future. Best, Xu Huang
soon as possible. Thanks for your
understanding.
Best,
Xu Huang
Xu Huang 于2025年1月4日周六 11:49写道：
> Hi Devs,
>
> Weijie Guo and I would like to initiate a discussion about FLIP-500:
> Support Join Extension in DataStream V2 API [1].
>
> In relational algebra, Join are used to co-
Hi, all.
I'd like to start a vote on FLIP-500: Support Join Extension in DataStream
V2 API [1]. You can find the discussion on it here[2].
The vote will last for at least 72 hours unless there is objection or
insufficient votes.
Best regards,
Xu Huang
[1] https://cwiki.apache.org/conflue
Hi, all.
I'd like to start a vote on FLIP-501: Support Window Extension in
DataStream V2 API [1]. You can find the discussion on it here [2].
The vote will last for at least 72 hours unless there is objection or
insufficient votes.
Best regards,
Xu Huang
[1] https://cwiki.apache.org/confl
FLIP will
implement the Join extension in DataStream V2.
For more details, please refer to FLIP-500 [1]. We look forward to your
feedback.
Best,
Xu Huang
[1] https://cwiki.apache.org/confluence/x/ywz0Ew
Hi all,
I'm glad to announce that the FLIP-467[1] has been accepted. The voting
thread is here[2].
The proposal received 4 approving votes, 3 of which are binding:
- Xintong Song (binding)
- Junrui Lee (binding)
- Weijie Guo (binding)
- Yunfeng Zhou
And there is no disapproving one.
Th
Hi all,
I'm glad to announce that the FLIP-501 [1] has been accepted. The voting
thread is here[2].
The proposal received 3 approving votes, all of which are binding:
- Weijie Guo (binding)
- Junrui Lee (binding)
- Zakelly Lan (binding)
And there is no disapproving one.
Thanks to all participan
Hi all,
I'm glad to announce that the FLIP-500 [1] has been accepted. The voting
thread is here[2].
The proposal received 4 approving votes, 3 of which are binding:
- Weijie Guo (binding)
- Junrui Lee (binding)
- Xintong Song (binding)
- Yuepeng Pan
And there is no disapproving one.
Thanks to a
26 matches
Mail list logo
