Sebastian Mattheis created FLINK-28853:
--
Summary: FLIP-217 Support watermark alignment of source splits
Key: FLINK-28853
URL: https://issues.apache.org/jira/browse/FLINK-28853
Project: Flink
Hi everybody,
I'm happy to let you know that FLIP-217 [1] for implementing "Support
watermark alignment of source splits" has been accepted [2] with 4 positive
votes (with 3 binding) and no negative vote:
- Mason Chen (non-binding)
- Thomas Weise (binding)
- Martijn Visser (binding)
- Piotr Nowoj
Hi everyone,
I would like to start the vote for FLIP-217 [1]. Thanks for your feedback
and the discussion in [2].
FLIP-217 is a follow-up on FLIP-182 [3] and adds support for watermark
alignment of source splits.
The poll will be open until August 4th, 8.00AM GMT (72h) unless there is a
binding
+source+splits
[2] https://github.com/smattheis/flink/tree/flip-217-split-wm-alignment
On Mon, Jul 25, 2022 at 9:19 AM Piotr Nowojski wrote:
> Thanks for the update Sebastian :)
>
> Best,
> Piotrek
>
> pon., 25 lip 2022 o 08:12 Sebastian Mattheis
> napisał(a):
>
>> H
ompared with the
> "coarse.grained.wm.alignment.enabled" option.
> >
> > BTW, the SourceOperator doesn't need to invoke the pauseOrResumeSplit()
> method and catch the UnsupportedOperation every time. A flag can be set so
> it doesn't attempt to pause the sp
alignment. This sounds like a global thing, and it seems not necessary to
> disable the split alignment, as long as the coarse grained alignment can be
> a fallback.
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> On Wed, Jul 13, 2022 at 2:46 PM Sebastian Mattheis <
> sebast...@ververi
seems to me like the current FLIP and
> implementation proposal would always throw an exception in that case?
>
> Best,
> Piotrek
>
> wt., 12 lip 2022 o 10:18 Sebastian Mattheis
> napisał(a):
>
> > Hi all,
> >
> > I have updated FLIP-217 [1] to the proposed
current Flink API is.
> b) We tell the source developers, please implement pausable splits,
> otherwise bad things may happen. Think of it like you are expected to
> implement SourceReader#snapshotState() properly, otherwise exceptions will
> be thrown when users enable checkpointing.
>> > > >> interfaces
>> > > >> > are valid. (...)
>> > > >> > In the future, if there is a new feature added
>> > > >> > (e.g. sorted or pre-partitioned data aware), are we going to
>> create
>> > &g
(Becket) Qin
>
> On Thu, Apr 21, 2022 at 11:39 PM Steven Wu
><
> stevenz...@gmail.com> <
> stevenz...@gmail.com> wrote:
>
> However, a single source operator may read data from multiple
>
> splits/partitions, e.g., multiple Kafka partitions, such th
Sebastian Mattheis created FLINK-27388:
--
Summary:
PulsarSourceEnumeratorTest#discoverPartitionsTriggersAssignments seems flaky
Key: FLINK-27388
URL: https://issues.apache.org/jira/browse/FLINK-27388
Dear Flink developers,
I would like to open a discussion on FLIP 217 [1] for an extension of
Watermark Alignment to perform alignment also in SplitReaders. To do so,
SplitReaders must be able to suspend and resume reading from split sources
where the SourceOperator coordinates and controlls suspen
Sebastian Mattheis created FLINK-26910:
--
Summary: flink-benchmarks build fails on Apple M1 silicon
Key: FLINK-26910
URL: https://issues.apache.org/jira/browse/FLINK-26910
Project: Flink
Sebastian Mattheis created FLINK-26279:
--
Summary: Provide mailbox delay metric
Key: FLINK-26279
URL: https://issues.apache.org/jira/browse/FLINK-26279
Project: Flink
Issue Type: New
Sebastian Mattheis created FLINK-26176:
--
Summary: Scala savepoint migration tests don't run as configured
(not testing RocksDB savepoints)
Key: FLINK-26176
URL: https://issues.apache.org/jira/browse/
15 matches
Mail list logo
