I was reading the source code of Kafka SQL Source Connector, I noticed that
in DynamicKafkaDeserializationSchema[1], when the schema emits multiple
keys, the code is doing a cartesian product of the key rows and value rows.
I know that in CDC, a format can emit multiple rows (UPDATE_BEFORE and
UPD
oup the same values into one key-value entry. In the terms of
> implementation,
> I think it makes sense to do the cartesian product.
>
> Best,
> Jark
>
> On Mon, 9 May 2022 at 13:57, Yufei Zhang wrote:
>
> > I was reading the source code of Kafka SQL Source Connector, I
+1 (nonbinding)
On Tue, May 17, 2022 at 5:29 PM Márton Balassi
wrote:
> +1 (binding)
>
> On Tue, May 17, 2022 at 11:00 AM Jingsong Li
> wrote:
>
> > Thank Xintong for driving this work.
> >
> > +1
> >
> > Best,
> > Jingsong
> >
> > On Tue, May 17, 2022 at 4:49 PM Martijn Visser >
> > wrote:
>
+1 (non-binding)
Best,
Yufei Zhang
On Fri, May 20, 2022 at 11:24 AM Paul Lam wrote:
> +1 (non-binding)
>
> Best,
> Paul Lam
>
> > 2022年5月20日 10:48，Jark Wu 写道：
> >
> > +1 (binding)
> >
> > Best,
> > Jark
> >
> > On Fri, 20
Hi,
Sorry for any inconvenience and late reply, after some investigation, the
test instabilities are believed to be caused by the newly introduced
PulsarEmbedRuntime, and an alternative to it is to use the
PulsarContainerRuntime
which runs in testcontainer. A pr is being submitted to resolve the
eers.
On Fri, Feb 18, 2022 at 4:34 PM Yufei Zhang wrote:
> Hi,
>
> Sorry for any inconvenience and late reply, after some investigation, the
> test instabilities are believed to be caused by the newly introduced
> PulsarEmbedRuntime, and an alternative to it is to use the
> Pu
Hi Till,
Thank you Till, and good luck in your next chapter :)
Cheers,
Yufei
On Mon, Feb 28, 2022 at 6:59 PM Till Rohrmann wrote:
> Hi everyone,
>
> I wanted to let you know that I will be less active in the community
> because I’ve decided to start a new chapter in my life. Hence, please don’
Hi,
+1 (non-binding)
Very interesting design. I saw a lot of discussion on the generic interface
design, good to know it will address extensibility.
Cheers,
Yufei
On 2021/11/10 02:51:55 Jingsong Li wrote:
> Hi everyone,
>
> Thanks for all the feedback so far. Based on the discussion[1] we s
Congratulations!
Cheers,
Yufei
On Sat, 13 Nov 2021 at 10:10, Yun Gao wrote:
> Congratulations Leonard!
>
> Best,
> Yun
>
>
> --
> Sender:Zakelly Lan
> Date:2021/11/12 21:09:48
> Recipient:
> Theme:Re: [ANNOUNCE] New Apache Flink Co
Hi all,
I noticed there is a Upsert-Kafka SQL Connector[1] and the Kafka SQL
Connector[2], my question is why do we implement them as two different
connectors? For example, why not add a `upsert` config option in the Kafka
SQL connector to specify whether the table enables upsert mode or not. Is
t
Thanks~ Will take a look.
Cheers,
Yufei
On Wed, Aug 24, 2022 at 3:45 PM Jark Wu wrote:
> There was a long discussion about this. You can read the thread[1].
>
> Best,
> Jark
>
> [1]: https://lists.apache.org/thread/sr6on0cq52ns4y3zh6j0x899by80n5zw
>
> On Wed, 24 Aug 20
Yufei Zhang created FLINK-26645:
---
Summary: Pulsar Source subscribe to a single topic partition will
consume all partitions from that topic
Key: FLINK-26645
URL: https://issues.apache.org/jira/browse/FLINK-26645
Yufei Zhang created FLINK-25044:
---
Summary: Add More Unit Test For Pulsar Source
Key: FLINK-25044
URL: https://issues.apache.org/jira/browse/FLINK-25044
Project: Flink
Issue Type: Improvement
Yufei Zhang created FLINK-25686:
---
Summary: Support Pulsar Schema evolution in Pulsar Connector
Key: FLINK-25686
URL: https://issues.apache.org/jira/browse/FLINK-25686
Project: Flink
Issue Type
Yufei Zhang created FLINK-26159:
---
Summary: Pulsar Connector: should add description MAX_FETCH_RECORD
in doc to explain slow consumption
Key: FLINK-26159
URL: https://issues.apache.org/jira/browse/FLINK-26159
Yufei Zhang created FLINK-26160:
---
Summary: Pulsar Connector: stopCursor description should be
changed. Connector only stop when auto discovery is disabled.
Key: FLINK-26160
URL: https://issues.apache.org/jira
Yufei Zhang created FLINK-26161:
---
Summary: Pulsar Connector: edge case: splits should be added to
finishedSplits if was empty from beginning
Key: FLINK-26161
URL: https://issues.apache.org/jira/browse/FLINK-26161
Yufei Zhang created FLINK-26202:
---
Summary: Support Table API in Pulsar Source Connector
Key: FLINK-26202
URL: https://issues.apache.org/jira/browse/FLINK-26202
Project: Flink
Issue Type: New
Yufei Zhang created FLINK-26203:
---
Summary: Support Table API in Pulsar Sink Connector
Key: FLINK-26203
URL: https://issues.apache.org/jira/browse/FLINK-26203
Project: Flink
Issue Type: New
Yufei Zhang created FLINK-24856:
---
Summary: Upgrade SourceReaderTestBase to Use Junit 5
Key: FLINK-24856
URL: https://issues.apache.org/jira/browse/FLINK-24856
Project: Flink
Issue Type
Yufei Zhang created FLINK-24857:
---
Summary: Upgrade SourceReaderTestBase to Use Junit 5
Key: FLINK-24857
URL: https://issues.apache.org/jira/browse/FLINK-24857
Project: Flink
Issue Type
Yufei Zhang created FLINK-29357:
---
Summary: Pulsar Table Sink code: implementation
Key: FLINK-29357
URL: https://issues.apache.org/jira/browse/FLINK-29357
Project: Flink
Issue Type: Sub-task
Yufei Zhang created FLINK-29356:
---
Summary: Pulsar Table Source code :implementation
Key: FLINK-29356
URL: https://issues.apache.org/jira/browse/FLINK-29356
Project: Flink
Issue Type: Sub-task
Yufei Zhang created FLINK-29360:
---
Summary: Pulsar Table Connector Documentation
Key: FLINK-29360
URL: https://issues.apache.org/jira/browse/FLINK-29360
Project: Flink
Issue Type: Sub-task
Yufei Zhang created FLINK-29359:
---
Summary: Pulsar Table Connector pom config and packaging
Key: FLINK-29359
URL: https://issues.apache.org/jira/browse/FLINK-29359
Project: Flink
Issue Type
Yufei Zhang created FLINK-29358:
---
Summary: Pulsar Table Connector testing
Key: FLINK-29358
URL: https://issues.apache.org/jira/browse/FLINK-29358
Project: Flink
Issue Type: Sub-task
Yufei Zhang created FLINK-29390:
---
Summary: Pulsar SQL Connector: SQLClient E2E testing
Key: FLINK-29390
URL: https://issues.apache.org/jira/browse/FLINK-29390
Project: Flink
Issue Type: Sub
Yufei Zhang created FLINK-29696:
---
Summary: [Doc] Operator helm install command points to wrong repo
Key: FLINK-29696
URL: https://issues.apache.org/jira/browse/FLINK-29696
Project: Flink
Issue
29 matches
Mail list logo
