Hi John,
Thank you for your valuable input. It sounds reasonable to me.
>From this point of view, the exactly-once is used to guarantee transaction
semantics other than avoid duplication/upserts.
This is similar to the JDBC connectors that already support eventual
consistency with idempotent upda
+1 (binding)
- tried out the kinesis sql binary with sql client
- staging binaries look fine
On Mon, Apr 3, 2023 at 10:12 PM Elphas Tori wrote:
> +1 (non-binding)
>
> + verified hashes and signatures
> + checked local build of website pull request and approved
>
> On 2023/04/03 16:19:00 Danny C
Hi Yun,
I reorganized our discussion and added a comparison table of state
ownership with some previous designs. Please take a look at section
"4.9. State ownership comparison with other designs".
But I don't see them as alternatives since the design of state
ownership is integrated with this FLI
+1 (non binding)
On Tue, 4 Apr 2023 at 1:42 AM, Elphas Tori wrote:
> +1 (non-binding)
>
> + verified hashes and signatures
> + checked local build of website pull request and approved
>
> On 2023/04/03 16:19:00 Danny Cranmer wrote:
> > Hi everyone,
> > Please review and vote on the binaries for
Matthias Pohl created FLINK-31776:
-
Summary: Introducing sub-interface
LeaderElectionService.LeaderElection
Key: FLINK-31776
URL: https://issues.apache.org/jira/browse/FLINK-31776
Project: Flink
Alvin Ge created FLINK-31777:
Summary: Upsert Kafka use Avro Confluent, key is ok, but all
values are null.
Key: FLINK-31777
URL: https://issues.apache.org/jira/browse/FLINK-31777
Project: Flink
Ilya Soin created FLINK-31778:
-
Summary: Casting array of rows produces incorrect result
Key: FLINK-31778
URL: https://issues.apache.org/jira/browse/FLINK-31778
Project: Flink
Issue Type: Bug
Weijie Guo created FLINK-31779:
--
Summary: Track stable branch of externalized connector instead of
specific release tag
Key: FLINK-31779
URL: https://issues.apache.org/jira/browse/FLINK-31779
Project: Fl
Oleksandr Nitavskyi created FLINK-31780:
---
Summary: Allow users to enable Ensemble tracking for ZooKeeper
Key: FLINK-31780
URL: https://issues.apache.org/jira/browse/FLINK-31780
Project: Flink
Matthias Pohl created FLINK-31782:
-
Summary: Make DefaultLeaderElectionService implement
MultipleComponentLeaderElectionService.Listener
Key: FLINK-31782
URL: https://issues.apache.org/jira/browse/FLINK-31782
Matthias Pohl created FLINK-31781:
-
Summary: Introduce contender ID into LeaderElectionService
interface
Key: FLINK-31781
URL: https://issues.apache.org/jira/browse/FLINK-31781
Project: Flink
Matthias Pohl created FLINK-31783:
-
Summary: Replace LeaderElectionDriver in
DefaultLeaderElectionService with MultipleComponentLeaderElectionService
Key: FLINK-31783
URL: https://issues.apache.org/jira/browse/FLI
Matthias Pohl created FLINK-31784:
-
Summary: Add multiple-component support to
DefaultLeaderElectionService
Key: FLINK-31784
URL: https://issues.apache.org/jira/browse/FLINK-31784
Project: Flink
Matthias Pohl created FLINK-31785:
-
Summary: Move LeaderElectionService out of LeaderContender
Key: FLINK-31785
URL: https://issues.apache.org/jira/browse/FLINK-31785
Project: Flink
Issue Typ
Matthias Pohl created FLINK-31786:
-
Summary: Removing unused HighAvailabilityServices implementations
Key: FLINK-31786
URL: https://issues.apache.org/jira/browse/FLINK-31786
Project: Flink
Is
Aitozi created FLINK-31787:
--
Summary: Add the explicit ROW constructor to the system function
doc
Key: FLINK-31787
URL: https://issues.apache.org/jira/browse/FLINK-31787
Project: Flink
Issue Type:
Which connectors would be commonly used when reading in Arrow format?
Filesystem?
On Wed, Apr 12, 2023 at 4:27 AM Jacky Lau wrote:
> Hi
>I also think arrow format will be useful when reading/writing with
> message queue.
>Arrow defines a language-independent columnar memory format for f
Feng Jin created FLINK-31788:
Summary: Add back Support emitValueWithRetract for
TableAggregateFunction
Key: FLINK-31788
URL: https://issues.apache.org/jira/browse/FLINK-31788
Project: Flink
Iss
Morey Straus created FLINK-31789:
Summary: Update axel to current
Key: FLINK-31789
URL: https://issues.apache.org/jira/browse/FLINK-31789
Project: Flink
Issue Type: Bug
Affects Versions:
Hi Feng,
Thanks for raising this FLIP. I am still confused after completely reading
the thread with following questions:
1. Naming confusion - registerCatalog() and addCatalog() have no big
difference based on their names. One of them is responsible for data
persistence. How about persistCatalog(
Hello!
I have a use case for the mongodb connector (see:
https://github.com/apache/flink-connector-mongodb), but I am currently
running flink 1.15. As far as I can tell, the connector relies on
dependencies that don't exist in 1.15 (one such example is
`org/apache/flink/table/connector/source/look
Hello there,
Zhu: agree with the config option, great suggestion
Hong: global timeout is also interesting and a good addition -- only
downside I see is just another config option
If everyone is happy, I suggest we keep the discussion open until Friday
and start a Vote shortly after.
Cheers,
Pana
Hi everyone,
Please review and vote on release candidate #2 for version 3.0.0 of the
Apache Flink Kafka Connector, as follows:
[ ] +1, Approve the release
[ ] -1, Do not approve the release (please provide specific comments)
The complete staging area is available for your review, which includes:
A few important remarks about this release candidate:
- As mentioned in the previous voting thread of RC1 [1], we've decided to
skip releasing a version of the externalized Flink Kafka Connector matching
with Flink 1.16.x since the original vote thread stalled, and meanwhile
we've already complete
RC2 (for Flink 1.17.0) vote has started in a separate thread:
https://lists.apache.org/thread/mff76c2hzcb1mk8fm5m2h4z0j73qz2vk
Please test and cast your votes!
On Tue, Apr 11, 2023 at 11:45 AM Martijn Visser
wrote:
> +1, thanks for driving this Gordon.
>
> On Tue, Apr 11, 2023 at 8:15 PM Tzu-Li
Hi Feng
Thanks for your update.
I found there are two options in `Proposed Changes`, can you put the
unselected option in `Rejected Alternatives`? I think this may help us
better understand your proposal
Best,
Shammon FY
On Thu, Apr 13, 2023 at 4:49 AM Jing Ge wrote:
> Hi Feng,
>
> Thanks f
>From the pom[1] of the connector, it seems it's compatible with Flink 1.17.
[1] https://github.com/apache/flink-connector-mongodb/blob/main/pom.xml#L56
Best regards,
Yuxia
- 原始邮件 -
发件人: "Saketh Kurnool"
收件人: "dev"
发送时间: 星期四, 2023年 4 月 13日 上午 5:27:06
主题: [mongodb connector] which flink
Hi Jark, John,
Thank you for the discussion! I will proceed with completing the patch that
adds exactly-once to upsert-kafka connector.
Best,
Alexander
On Wed, Apr 12, 2023 at 12:21 AM Jark Wu wrote:
> Hi John,
>
> Thank you for your valuable input. It sounds reasonable to me.
>
> From this po
Oh, correct what I said.
The version of released connector jars on Maven central has the supported Flink
version as suffix.
For the case of the mongodb connector with version 1.0.0-1.16[1], it should be
compatible with Flink 1.16.
[1]
https://central.sonatype.com/artifact/org.apache.flink/fli
Hi, devs.
I'd like to start a discussion about to EncodingFormat and DecondingFormat
provide copy API, which relate to FLINK-31686 [1].
Current, DecodingFormat doesn't support copy(), which makes the DecodingFormat
resued after filter/projection is pushed down. The EncodingFormat has the sam
Hi, Mang
Atomicity is very important for CTAS, especially for batch jobs. This FLIP
is a continuation of FLIP-218, which is valuable for CTAS.
I just have one question, in the Motivation part of FLIP-218, we mentioned
three levels of atomicity semantics, can this current design do the same as
Spark
Aitozi created FLINK-31790:
--
Summary: Filesystem batch sink should also respect to the
PartitionCommitPolicy
Key: FLINK-31790
URL: https://issues.apache.org/jira/browse/FLINK-31790
Project: Flink
I
Hi Saketh
Hi Saketh,
As yuxia said, currently the mongodb connector 1.0.0 is compatible with flink
1.16.
Some compatibility fixes have been made recently to make it compatible with
flink 1.17, but it has not been released yet.
Best,
Jiabao
> 2023年4月13日 上午9:36，yuxia 写道：
>
> Oh, correct what
Hi everyone,
FLIP-292 [1] has been accepted and voted through this thread [2].
There are seven approving votes, six of which are binding:
- Lincoln Lee (binding)
- Jing Ge (binding)
- godfrey he (binding)
- Jark Wu (binding)
- Shuo Cheng
- Benchao Li (binding)
- Leonard Xu (
Hi everyone,
I'm going to check out the 0.4 branch out next Monday, and won't merge
major refactoring-related PRs into master branch until next Monday.
Blockers:
- Entire Database Sync CC @Caizhi Weng
- CDC Ingestion mysql DATETIME(6) cast error [1]
- MySqlSyncTableAction should support case igno
Oh sorry to Flink devs,
This email should be sent to paimon dev, please ignore it.
Best,
Jingsong
On Thu, Apr 13, 2023 at 10:56 AM Jingsong Li wrote:
>
> Hi everyone,
>
> I'm going to check out the 0.4 branch out next Monday, and won't merge
> major refactoring-related PRs into master branch un
Jane Chan created FLINK-31791:
-
Summary: FLIP-292: Enhance COMPILED PLAN to support operator-level
state TTL configuration
Key: FLINK-31791
URL: https://issues.apache.org/jira/browse/FLINK-31791
Project:
Hi, xia
Thanks for your explanation, for the first question, given the current
status, I think we can provide the generic interface in the future if we
need it. For the second question, it makes sense to me if we can
support the table cache at the framework level.
Best,
Ron
yuxia 于2023年4月11日周二
Thanks Panagiotis for the update,
the updated FLIP looks good to me.
Best,
Leonard
> On Apr 13, 2023, at 7:42 AM, Panagiotis Garefalakis wrote:
>
> Hello there,
>
> Zhu: agree with the config option, great suggestion
> Hong: global timeout is also interesting and a good addition -- only
>
Hi, Mang
+1 for completing the support for atomicity of CTAS, this is very useful in
batch scenarios.
I have two questions:
1. naming wise:
a) can we rename the `Catalog#getTwoPhaseCommitCreateTable` to
`Catalog#twoPhaseCreateTable` (and we may add
twoPhaseReplaceTable/twoPhaseCreateOrReplaceTa
David Morávek created FLINK-31792:
-
Summary: Errors are not reported in the Web UI
Key: FLINK-31792
URL: https://issues.apache.org/jira/browse/FLINK-31792
Project: Flink
Issue Type: Bug
> Which connectors would be commonly used when reading in Arrow format?
Filesystem?
Currently, yes. The better way is it can be combined used with
different connector,
but I have not figured out how to integrate the Arrow format
deserializer with the
`DecodingFormat` or `DeserializationSchema` int
Hi, xia
> which I think if Flink supports table cache in framework-level,
we can also recache in framework-level for truncate table statement.
I think currently flink catalog already will some stats for the table,
eg: after `ANALYZE TABLE`, the table's Statistics will be stored in
the
catalog,
43 matches
Mail list logo
