Yes,
kafka connect supports topics.regex option for Sink connectors. The
connector automatically discovers new topics which fit the regex pattern.
It's similar with source connectors, which discover tables in a SQL
database and save them to Kafka topics.
czw., 5 lis 2020 o 04:16 Jark Wu napisał(
Yes. The dynamism might be a problem.
Does Kafka Connect support discovering new tables and synchronizing them
dynamically?
Best,
Jark
On Thu, 5 Nov 2020 at 04:39, Krzysztof Zarzycki
wrote:
> Hi Jark, thanks for joining the discussion!
> I understand your point of view that SQL environment is p
Hi Jark, thanks for joining the discussion!
I understand your point of view that SQL environment is probably not the
best for what I was looking to achieve.
The idea of a configuration tool sounds almost perfect :) Almost , because:
Without the "StatementSet" that you mentioned at the end I would b
Hi Krzysztof,
This is a very interesting idea.
I think SQL is not a suitable tool for this use case, because SQL is a
structured query language
where the table schema is fixed and never changes during job running.
However, I think it can be a configuration tool project on top of Flink
SQL.
The
Hi community, I would like to confront one idea with you.
I was thinking that Flink SQL could be a Flink's answer for Kafka Connect
(more powerful, with advantages like being decoupled from Kafka). Flink SQL
would be the configuration language for Flink "connectors", sounds great!.
But one thing d
