Flink CDC blog

I wrote up my thoughts on Flink CDC, and would love to get any feedback/corrections: https://www.decodable.co/blog/exploring-flink-cdc thanks, Robin.

Flink CDC operational questions

Are there any resources I can look at regarding the operational side of Flink CDC? e.g. is the Flink web UI the only place to monitor what's going on, or looking through the log files? Can you stop and restart a job or will it trigger a fresh snapshot? etc thanks!

Re: [Flink CDC] What's the difference between Pipeline connectors and Flink Source connectors?

here >>> <https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/overview/> >>> under >>> the main Flink docs? >>> >>> Flink CDC connectors are Flink Table connectors, but specifically for >>> doing CDC. Compare that

[Flink CDC] What's the difference between Pipeline connectors and Flink Source connectors?

I'm struggling to grok the difference between pipeline connectors and Flink sources i

Re: Flink performance

22/01/04/how-we-improved-scheduler-performance-for-large-scale-jobs-part-one/ * https://shopify.engineering/optimizing-apache-flink-applications-tips * https://github.com/apache/flink-benchmarks * https://github.com/aws-samples/amazon-kinesis-data-analytics-flink-benchmarking-utility -- Robin Moffatt

Re: Re: Running Flink SQL in production

gt; Zhanghao Chen > -- > *From:* Feng Jin > *Sent:* Friday, March 8, 2024 9:46 > *To:* Xuyang > *Cc:* Robin Moffatt ; user@flink.apache.org < > user@flink.apache.org> > *Subject:* Re: Re: Running Flink SQL in production > > Hi, > >

Running Flink SQL in production

I'm reading the deployment guide[1] and wanted to check my understanding. For deploying a SQL job into production, would the pattern be to write the SQL in a file that's under source control, and pass that file as an argument to SQL Client with -f argument (as in this docs example[2])? Or script a

[Meta question] Sharing blog posts

Hi, I have a netiquette question - is it ok to share blog posts here that are specific to Apache Flink and not vendor-focussed? thanks, Robin.

DESCRIBE CATALOG not available?

In FLIP-69 [1] it looks like DESCRIBE CATALOG was added, but when I try it from SQL Client in 1.18.1 it doesn't seem to work Flink SQL> SHOW CATALOGS; +-+ |catalog name | +-+ | c_new | | default_catalog | +-+ 2 rows in set Flink SQL> D

Re: Flink SQL exception on using cte

CTEs are supported, you can see an example in the docs [1] [2]. In the latter doc, it also says > CTEs are supported in Views, CTAS and INSERT statement So I'm just guessing here, but your SQL doesn't look right. The CTE needs to return a column called `pod`, and the `FROM` clause for the `SELECT