RE: Streaming SQL support for redis streaming connector

2021-09-16 Thread Osada Paranaliyanage
Thanks, will have a look through! -Original Message- From: Yangze Guo Sent: Wednesday, September 15, 2021 11:25 AM To: Osada Paranaliyanage Cc: David Morávek ; user@flink.apache.org Subject: Re: Streaming SQL support for redis streaming connector [EXTERNAL EMAIL] This email has been

RE: Streaming SQL support for redis streaming connector

2021-09-16 Thread Osada Paranaliyanage
: Streaming SQL support for redis streaming connector [EXTERNAL EMAIL] This email has been received from an external source - please review before actioning, clicking on links, or opening attachments. Hi, Osada Just want to offer some material here.The flink-cdc-connectors project [1] maybe also help you

Re: Streaming SQL support for redis streaming connector

2021-09-15 Thread Leonard Xu
Hi, Osada Just want to offer some material here.The flink-cdc-connectors project [1] maybe also help you, we supports the document db MongoDB[2] recently. Best, Leonard [1] https://github.com/ververica/flink-cdc-connectors [2] https://verve

Re: Streaming SQL support for redis streaming connector

2021-09-14 Thread Yangze Guo
use > as redis) > > > > Thanks, > > Osada. > > > > From: David Morávek > Sent: Tuesday, September 14, 2021 7:53 PM > To: Osada Paranaliyanage > Cc: user@flink.apache.org > Subject: Re: Streaming SQL support for redis streaming connector > > > > [EXTER

RE: Streaming SQL support for redis streaming connector

2021-09-14 Thread Osada Paranaliyanage
the WITH clause as redis) Thanks, Osada. From: David Morávek Sent: Tuesday, September 14, 2021 7:53 PM To: Osada Paranaliyanage Cc: user@flink.apache.org Subject: Re: Streaming SQL support for redis streaming connector [EXTERNAL EMAIL] This email has been received from an external source

Re: Streaming SQL support for redis streaming connector

2021-09-14 Thread David Morávek
Hi Osada, in theory building a Redis table from "CDC stream" should definitely be doable. Unfortunately Flink currently doesn't have any official Redis Sink for the Table API and there is currently no on-going effort for adding it, so it would need to be implemented first. The resulting syntax wou

Streaming SQL support for redis streaming connector

2021-09-14 Thread Osada Paranaliyanage
Hi All, We are looking to use flink to build a materialized view of a relation db and a document db using cdc streams. For this purpose we would like to use redis for hosting the materialized view. Can we do this in streaming SQL? We have worked through https://github.com/ververica/flink-sql-CDC