Re: Waiting for a signal on one stream to start processing on another

2023-03-09 Thread Ioannis Polyzos
If I understand this correctly *Stream A *should be a changelog stream and *Stream B *an append-only stream. Then you want to use *Stream A* as a *lookup Table *for *Stream B?* I don't think there is an out-of-the box way for saying - start reading StreamB only after I have read up to this point fr

GCS setup

2023-02-06 Thread Ioannis Polyzos
Im trying to set up my Flink cluster to store checkpoints on GCS - just a basic docker setup. per the instructions I add the gcs jar file and also export as env variable my credentials file path. *GOOGLE_APPLICATION_CREDENTIALS=/opt/flink/my-keys-sa.json* I also specify the checkpoints dir inside *