Re: Backup event from Kafka to S3 in parquet format every minute

2023-02-22 Thread Lydian
I've tested the same window, trigger, allowed_lateness nothing seems to work. I think the main issue is in the writerimpl which I linked earlier. https://github.com/apache/beam/blob/v2.41.0/sdks/python/apache_beam/io/iobase.py#L1033 According to the doc: > Currently only batch workflows support c

Re: Beam SQL Alias issue while using With Clause

2023-02-22 Thread Talat Uyarer via user
Hi @Andrew Pilloud Sorry for the late response. Yes your test is working fine. I changed the test input structure like our input structure. Now this test also has the same exception. Feb 21, 2023 2:02:28 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel INFO: SQL: W