Re: sudden problems in running a test pipieline

2022-12-09 Thread Sofia’s World
Hello indeed i found something quite interesting Below is the full stack trace in module *\sector_loader.py:33: , * which i am importing at the top of my unittest, i am declaring this class class XyzOptions(PipelineOptions): @classmethod def _add_argparse_args(cls, parser): par

Re: clear State using business logic

2022-12-09 Thread Reza Ardeshir Rokni
Have you explored processing time timers? https://beam.apache.org/releases/javadoc/2.43.0/org/apache/beam/sdk/state/TimeDomain.html#PROCESSING_TIME On Wed, 23 Nov 2022 at 13:46, Sigalit Eliazov wrote: > Hi all, > > the flow in our pipeline is: > > 1. read event X from kafka. open fixed window o