Hi There,

I am implementing a beam pipeline,which is reading events from pub-sub and
using sliding windowing and then combinegloblally. The thing is that I am
not able to test my pipeline on local machine. below is the code sample. I
am not able to feed event_out to event_fi my pipeline gets frozen on
events_out means it produces event_out output on screen and from there it
doesn't process anything it just stuck on the screen.

event_out = event | "Windowing"
>> beam.WindowInto(
window.SlidingWindows(60 * 60, 10),
trigger=Repeatedly(AfterAny(AfterProcessingTime(10))),
allowed_lateness=0,
accumulation_mode=AccumulationMode.DISCARDING,
)
| "Combine-globally"
>> beam.CombineGlobally(
lambda e, t: get_agg(
e, t
),
t=t
).without_defaults()
)

event_fi = (
records
| "mapping"
>> beam.FlatMap(
fun1, rights=beam.pvalue.AsIter(event_out)
)
| beam.Map(print)
)




Any suggestions or help would be appreciated.

Reply via email to