DataFlow Template error - SDK not reporting number of elements processed

2023-01-10 Thread Patrick McQuighan via user
user@beam.apache.org Hi, I recently started encountering a strange error where a Dataflow job launched from a template never completes, but runs when launched directly. The template has been in use since Dec 14 without issue, but trying to recreate the template today (or the past week) and execut

Re: DataFlow Template error - SDK not reporting number of elements processed

2023-01-10 Thread Bruno Volpato via user
Hi Patrick, I have a few questions that might help troubleshoot this: Did you use the same SDK? Have you updated Beam or any other dependencies? Are there any other error logs (prior to the trace above) that could help understand it? Do you still have the previous template so you can compare the