Figured it out. Basically you cannot log inside the getSplitBacklogBytes()
method and get it to show in the UnboundedSource.Read log stack and could not
figure out another way to get at this logs. So I added stats in this method
and dumped the stats periodically in the advance() method to get
Does anyone actually use Streaming Autoscaling with cloud Dataflow? I have
seen scale-ups based on CPU but never on backlog. Now I do not see scale up
events at all. If this works can you please point me to a working example.
On 2019/01/09 20:09:46, Ken Barr wrote:
> Hello
>
> I have been
