Re: PaneInfo showing UNKOWN State

2020-05-28 Thread Jay
Also, note that I observed similar behaviour with DataflowRunner. On Thu, 28 May 2020 at 21:24, Jay wrote: > I was trying to simulate the PaneInfo in Python to check for parity with > the Java SDK. I was able to get PaneInfo after introduction a CombinePerKey. > I am not sure why GBK operation i

Re: PaneInfo showing UNKOWN State

2020-05-28 Thread Jay
I was trying to simulate the PaneInfo in Python to check for parity with the Java SDK. I was able to get PaneInfo after introduction a CombinePerKey. I am not sure why GBK operation is returning the correct information. On Wed, 27 May 2020 at 00:54, Robert Bradshaw wrote: > To clarify, PaneInfo

Re: PaneInfo showing UNKOWN State

2020-05-26 Thread Robert Bradshaw
To clarify, PaneInfo is supported on the FnAPI local runner, but not on the bundle based one. Unfortunately, Streaming is not supported on the FnAPI one (yet), but work there is ongoing. On Tue, May 26, 2020 at 11:46 AM Pablo Estrada wrote: > Hi Jayadeep, > Unfortunately, it seems that PaneInfo

Re: PaneInfo showing UNKOWN State

2020-05-26 Thread Pablo Estrada
Hi Jayadeep, Unfortunately, it seems that PaneInfo is not well supported yet on the local runners: https://issues.apache.org/jira/browse/BEAM-3759 Can you share more about your use case, and what you'd like to do with the PaneInfo? On Sat, May 23, 2020 at 10:03 AM Jay wrote: > Hi All - > > Belo

PaneInfo showing UNKOWN State

2020-05-23 Thread Jay
Hi All - Below is a sample code written in Python which reads data from Pub/Sub and tries to determine the PaneInfo for different elements There are 3 rows of data as shown below {"country":"USA","user_id": 1,"ts": 0}, > {"country":"USA","user_id": 2,"ts": 0}, > {"country":"USA","user_id": 3,"ts