writeVoid() and write() plus withResults() return the same PCollection
AFAIK. In any case i updated the code and same thing happens
PCollection result = p.
apply("Pubsub",
PubsubIO.readMessagesWithAttributes().fromSubscription(String.format("projects/%s/subscriptions/%s",
optio
The other problem you have here is that you have not set a window. Wait.on
waits for the end of the current window before triggering. The default
Window is the GlobalWindow, so as written Wait.on will wait for the end of
time (or until you drain the pipeline, which will also trigger the
GlobalWindo
Same result:
PCollection result = p
.apply("Pubsub",
PubsubIO.readMessagesWithAttributes().fromSubscription(String.format("projects/%s/subscriptions/%s",
options.getProjectId(), subscription)))
.apply("Transform", ParDo.of(new MyTransformer()))
.app
Can some one please remove me from this mailing list
Hi Unais,
If you want to unsubscribe from this mailing list, you need to send a blank
email to user-unsubscr...@beam.apache.org.
On Sat, Apr 22, 2023 at 12:54 PM Unais T wrote:
> Can some one please remove me from this mailing list
What runner are you using to run this pipeline?
On Sat, Apr 22, 2023 at 9:47 AM Juan Cuzmar wrote:
> Same result:
> PCollection result = p
> .apply("Pubsub",
> PubsubIO.readMessagesWithAttributes().fromSubscription(String.format("projects/%s/subscriptions/%s",
> options.getProjec
I'm developing with direct runner. but should go to dataflow when deployed.
Original Message
On Apr 22, 2023, 13:13, Reuven Lax via user wrote:
> What runner are you using to run this pipeline?
>
> On Sat, Apr 22, 2023 at 9:47 AM Juan Cuzmar wrote:
>
>> Same result:
>> PCollect
Oh - in that case it's possible that the problem may be the direct runner's
implementation of the pubsub source - especially the watermark. For a
direct-runner test, I recommend using TestStream (which allows you to
advance the watermark manually, so you can test windowing).
On Sat, Apr 22, 2023 a
I see. if you don't mind could you give me an example? i am not very
knowledgeable in apache beam.
Original Message
On Apr 22, 2023, 13:39, Reuven Lax via user wrote:
> Oh - in that case it's possible that the problem may be the direct runner's
> implementation of the pubsub s
