[
https://issues.apache.org/jira/browse/BEAM-13532?focusedWorklogId=701415&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-701415
]
ASF GitHub Bot logged work on BEAM-13532:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 28/Dec/21 05:21
Start Date: 28/Dec/21 05:21
Worklog Time Spent: 10m
Work Description: dpcollins-google commented on pull request #16366:
URL: https://github.com/apache/beam/pull/16366#issuecomment-1001875299
Hi Tamir,
Thank you for your contribution to beam. Changes to PubsubIO like this will
not properly work on dataflow jobs, as the dataflow runner replaces Pub/Sub
reads and writes with an internal implementation.
If you want to dynamically dispatch to Pub/Sub Topics for your own
pipelines, you might be able to get this working in the shorter term by writing
a relatively simple DoFn using the Pub/Sub java client library in your code
that identifies the topic from an attribute and publishes to the correct topic.
If this is a feature that you'd like to see added to PubsubIO, I'd suggest
bringing it up on the dev mailing list, where you could coordinate and discuss
this with the owners of the internal runner.
-Daniel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@beam.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 701415)
Time Spent: 20m (was: 10m)
> Pubsub-IO dynamic destination
> -----------------------------
>
> Key: BEAM-13532
> URL: https://issues.apache.org/jira/browse/BEAM-13532
> Project: Beam
> Issue Type: Improvement
> Components: io-java-gcp
> Reporter: tamir
> Priority: P2
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Change topic name to be part of the PubsubMessage and pass it using dynamic
> destinations (like in BigQuery-IO). This will allow writing to new topics
> without restart the job.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
