[
https://issues.apache.org/jira/browse/BEAM-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223969#comment-17223969
]
Udi Meiri commented on BEAM-7763:
---------------------------------
>From what I can tell the same code is still there:
>https://github.com/apache/beam/blob/168d442314a3bd012eedf2915d1aaef7f4092bdc/sdks/python/apache_beam/runners/direct/transform_evaluator.py#L688
Your LOCAL_TEXT_FILE should have more than 10 lines, preferably 100s. The
client reads 10 messages at a time.
It could be that newer versions of google-cloud-pubsub or google-cloud-core
have changed their backend and no longer use oauth2client. (deprecated:
https://github.com/googleapis/oauth2client/releases)
I think we can close this as not reproducible.
> Python DirectRunner _PubSubReadEvaluator creates new client per bundle
> ----------------------------------------------------------------------
>
> Key: BEAM-7763
> URL: https://issues.apache.org/jira/browse/BEAM-7763
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: Udi Meiri
> Priority: P3
> Labels: easy
>
> Lots of credential fetches.
> Similar to https://issues.apache.org/jira/browse/BEAM-2264
> but in this case the DirectRunner implementation seems to be creating a new
> client for each bundle:
> https://github.com/apache/beam/blob/d5d7a7b7d0408d8435031e7bfce1abe2227115f5/sdks/python/apache_beam/runners/direct/transform_evaluator.py#L474
> From:
> https://stackoverflow.com/questions/57010426/dataflow-access-to-pubsub-access-tokens
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
