Re: Copying tar.gz libraries to apache-beam workers

Thank you. I should have realized this flag. Stay safe Best, Eila On Mon, Apr 20, 2020 at 12:42 PM Luke Cwik wrote: > It looks like anaconda assumes that the directory doesn't exist before > installation. I would recommend using a new directory such as > ["/opt/userowned/anaconda.sh", "-b","-p"

Re: Copying tar.gz libraries to apache-beam workers

It looks like anaconda assumes that the directory doesn't exist before installation. I would recommend using a new directory such as ["/opt/userowned/anaconda.sh", "-b","-p","/opt/userowned/anaconda/"] but if you really want it to be in "/opt/userowned", you should add "-f": ["/opt/userowned/anacon

Re: Copying tar.gz libraries to apache-beam workers

Thank you. I was able to tar my libraries at the /opt/userowned fodler. I am using setup.py from this url (recommended your apache-beam documentation) https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/complete/juliaset/setup.py Last, I want to install anaconda. I have a l

Re: Copying tar.gz libraries to apache-beam workers

On Dataflow you should be able to use /opt/userowned On Fri, Apr 17, 2020 at 9:01 AM OrielResearch Eila Arich-Landkof < e...@orielresearch.org> wrote: > See inline > > > — > Eila > www.orielesearch.com > https://www.meetu > p.co

Re: Copying tar.gz libraries to apache-beam workers

See inline — Eila www.orielesearch.com https://www.meetup.com/Deep-Learning-In-Production Sent from my iPhone > On Apr 17, 2020, at 11:32 AM, Luke Cwik wrote: > >  > When you said you checked '/usr/local/', did you check inside the docker > container or on the VM itself? Yes. Checked as

Re: Copying tar.gz libraries to apache-beam workers

When you said you checked '/usr/local/', did you check inside the docker container or on the VM itself? Have you tried adding an echo command before and after your script runs and looked for them in the stackdriver logs? It should help you locate any errors that might have happened when executing