Re: Best way to load heavy object into memory on nodes (python sdk)

2017-05-25 Thread Ahmet Altay
Awesome! I will remember your offer next time I visit Stockholm :) On Thu, May 25, 2017 at 1:48 PM, Vilhelm von Ehrenheim < vonehrenh...@gmail.com> wrote: > Wow! That answer truly solved my problem. I would have never thought of > using threading.local for this. Thank you so much! If you ever sto

Re: Best way to load heavy object into memory on nodes (python sdk)

2017-05-25 Thread Vilhelm von Ehrenheim
Wow! That answer truly solved my problem. I would have never thought of using threading.local for this. Thank you so much! If you ever stop by Stockholm I'll be happy to buy you guys a beer! On Wed, May 24, 2017 at 6:38 PM, Ahmet Altay wrote: > You can see an example implementation of Luke's su

Re: Problem when trying to specify the runner in examples

2017-05-25 Thread Claire Yuan
Thanks for helping with running the examples command! Claire On Wednesday, May 24, 2017 10:46 PM, Jean-Baptiste Onofré wrote: Hi, you have to provide the profile: -Pflink-runner. Regards JB On 05/24/2017 11:35 PM, Claire Yuan wrote: > Hi all, >    When I tried specify the runner in c

Re: Getting "Unable to find registrar for c" error

2017-05-25 Thread Lukasz Cwik
I'm all out of suggestions at this point beyond doing one of the following: * contributing a fix * up vote and watch the windows integration issue: https://issues.apache.org/jira/browse/BEAM-2299 On Thu, May 25, 2017 at 1:48 AM, Shuangyin Ge wrote: > BTW, what I see in the folder structure after

Re: Make runner implementation smoother?

2017-05-25 Thread Jean-Baptiste Onofré
Got your points ;) I think a first step would be kind of "runner author guide" documentation. Kenn created the corresponding Jira already. While writing this guide, I'm pretty sure we would find some improvements ;) Thanks buddy. Talk to you on private message about my wip on runners. Regards J

Re: Make runner implementation smoother?

2017-05-25 Thread Romain Manni-Bucau
2017-05-25 7:42 GMT+02:00 Jean-Baptiste Onofré : > Hi Romain, > > 1. A runner has to implement the 5 (or 6 depending how we count) > primitives. It's the purpose of Runner API (the Fn API is more to deal with > SDKs in the runner). So, the Runner API is kind of adapter, and it > implements all oth

Re: Getting "Unable to find registrar for c" error

2017-05-25 Thread Shuangyin Ge
BTW, what I see in the folder structure after running the below command, mvn compile exec:java -P direct-runner -D exec.mainClass=org.apache.beam.examples.WordCount -D exec.args="--inputFile=pom.xml --output=counts" is C:\Users\ges\Workspace\word-count-beam>dir Volume in drive C has no label.

Re: Getting "Unable to find registrar for c" error

2017-05-25 Thread Shuangyin Ge
I used "mvn compile exec:java -P direct-runner -D exec.mainClass=org.apache.beam.examples.WordCount -D exec.args="--inputFile=C%3A/users/ges/workspace/word-count-beam/pom.xml --output=counts"" however got a "NOT FOUND" error. It didn't create any temp files yet. [ERROR] Failed to execute goal org.