[ 
https://issues.apache.org/jira/browse/BEAM-6745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16777333#comment-16777333
 ] 

Robert Burke commented on BEAM-6745:
------------------------------------

Obligatory reminder that Dataflow doesn't support the Go SDK at this time. 
Thank you for the issue!

My gut instinct is that the worker_harness_container_image indicated is very 
old and might need to be updated/rebuilt. 
Please see [https://github.com/apache/beam/blob/master/sdks/CONTAINERS.md] for 
instructions on how to build your own, and use that.

> Cannot run pipeline on Dataflow (GO SDK)
> ----------------------------------------
>
>                 Key: BEAM-6745
>                 URL: https://issues.apache.org/jira/browse/BEAM-6745
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-dataflow, sdk-go
>            Reporter: Michael Chemani
>            Priority: Major
>
> I got 
> ```
> {{Failed to retrieve staged files: failed to retrieve worker in 3 attempts: 
> bad MD5 for /var/opt/google/staged/worker: d79JZxFttnJG7SPkF30ozA==, want ; 
> bad MD5 for /var/opt/google/staged/worker: d79JZxFttnJG7SPkF30ozA==, want ; 
> bad MD5 for /var/opt/google/staged/worker: d79JZxFttnJG7SPkF30ozA==, want ; 
> bad MD5 for /var/opt/google/staged/worker: d79JZxFttnJG7SPkF30ozA==, want}}
> ```
>  
> When trying to run 
> ```
> {{dataflow \ --runner dataflow \ --index gs://\{BUCKET}/data_100k.csv \ 
> --output gs://\{BUCKET}/ \ --project {PROJECT} \ --temp_location 
> gs://\{BUCKET}/tmp/ \ --staging_location gs://\{BUCKET}/binaries/ \ 
> --worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515}}
> ```



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to