Inserting datastore projected queries in Postgresql

2018-11-13 Thread Jonathan Perron
Hello fellow Apache Beam users, I am trying to copy datastore entities to a PostgreSQL instance. As I don't need each fields, I performed projections following [this snippet][1]. I build the following query:     public static Query DatastoreQuery() {     Query.Builder query = Query.newBui

Re: [Need advices] Troubles to create custom PTransform in Python

2018-10-01 Thread Jonathan Perron
01/10/2018 à 15:32, Abhijit Chanda a écrit : Further refer beam documentation on design-your-pipeline <https://beam.apache.org/documentation/pipelines/design-your-pipeline/> *From: *Abhijit Chanda *Date: *Monday, 1 October 2018 at 6:58 PM *To: *Jonathan Perron , "user@beam

Fwd: [Need advices] Troubles to create custom PTransform in Python

2018-10-01 Thread Jonathan Perron
Hello everybody, I am new with Apache Beam and I need some advices on own to write properly a custom PTransform in Python. I try to read entities from a PostgreSQL database using SQLAlchemy. I followed the examples in the documentation for Pub/Sub (https://beam.apache.org/documentation/sdks