Re: [Question] [CassandraIO]Using a query

2023-02-07 Thread Vincent Marquez
I've not used the BigTable writer, but It should be just creating a function that takes a MyClass and converts it to an Iterable, then calling that from a DoFn you create and outputting the resulting Iterable to the OutputReceiver. Then your pipeline would be something like pipeline.apply(Cassand

Re: [Question] [CassandraIO]Using a query

2023-02-07 Thread Adam Scott
Thank you Vincent! Thanks for the quick response! The goal is to read from a Cassandra query and write to a Bigtable table. I've tried combining this technique, below, with the test examples you pointed out. But I am afraid my efforts were wholly naive. https://github.com/GoogleCloudPlatform/Dat

Re: [Question] [CassandraIO]Using a query

2023-02-03 Thread Vincent Marquez
There are some examples in the test code that should be easy enough to follow. Here is an example of just querying the entire table: https://github.com/apache/beam/blob/master/sdks/java/io/cassandra/src/test/java/org/apache/beam/sdk/io/cassandra/CassandraIOTest.java#L460 Here's an example of usi

[Question] [CassandraIO]Using a query

2023-02-03 Thread Adam Scott
HI All, does anyone have an example of using CassandraIO to query a table? The following mentions "Alternatively, one may use CassandraIO.readAll() .withCoder(SerializableCoder.of(Person.class)) to query a subset of the Cassandra database by creating a PCollection of CassandraIO.Read each with th