Hi Brian,
Thank you for your response.
1. When I annotate the class with @DefaultSchema(JavaFieldSchema.class) and
my constructor with a @SchemaCreate ,I get the following exception:
Caused by: java.lang.IllegalAccessError: tried to access method
ch.ricardo.schemas.data_intelligence.ArticleProto
A bit more context - I started with the Beam documentation and
tried JavaFieldSchema and JavaBeanSchema first, when that didn't work, I
dug deeper and tried to implement the methods myself.
What I also tried is the following class definition:
@DefaultSchema(JavaFieldSchema.class)
public class Enr
I am using sparkRunner on streaming mode. So stateful DoFn is not
supported.
On Sat, 27 Jun, 2020, 7:48 AM Sunny, Mani Kolbe, wrote:
> Hello,
>
>
>
> I am looking to implement Wait.on() pattern to do something after writes
> for each window are done. There are two outputs - one writing using Avr
Hi,
I am working on Beam using Dataflow engine. Recently I am working on reading
spanner data from different project. Say I run my Beam dataflow job in GCP
project A, but the Spanner is in GCP project B. I searched all the documents,
but can't find any documentation about SpannerIO reading dat
If a transform doesn't return something waitable, there is no way to wait
on it.
However:
* AvroIO.write is waitable - if not through AvroIO.write() (I don't
remember off the top of my head), then at least through
FileIO.write().via(AvroIO.sink()).
* KinesisIO.write is *very* easy to change to be w
