Re: BigQuery connector debugging

2022-04-06 Thread Martijn Visser
Hey Matthew, Thanks also for sharing the code that you're working on. What are your plans with the connector? I could imagine that others would also be interested, so perhaps you wanted to add it to https://flink-packages.org/ ? Best regards, Martijn Visser https://twitter.com/MartijnVisser82 ht

Re: BigQuery connector debugging

2022-04-05 Thread Matthew Brown
Thanks Robert! All working now. Turns out an incorrect log4j2 configuration was slurping up a warning about converting org.apache.avro.util.Utf8 to the internal flink data type. I've drawn some inspiration from flink-avro and added a converter that converts and re-orders the Avro encoded BigQuery

Re: BigQuery connector debugging

2022-04-05 Thread Robert Metzger
Hi Matt, At first glance your code looks fine. I guess you'll need to follow the codepaths more with the debugger. Have you made sure that "reachedEnd()" returns false? On Tue, Apr 5, 2022 at 9:42 AM Matthew Brown wrote: > Hi all, > > I'm attempting to build a Table API connector for BigQuery