Re: Potential issue with the flink runner in streaming mode

Thanks Boyuan! From: Boyuan Zhang Date: Wednesday, November 25, 2020 at 10:52 AM To: Tao Li Cc: "user@beam.apache.org" , Kyle Weaver Subject: Re: Potential issue with the flink runner in streaming mode Thanks for reporting this issue, Tao. That's all I need for debugging this issue and hopef

Quick question regarding production readiness of ParquetIO

Hi Beam community, According to this link the ParquetIO is still considered experimental: https://beam.apache.org/releases/javadoc/2.25.0/org/apache/beam/sdk/io/parquet/ParquetIO.html Does it mean it’s not yet ready for prod usage? If that’s the case, when will it be ready? Also, is there any

Re: snowflake io in python

Thank you! On Mon, Nov 23, 2020 at 10:53 PM Chamikara Jayalath wrote: > We are working on this. ETA is the end of this quarter. Created > https://issues.apache.org/jira/browse/BEAM-11332 for tracking. > > Thanks, > Cham > > On Mon, Nov 23, 2020 at 5:42 AM Alan Krumholz > wrote: > >> Hi Cham, >>

NotSerializableException in Spark runner

Hi all, I have pipeline to read data from kafka & write to file. I am using Beam 2.12 with spark runner in java. While executing I am getting below exception : org.apache.spark.network.client.ChunkFetchFailureException: Failure while fetching StreamChunkId{streamId=1660417857014, chunkIndex=0