I solved this problem by removing the Hadoop classpath from Flink cluster
deployment.
On 2022/04/28 09:04:50 Terry Heathcote wrote:
> Hi
>
> We are running a Flink job that delivers Kafka data to an Iceberg table.
> The job uses the *org.apache.iceberg.flink.Catalo
Hi
We are running a Flink job that delivers Kafka data to an Iceberg table.
The job uses the *org.apache.iceberg.flink.CatalogLoader* and
*org.apache.iceberg.flink.TableLoader
*interfaces in combination with *org.apache.iceberg.flink.sink.FlinkSink *where
the catalog type is Hive.
We have had suc
roperties(Properties properties) {
properties.setProperty("transaction.timeout.ms", "90");
properties.setProperty("max.block.ms", "60");
properties.setProperty("delivery.timeout.ms", "30");
return properties;
}
}
Best regards
Terr
Hi
We are having trouble with record throughput that we believe to be a result
of slow checkpoint durations. The job uses Kafka as both a source and sink
as well as a Redis-backed service within the same cluster, used to enrich
the data in a transformation, before writing records back to Kafka. Be
