I have an embedded function with a SinkFunction as an egress, implemented as
this pseudo-code:
val serializationSchema = KafkaSchemaSerializationSchema(... props required to
use a Confluent Schema Registry with Avro, auth etc ...)
return SinkFunctionSpec(EGRESS_ID, FlinkKafkaProducer(serializati
12:31 AM
To: user@flink.apache.org ; Meissner, Dylan
Subject: Re: Stateful functions 2.2 and stop with savepoint
Hi,
Thanks for reporting. I think it is a Flink bug and have created FLINK-21522
for it. You could track progress there.
FLINK-21522: https://issues.apache.org/jira/browse/FLINK-
Hi Rion,
Regarding the question about adding Prometheus labels out of the box. This is
common ask of all exporters, but Prometheus philosophy sees this as an
"anti-pattern" as the metrics source can often be ambivalent about context. See
[0] for example of such a discussion.
Instead, we can es
Piotr Nowojski
Sent: Thursday, March 4, 2021 7:03 AM
To: Kezhu Wang
Cc: Meissner, Dylan ; user@flink.apache.org
Subject: Re: Stateful functions 2.2 and stop with savepoint
It doesn't change much ;) There is a known issue of stopping with savepoint and
stateful functions not working [1]. Th
Thomas, I use only these actions for checkpoints and savepoints: s3:GetObject,
s3:PutObject, s3:DeleteObject, and s3:ListBucket
Cheers,
Dylan
From: Guowei Ma
Sent: Friday, September 24, 2021 12:47 AM
To: Thomas Wang
Cc: user
Subject: Re: Exact S3 Permissions to
Flink deployment resources support env interpolation natively using $() syntax.
I expected this to "just work" like other resources when using the operator,
but it does not.
https://kubernetes.io/docs/tasks/inject-data-application/_print/#use-environment-variables-to-define-arguments
job:
jar
This comes up when the Schema Registry has authorization capabilities.
A producing application may not be authorized to call “register” when another
principal owns the schema subject, for example in organizations with strong
schema governance practices. When ConfluentSchemaRegistryCoder.writeSch
“getId()”.
To solve this for everyone, the Confluent schema coder should honor Confluent’s
“auto.register.schemas” property in SchemaCoder.
From: Schmeier, Jannik
Date: Tuesday, July 11, 2023 at 4:43 AM
To: Meissner, Dylan , Martijn Visser
Cc: Schwalbe Matthias , user@flink.apache.org
Subject
