My Flink app uses logback for logging, when submitting it from the operator
I get this error:
ERROR in ch.qos.logback.classic.joran.JoranConfigurator@7364985f - Could
not open URL [file:/opt/flink/conf/logback-console.xml].
java.io.FileNotFoundException: /opt/flink/conf/logback-console.xml (No suc
Hi all,
I need to configure a keyed global window that would trigger a reduce function
for all the events in each key group before the processing finishes and the job
closes.
I have something similar for the realtime(streaming) version of the job,
configured with a processing time gap:
.keyB
Hello Edwin,
Would you mind sharing a simple FlinkSQL DDL for the table you are creating
with the kafka connector and dthe debezium-avro-confluent format?
Also, can you elaborate on the mechanism who publishes initially to the
schema registry and share the corresponding schema?
In a nutshell, th
Sorry I mean the 180 seconds. Where does flink decide that 180 seconds is
the cutoff point... And can I increase it.
On Thu., Sep. 29, 2022, 7:02 a.m. John Smith,
wrote:
> Is there a way to increase the 30 seconds to 60? Where is that 30 second
> timeout set?
>
> I have jdbc query timeout but at
Is there a way to increase the 30 seconds to 60? Where is that 30 second
timeout set?
I have jdbc query timeout but at some point at night the insert takes a bit
longer cause of index rebuilding.
On Wed., Sep. 28, 2022, 5:02 a.m. Congxian Qiu,
wrote:
> Hi John
>
> Yes, the whole TaskManager exi
I see. As mentioned, Flink uses Dynamic Tables, which are a logical
concept. They don't necessarily (fully) materialize during query execution.
On Tue, Sep 27, 2022 at 1:35 PM wrote:
>
> I was thinking if I can use Flink to process large files and save result
> to another file or database (jdbc)
Hi Edwin,
I'm suspecting that's because those fields are considered metadata which
are treated separately. There's
https://issues.apache.org/jira/browse/FLINK-20454 for adding the metadata
support for the Debezium format with a PR provided, but not yet reviewed.
If you could have a look at the PR
