Dear all,
A reoccurring challenge we have with stream enrichment in Flink is a robust
mechanism to estimate that all messages of the source(s) have been
consumed/processed before output is collected.
A simple example is two sources of catalogue metadata:
- source A delivers products,
- source B d
Hi Mate,
thanks for creating the issue and pointing it out. I think the issue you
created is a bit more specific than my whole point. It rather focuses on the
taskmanagers, which is of course fine. From my point of view the following two
things are the low hanging fruits:
1. Improving the logg
Hi,
I have opened a JIRA [1] as I had the same error (AlreadyExists) last week
and I could pinpoint the problem to the TaskManagers being still alive when
creating the new Deployment. In native mode we only check for the
JobManagers when we wait for the cluster to shut down in contrast to
standalo
You can check the Oracle CDC connector, which provides that
https://ververica.github.io/flink-cdc-connectors/master/content/connectors/oracle-cdc.html
Best,
G.
On Tue, Feb 13, 2024 at 3:25 PM К В wrote:
> Hello!
>
> We need to read data from an Oracle database table in order to pass it to
> Kaf
Hello!
We need to read data from an Oracle database table in order to pass it to
Kafka.
Data is inserted in the table periodically.
The table has multiple partitions.
Data should be processed parallel, each task should consume one partition
in the database.
Can this be done using a Flink task?
Ho
Hi Gyula,
thanks for the advise. I requested a Jira account and will try to open a ticket
as soon as I get access.
Cheers,
Niklas
> On 13. Feb 2024, at 09:13, Gyula Fóra wrote:
>
> Hi Niklas!
>
> The best way to report the issue would be to open a JIRA ticket with the same
> detailed inform
Hi Niklas!
The best way to report the issue would be to open a JIRA ticket with the
same detailed information.
Otherwise I think your observations are correct and this is indeed a
frequent problem that comes up, it would be good to improve on it. In
addition to improving logging we could also inc
Hi Nida,
I request that you read
https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/resource-providers/standalone/docker/
in order to learn how to Dockerize your Flink job.
You're Welcome & Regard
Marco A. Villalobos
> On Feb 13, 2024, at 12:00 AM, Fidea Lidea wrote:
>
> Hi
Hi Team,
I request you to provide a few sample codes for dockerizing
flink-java application.
My application has only one job as of now.
Awaiting your response.
Thanks & Regards
Nida Shaikh
