Re: Flink and default parallelims, problems with state functions

2024-12-20 Thread Guillermo Ortiz Fernández
I have been reviewing the previous query I ran in the flink sql-client while simultaneously running an INSERT into a Kafka topic (with 4 partitions) from another flink sql-client. For testing purposes, I set up 8 task slots and a default parallelism of 4. When I run the query, it shows as "RUNNING

Flink parallelism with Kafka source

2024-12-20 Thread Guillermo Ortiz Fernández
I'm looking for how Flink defines parallelism for a Kafka source ( https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/kafka/). How is it determined by default? Is it based on the number of partitions in the topic? I have some topics with hundreds of partitions, and such a hi