On 10.11.20 11:53, Tim Josefsson wrote:
Also when checking my logs I see the following message: 11:41:56,345 INFO org.apache.kafka.clients.producer.ProducerConfig - ProducerConfig values: acks = 1 [omitted for brevity] transaction.timeout.ms = 900000 transactional.id = Source: Read player events from Kafka -> Map Json to HashMap -> Add CanonicalTime as timestamp -> Filter dates not needed for backfill -> Sink: Post events to playerEvents Kafka-a15b4dd4812495cebdc94e33125ef858-1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer
The interesting thing would be to figure out where that `transaction.timeout.ms = 900000` is coming from. The default from Flink would be 60000, if nothing is configured. Are you specifying that value, maybe from the commandline or in code?
Maybe it's a funny coincidence, but our StreamingKafkaITCase also specifies that timeout value.
Best, Aljoscha