Re: Reading performance - Kafka VS FileSystem

2022-01-26 Thread Yun Tang
Wednesday, January 26, 2022 23:13 To: user@flink.apache.org Subject: Re: Reading performance - Kafka VS FileSystem Also, what would you recommend? I have both options available: * Kafka - protobuf messages * S3 - here are messages copied from kafka for persistence with Kafka Connect se

Re: Reading performance - Kafka VS FileSystem

2022-01-26 Thread Jasmin Redžepović
Also, what would you recommend? I have both options available: * Kafka - protobuf messages * S3 - here are messages copied from kafka for persistence with Kafka Connect service On 26.01.2022., at 14:43, Jasmin Redžepović mailto:jasmin.redzepo...@superbet.com>> wrote: Hello Flink commit

Reading performance - Kafka VS FileSystem

2022-01-26 Thread Jasmin Redžepović
Hello Flink committers :) Just one short question: How is performance of reading from Kafka source compared to reading from FileSystem source? I would be very grateful if you could provide a short explanation. I saw in documentation that both provide exactly-once semantics for streaming, but t