Hi,
how did you execute this? Did any failures occur in between? If yes, it can
be that the sink writes stuff multiple times but marks the valid contents
of files using a .valid-length file.
Cheers,
Aljoscha
On Mon, 12 Dec 2016 at 19:54 Dominik Safaric
wrote:
> Hi everyone,
>
> As I’ve implemen
Hi everyone,
As I’ve implemented a RollingSink writing messages consumed from a Kafka log,
I’ve observed that there is a significant mismatch in the number of messages
consumed and written to file system.
Namely, the consumed Kafka topic contains in total 1.000.000 messages. The
topology does
