Hi all, I am not sure if this is the right mailing list but
us...@samza.apache.org doesn't seem to exist.

I am just looking at the code of KafkaSystemProducer and am a bit confused
as to how the  partitioning at Samza output is handled.

Firstly it seems to be hard-coded to take a modulo of the hashCode of the
envelope partitionKey if provided otherwise null which means that it hands
the partitioning decision to the underlying kafka producer.

Now when I try to override `systems.<..>.producer.partitioner.class` I see
a warning in the initialization that partitioner.class is not a known
config - however the configuartion for samza says that any configuration
available for kafka producer can be passed to `systems.<..>.producer...`. I
have checked that both new and old kafka producer api have
`partitioner.class` configurable.

I think I am missing something or else it means that samza doesn't allow
for custom partitioning strategies at the output to kafka.

Michal,

Reply via email to