Hi, my Topology description..
- Topologies:
Sub-topology: 0
Source: SeSource (topics: [buzzard.decoded.amon.stats.ap,
buzzard.app.monitoring.internal.clientsestats])
--> SeProcess
Processor: SeProcess (stores: [BucketData, CacheData])
--> AeSink
<-- SeSource
Sink:
If I recall correctly, you can set 'delete.retention.ms' in the topic level
configuration to how long you want to retain the tombstones in the topic.
By default is set to 8640, you can set it to lower than this. Regarding
the performance, I am not really why would compaction causes the
performa
Hi Peter,
A HUGE thank you for your suggestion of using ‘retention.ms=-1' for the topic.
I also explicitly set ‘retention.bytes=-1'. With this combination, kafka is
certainly not deleting the segment logs and I am able to run multiple instances
of console consumers to read data. I am still conf
Hi,
how to check the version information for Kafka that is being used on the
MDT Mirror servers.
thanks
And all four stores (BucketData, CacheData, StationKeyValue,
StationCacheData) are definitely explicitly added as
Stores.inMemoryKeyValueStore("name")? Hm.
Does du -h show any contents within the
./buzzard.MonitoringSeWlanStatsAggregator/0_1 directories that match any of
these store names? Also if
Hello Muhammed,
The community is working on KIP-444 that expose rocksDB metrics. There's an
on-going PR that you may find helpful for your own implementation:
https://github.com/apache/kafka/pull/6884
Guozhang
On Wed, Jul 17, 2019 at 6:26 AM Muhammed Ashik wrote:
> Hi I'm trying to log the r
Hi All,
I'm working on a kafka streams application to basically aggreagte data over
5 min intervals.
The input topic is partitioned by id and then I want to use process
function to aggregate data using state store and use punctuator to emit
results. But I'm not sure how I can perform groupBy when
Hi,
How to check version information for Kafka that is being used on the MDT
Mirror servers? Is their any command to check that.I have any only access
to Kafka and zookeeper servers through putty.Any help will be appreciated.
Best Regards,
bahir
Hi All,
Could someone confirm what truncation happens when a partition changes from a
follower to a leader and why?
Any help would be greatly appreciated.
Many Thanks,
Jamie
