Hi all,
Our cassandra cluster consist of two dc and every dc we have 10 nodes. We
are using DSE 5.1.12 (cassandra 3.11).We have a high local write latency on
a single table. All other tables in our keyspace have normal latencies
like 0.02 msec,even tables that have more write tps and more data. Below
you can find two table descriptions and their latencies.
message_history_state have high local write latency. This is not node
specific every node have this high local write latency for
message_history_state. Have you ever see such a behavior or any clue why
this could happen?
CREATE TABLE tims."MESSAGE_HISTORY" (
> username text,
> date_partition text,
> jid text,
> sent_time timestamp,
> message_id text,
> stanza text,
> PRIMARY KEY ((username, date_partition), jid, sent_time, message_id)
> ) WITH CLUSTERING ORDER BY (jid ASC, sent_time DESC, message_id ASC)
> AND bloom_filter_fp_chance = 0.01
> AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
> AND comment = ''
> AND compaction = {'bucket_high': '1.5', 'bucket_low': '0.5', 'class':
> 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy',
> 'enabled': 'true', 'max_threshold': '32', 'min_sstable_size': '50',
> 'min_threshold': '4', 'tombstone_compaction_interval': '86400',
> 'tombstone_threshold': '0.2', 'unchecked_tombstone_compaction': 'false'}
> AND compression = {'chunk_length_in_kb': '64', 'class':
> 'org.apache.cassandra.io.compress.LZ4Compressor'}
> AND crc_check_chance = 1.0
> AND dclocal_read_repair_chance = 0.0
> AND default_time_to_live = 0
> AND gc_grace_seconds = 86400
> AND max_index_interval = 2048
> AND memtable_flush_period_in_ms = 0
> AND min_index_interval = 128
> AND read_repair_chance = 0.0
> AND speculative_retry = '99PERCENTILE';
>
> CREATE TABLE tims."MESSAGE_HISTORY_STATE" (
> username text,
> date_partition text,
> message_id text,
> jid text,
> state text,
> sent_time timestamp,
> PRIMARY KEY ((username, date_partition), message_id, jid, state)
> ) WITH CLUSTERING ORDER BY (message_id ASC, jid ASC, state ASC)
> AND bloom_filter_fp_chance = 0.01
> AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
> AND comment = ''
> AND compaction = {'class':
> 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy',
> 'max_threshold': '32', 'min_threshold': '4'}
> AND compression = {'chunk_length_in_kb': '64', 'class':
> 'org.apache.cassandra.io.compress.LZ4Compressor'}
> AND crc_check_chance = 1.0
> AND dclocal_read_repair_chance = 0.1
> AND default_time_to_live = 0
> AND gc_grace_seconds = 864000
> AND max_index_interval = 2048
> AND memtable_flush_period_in_ms = 0
> AND min_index_interval = 128
> AND read_repair_chance = 0.0
> AND speculative_retry = '99PERCENTILE';
>
message_history Local write latency: 0.021 ms
message_history_state Local write latency: 11.353 ms
Thanks in advance.
