[
https://issues.apache.org/jira/browse/CASSANDRA-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119163#comment-13119163
]
Yang Yang commented on CASSANDRA-3269:
--------------------------------------
this piece of logging is particularly interesting. the LocationInfo CF is
flushed, right after that, it's trying to discard oldest segment, but the
discard fails saying that locationInfo bit is dirty. but supposedly the bit
should have been turned off
INFO [main] 2011-10-02 04:22:55,033 CommitLog.java (line 174) Log replay
complete, 15600762 replayed mutations
INFO [main] 2011-10-02 04:22:58,560 ColumnFamilyStore.java (line 651) flush
position is ReplayPosition(segmentId=1317524063739,
position=0)
INFO [main] 2011-10-02 04:22:59,244 ColumnFamilyStore.java (line 665)
Enqueuing flush of Memtable-LocationInfo@2115195389(29/36
serialized/live bytes, 1 ops)
INFO [FlushWriter:2] 2011-10-02 04:22:59,244 Memtable.java (line 283) flushing
memtable LocationInfo
INFO [FlushWriter:2] 2011-10-02 04:22:59,244 Memtable.java (line 287) entered
lock flushing memtable LocationInfo
INFO [FlushWriter:2] 2011-10-02 04:22:59,244 Memtable.java (line 290) really
start flushing memtable LocationInfo
INFO [FlushWriter:2] 2011-10-02 04:22:59,245 Memtable.java (line 236) Writing
Memtable-LocationInfo@2115195389(29/36 serialized
/live bytes, 1 ops)
INFO [FlushWriter:2] 2011-10-02 04:22:59,396 Memtable.java (line 272)
Completed flushing /mnt/cass/lib/cassandra/data/system/Lo
cationInfo-h-4-Data.db (80 bytes)
DEBUG [COMMIT-LOG-WRITER] 2011-10-02 04:22:59,397 CommitLog.java (line 461)
discard completed log segments for ReplayPosition(segmentId=1317524063739,
position=0), column family 0.
DEBUG [COMMIT-LOG-WRITER] 2011-10-02 04:22:59,397 CommitLog.java (line 473)
trying to discard segment CommitLog-1317524063739.log
DEBUG [COMMIT-LOG-WRITER] 2011-10-02 04:22:59,398 CommitLog.java (line 502) Not
safe to delete commit log
CommitLogSegment(/mnt/cass/lib/cassandra/commitlog/CommitLog-1317524063739.log);
dirty is LocationInfo (0), ; hasNext: false
INFO [main] 2011-10-02 04:22:59,447 ColumnFamilyStore.java (line 651) flush
position is ReplayPosition(segmentId=1317524063739, position=174)
INFO [main] 2011-10-02 04:22:59,447 ColumnFamilyStore.java (line 665)
Enqueuing flush of Memtable-LocationInfo@2010157886(53/66 serialized/live
bytes, 2 ops)
INFO [FlushWriter:2] 2011-10-02 04:22:59,448 Memtable.java (line 283) flushing
memtable LocationInfo
INFO [FlushWriter:2] 2011-10-02 04:22:59,448 Memtable.java (line 287) entered
lock flushing memtable LocationInfo
INFO [FlushWriter:2] 2011-10-02 04:22:59,448 Memtable.java (line 290) really
start flushing memtable LocationInfo
INFO [FlushWriter:2] 2011-10-02 04:22:59,448 Memtable.java (line 236) Writing
Memtable-LocationInfo@2010157886(53/66 serialized/live bytes, 2 ops)
INFO [FlushWriter:2] 2011-10-02 04:22:59,572 Memtable.java (line 272)
Completed flushing /mnt/cass/lib/cassandra/data/system/LocationInfo-h-6-Data.db
(163 bytes)
DEBUG [COMMIT-LOG-WRITER] 2011-10-02 04:22:59,573 CommitLog.java (line 461)
discard completed log segments for ReplayPosition(segmentId=1317524063739,
position=174), column family 0.
DEBUG [COMMIT-LOG-WRITER] 2011-10-02 04:22:59,573 CommitLog.java (line 473)
trying to discard segment CommitLog-1317524063739.log
DEBUG [COMMIT-LOG-WRITER] 2011-10-02 04:22:59,573 CommitLog.java (line 502) Not
safe to delete commit log
CommitLogSegment(/mnt/cass/lib/cassandra/commitlog/CommitLog-1317524063739.log);
dirty is LocationInfo (0), ; hasNext: false
WARN [MutationStage:23] 2011-10-02 04:23:21,015 Memtable.java (line 136)
MemoryMeter uninitialized (jamm not specified as java :
> accumulated 100GB of commit logs
> --------------------------------
>
> Key: CASSANDRA-3269
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3269
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.0
> Reporter: Yang Yang
>
> I ran my cluster for about 2 days. the cluster has 2 nodes. I restarted one
> box several times, and the other one was always running. the one always
> running ended up accumulating 100GB of commit logs.
> this is 1.0.0 code from about Sept 15 in github. I kept the original setting
> for
> #commitlog_total_space_in_mb: 4096
> i.e. commented out
> here is some sample of the output:
> -rw-r--r-- 1 yyang yyang 134217857 2011-09-28 03:51
> CommitLog-1317181834810.log
> -rw-r--r-- 1 yyang yyang 134217869 2011-09-28 03:50
> CommitLog-1317181764105.log
> -rw-r--r-- 1 yyang yyang 134217783 2011-09-28 03:49
> CommitLog-1317181694633.log
> -rw-r--r-- 1 yyang yyang 134217750 2011-09-28 02:39
> CommitLog-1317176955102.log
> yyang@ip-10-71-21-46:/mnt/cass/log/cassandra$ ls -lt
> /mnt/cass/lib//cassandra/commitlog/|wc -l
> 727
> yyang@ip-10-71-21-46:/mnt/cass/log/cassandra$ du -s
> /mnt/cass/lib/cassandra/commitlog/
> 95095316 /mnt/cass/lib/cassandra/commitlog/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
