Sam,thank you for your detailed problem description. What is reason why delete cant remove old counter value from memtable? Because currently we need to code workaround in our applications.
It would be nice to copy your description of this problem to: http://wiki.apache.org/cassandra/Counters because it is more clear than existing text.