A naive thought, perhaps: Would there be any advantage to using a key-value embedded database program for the voluminous maps needed for gcc optimization, etc.?
If so, consider <http://tokyocabinet.sourceforge.net>. I have used its predecessor, qdbm, for years and it was very fast. TC is faster still. I notice many threads here about memory requirements and speed reductions--perhaps there is some way TC could help with those problems. -Tom