In my experience it's simple. Generally speaking, not installing a compiler makes the system less secure. Why? real easy. Most systems I have ever seen without a compiler has software running on it that is behind on it's updates. When you ask the system administrator why, it is "Oh I don't have the compiler installed"
Not giving the system administrator the tools to install security updates is a reciepe for a less secure system. Meanwhile, and attacker, if they need something compiled, can simply compile elsewhere and bring it in, or install the tool once the box is owned. -Bob (Yes there are exceptions to this if you have some other sort of update mechanism in place, blah blah blah. 90% of people don't, because they run openbsd and "never need to patch it", but then run "other" dubious stuff out of /usr/local/ and should be..)