I solved this problem by using the xorg-edgers ppa. Now xorg hovers around 150MB, which is way better than 500MB. The problem is that this is not really a fix, and xorg-edgers comes with it's own host of issues. I've been using it with out issue for a week or so, but with ppas like this that could change any minute...
https://launchpad.net/~xorg-edgers/+archive/ppa 32bit Kubuntu 11.04 GeForce 6150SE nForce 430 $ lscpu Architecture: i686 CPU op-mode(s): 64-bit CPU(s): 2 Thread(s) per core: 1 Core(s) per socket: 2 CPU socket(s): 1 Vendor ID: AuthenticAMD CPU family: 16 Model: 2 Stepping: 3 CPU MHz: 1250.000 Virtualization: AMD-V L1d cache: 64K L1i cache: 64K L2 cache: 512K L3 cache: 2048K -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/787859 Title: Xorg memory usage/leak -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs