The server/client thing seems to make sense, running X sessions remotely seems the best bet. Did you have a look at eyeos? I guess it's a similar approach, with a different DM, so to speak.
[1] http://eyeos.org/ -- () ascii ribbon campaign - against html e-mail /\ ascii-rubanda kampajno - kontraŭ html-a retpoŝto -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org