Disabling caps lock isn't a stupid idea. I hit it very frequently when I go for the A key, and I never intentionally use it at all. I used to disable it all the time with a powertoy that was available for the purpose (i think it was only for win9x or something like that, it's been a while).
I'm not interested in taking keys off the keyboard (but jamming something under the button is tempting).