Whenever I have activated it, it has always been by accident. I have been in the habit, for a long time, of holding the shift key with my left pinky whenever I need all caps. I can still type an A with my ring finger, and it feels completely natural to do so.

Despite this, it never once occurred to me to turn the blasted thing off. I just mapped it as a Ctrl key. I feel so old school. I may even learn Emacs now.