I've never used one, but I would suspect the biggest value is just having someone confidential and with no conflict of interest that you can just talk to and put your thoughts in order.

See also:

http://en.wikipedia.org/wiki/Rubber_duck_debugging