Use https://github.com/syohex/emacs-git-gutter-fringe if you want the symbols in the fringe.

But sadly the Emacs mode calls git synchronously which can lead to a significant slow down when switching buffers. I hope that gets fixed.