What is that argument, specifically? So far all I've heard is "this is wrong", not "this is wrong because of x".
The only point anyone's been able to make is that it could possibly be abused, but frankly, everything the government can do can be abused. You'll need more than "it could be abused" to argue against it.
I'm arguing that it makes me uncomfortable and that this discomfort will be widely shared. Go ahead and disagree that morality is something different than that if you want. You are also welcome to think that is weak sauce (but then go ahead and make a habit of making strangers uncomfortable in public and see how that serves you).
Recording and documenting where you go in no way hinders or interferes with your freedom of action, therefore I retain my right to freedom of action in doing so.
I don't have a right to go into a place where you have privacy. If you come out of a private place, or act in a way that is public, I have every right in the world to track you.
The only point anyone's been able to make is that it could possibly be abused, but frankly, everything the government can do can be abused. You'll need more than "it could be abused" to argue against it.