Suppose the US passed a law in 1850 saying that slaves are legally people, but no other changes were made (i.e., the legal person slaves were still forced to perform labor for their masters). Would that also be a non-trivial difference?

Being defined as a legal person is nice, but it doesn't change the fact that you are forced (under threat of violence) to work for someone else against your will.