What you're really asking is if fundamental individual human rights are desirable for individuals and community as a whole, which is of course a hotly debated topic. So yeah, it goes all the way down to fundamental questions like if we should have freedom of association.