Using a different microphone (Logitech Webcam) works fine. I really need to switch off the AirPods microphone to get things to work.

It's mostly fine, but I also step away from my desk. I wish I could also prioritize my microphone.

1. Webcam (if I'm at my desk, I have my webcam) 2. MacBook Pro (if I'm away from my desk, my computer is still probably within range of my MX mouse)