Don't know why you were downvoted. I've noticed this too. Someone who works out a lot (noticeably muscular) is stereotyped in academia or STEM professions.
I can understand there being an issue for being overly muscular, but I also don't think that being overly muscular equals being good looking. This is probably a very common mistake that men make when pursuing better looks.
I'm a pretty good looking man by conventional standards. In my n=1 experience the benefits far outweigh any downside. I actually can't think about any downside.
I know this sounds cocky, but I thought it might add to the discussion.
Being good looking is fucking awesome. So is being smart. Both are a combination of genetics and hard work.