Do other men make you guys dysphoric?

I go to a really inclusive college now (thank fucking god) and the boys there aren’t usually transphobic and I can tell there’s a few who are really trying to include me and make me feel like one of them which just makes me wanna cry (in a good way). But every time one of them does something as generic as high five me in the hall way or call me man or bro I feel like a fraud, I know I don’t pass really that well I have dyed hair im clearly queer, I KNOW they must not think I’m one of them but they’re so nice to me. I get so dysphoric over it I don’t know what to do