Is it wrong to have sexual compatibility as a filter for entertaining people and going into a relationship?

Currently a guy I physically and emotionally like has been giving signs that he's interested in me, he also knows that I am also interested in him but I am still not committed in entertaining him because I heard from our common friend that he might be a bottom just like me, I wonder now if he thought I am top just because I am masc and am always straight passing.

For context, I have tried topping, thrice, but it is just not for me, I do not enjoy it at all, and as embarrassing as it sounds, it seemed like my d can't keep being hard while I do the deed, but being the bottom is exhilarating, and it is no effort for my d to get hard during those moments.

Is it weird (and wrong) for me to not see us getting together (even though we are both interested with each other) just because we are both bottoms? I cannot see myself topping and him being a bot kinda turns me off, honestly. Open relationships are also not for me. Should I stop even doing little things to tell that I'm interested since this is still an early stage or do I commit and think that everything will be okay?