I hate physics but love building things... do I stick with Mech E?

Basically as the title says. I am a first year mechanical engineering major, but I am taking all sophomore classes (statics, physics w calc II, mechanical systems).

I hate physics. Both physics I and now physics II have been absolute hell for me. I don't understand it (but I know I could if I really tried), and I do not care about it at all. In fact, the same goes for most of my classes in engineering. I know I could learn it, but I don't want to.

I like working with my hands and building things (robotics is awesome), but I hate the math involved in an actual engineering degree. I feel like I do not have passion for anything. I don't know what I want to do, or what I would switch to if I changed my major.

Unfortunately, a gap year or anything of the sorts is out of the question because of scholarship reasons.

Any advice? I am miserable in my academics, and it has led me to slack on work due to no motivation.