Do I let bad sex ruin a good relationship?

I’ve been with my boyfriend for six months and I love him so much. But the sex is less than perfect. It’s always over really quickly, and he doesn’t seem to care if I orgasm or not. It’s really weird because he’s so considerate and lovely in everything else. Sex is really important to me too though. Should I break up with him?