I say find a way to do both. Even if it ends up being with two people/lovers. If you're up front aout it with both parties... That doesn't mean they have to participate with each other or even know who the other is.

Be loyal, true and trustworthy and both can bring you pleasure without you hurting them.