I had a lot typed out on this, but nah. I'll just say this-
If polyamory is the thing for you, then do it. Know yourself well enough to understand what it is you desire in a relationship, find a like-minded soul (or souls in this case) and do it all over the place. Live your life and be happy in it.
Just don't expect and/or demand that others be happy with you in the living of it. "Live and let live", while a grand idea, just isn't realistic. And unless you live totally isolated from public view and opinion, what you should expect are judgements, differing opinions and disapproval. That's what people do when they don't understand something. And forget trying to "make them understand" any of it. They don't want to.
That's life. Have fun with it.