you sound like you are feeling obliged to have multiple subs, because that is what fantasy would dictate.
It is not fantasy if you are getting people emotionally involved with you, and this should be considered before having more than one sub. It is not a requirement and should not be done for the sake of not being monogomous because it seems "normal" but because it is what is right for everyone involved.
Arch