Sir, Sire, M'lord, M'lady, Master, Mistress.

Instead of a formal You vs. an informal you (in those languages that have it,) I would think it more appropriate to use the full honorific. Even Darth Vader addressed the Emperor with "My Master."