Yes, it absolutely can work as a mainstream nickname, just think about all the weird/crazy/sickly sweet names you have heard vanilla people call each other.
What you may want to pay a bit of attention to, if you are not too keen on explaining things lol, is the general feel of the dynamic between the two of you when he calls you that in public. But all in all, you should be fine,.