Hmmm. Y'know, I may have been okay with that answer had he added, "I'm going to walk through any barrier you put up eventually." My advice then would have been along the lines of, "give him another chance, even Doms sometimes come off a little strong on a first date." There are a few red flags here, however. Not to the point where I would tell you to can the relationship completely or anything, but set your sights on "just friends" first and leave it at that for awhile. Let him know why, and if he's not cool with that, his loss.
He may very well take a deeper level of intimacy for granted based on your mutual friend (where he knows more about you than you think already, or assumes you know more about him than you do), but he's pursuing a relationship with you, not the three of you so it's a moot point in the end.
Continue to make yourself clear, and proceed with caution!