Yes... I beleive the market is too fringe to be profitable all on its own...
Has anyone considered also including hirable dungeon space open to those who are not staying at the B&B? There may be other things you can do to boost profit that can be done with a large enough building with the right facilities.