Oh God. It'll be so easy to set off, fish in a barrel, seriously. O.O

Also it will probably call joker a vulgar ruffian because it is a victorian maiden of a building.

(Also, no idea how far you're planning to go with the plot on line the line, and obviously I wouldn't meddle in your ability to participate without permission, but it's entirely plausible the House might get scared enough to have Joker kicked out, because it has low ruffian tolerance. Could be the start of interesting bad CR if he's mad about it, IDEK.)