I'll make the post prettier at a later date. For now, enjoy the raw info
Green markings on some levels mean the building will gain a new slot and/or change visuals at that level.
Not covered in this guide: Inn/Spa, Tavern/Tea House, Library, Hero Monuments.
Disclaimer: The source I used to create these tables may or may not be outdated and/or incorrect.