The Zhang Family compound is built in the traditional Siheyuan style, with a central courtyard surrounded by several buildings. Due to space constraints while building in London, the buildings each have a second storey. Small roofed bridges connecting the buildings give the compound a larger feeling, while retaining the semi-freestanding nature of the buildings.

The Zhang family compound is located on Lisle Street, between the Leicester Place and Newport Street, opposite of the chapel.

The compound was built in 1878 by Lady Gallorett to house the Zhang family, of which she is a spirit patron.