Fix position of Internal Dimensions

I’m wondering if anyone has a trick to ensure dimensions stay fixed within a scalable group?

I use a rectangle with embedded dimensions to rough out schematic floor plan layouts. This works if objects are scaled up, but pushes the dimension outside the group if it is scaled smaller. Once the dimension is outside of the rectangle it becomes the new extremity of the group.

You can see this behaviour in the image below!