Narrowing a closet

I have modeled a closet with shelves, drawers and dividers as separate groups. Now, I discovered I need to make it less deep. Is there a way to do this faster than opening each group and pushing its back? I thought of using the scale tool but then any dimensions inside will be changed as well

Very likely it would be faster if you’d used components instead of groups.

Can you share the SKP file so we can see exactly how you structured it? The exact answer to the question will be easier to give with the model in front of us.