You would need to set the scale for the viewport in the SketchUp Model panel or via the context menu when you have the viewport selected. The Scale tool is used only on LayOut drawing entites. Text would need to be resized via the Text Style panel.
If I were doing this I would ungroup everything, change the scale for the viewport and resize it, move and resize the text, and then scale any LayOut drawing entities. If those drawing entities had been made a Scaled Drawing in the first place, changing the scale from 1:100 to 1:50 would be as simple. You’d just select the new scale in the Scaled Drawing panel or in the Context menu.
I see that you have modified the Camera properties for the viewport in LayOut. Note the dark gray background and Reset button in the Camera section of the SketchUp Model panel.
That’s very likely to create a lot of work for you if it gets reset.
There’s really no reason you shouldn’t have a scene set up to show the plan as you need it. I would fix this before going to the work of changing the scale on everything.
Edit to add: I’ve been looking more at your LayOut file and the SketchUp model associated with it. I would suggest that you fix the incorrect tag usage making sure that all edges and faces are untagged. Then create tags for the objects in the model so you can control their visibility in the scenes in SketchUp and in the viewports within LayOut.
Set up the CAD import so it is aligned with the 3D model. Reset the model axes, first. Update the scenes as required.
In LayOut I would suggest that you create layers for the different entity types: viewports, LO drawing elements, dimensions, and text. The dimension and text lays should be at the top of the layers list so those entites don’t wind up behind the viewports or other drawn entities.
Again, use Scaled Drawings for those LO drawing elements such as the door swings and the dashed lines so that you can change their scale easily if needed. If you like adding the door swings in LayOut, I would suggest making a set of them for the different standard door widths using Scaled Drawings and then save them as scrapbook objects so you can drag them in easily and set their scale to suit.
Avoid modifying the Camera for viewports to maintain the connection with the scenes in the SketchUp model.