The way I get around that in SketchUp is to left mouse drag while holding control and command, for orbit, and also shift for pan (you can release the control and command keys once you are orbiting). In LayOut control and command held down does let you temporarily pan, and your existing tool remains active afterwards.
I can’t find a Windows equivalent of that ability.