It looks cool. Too bad that sensors are not yet widespread in laptops etc.
Are you planning to do also exterior tours? It would be interesting to explore loading data only on demand (by visibility, level of detail).
Another idea is to be creative and tell a story during loading time (don’t let the visitor notice he has to wait). Either by displaying a simplified preview, or 360° panorama background, some animation or showing a popup with additional explanative information.