Can you see if what I wrote here applies to your situation?
We first saw that problem with 2020, or maybe even 2019. To save reading the whole thing, open the Colors palette and choose anything except Colors in Model. See if things then download into the scene quickly.