It’s also worth looking at the system preferences for Mission Control. Here’s how mine are set. I think unchecking the “Automatically rearrange” one is crucial, as when it is active the desktops get dynamically renumbered based on what you used last (so assignment to a specific one becomes meaningless).
