Just found a super hacky way. Rename the resource folder of the desired language to a language code matching your locale* setting.
Would be nice though with something more versatile, like different desktop shortcuts for different languages.
(*Yeah, I know this is often intepreted as a langauge setting, and maybe even intended to be that, but the way it is exposed in the UI it is a locale setting)