You are right that the font makes a difference. I don’t get the same oddity with Arial.
You have an expressed box around your text which presumably engages Stroke. But the problem I encountered was regardless of whether Stroke was invoked or not.
So, as so often, there is a workaround and that is what most of us would reach for in practice. But should the problem occur in the first place? I am maybe too purist but I just have this nagging feeling that the need for a workaround is emblematic of an inherent defect!