Do you have 3 layers of 10 cm thick glass (total of 30 cm)?
According to Vray Docs:
Max Trace Depth – Specifies the level to which all bounces that will be computed for reflections and refractions are clamped.
You seem to solve your problem via max trace depth , what is the caveat/problem?
Also here is the text that displays when you hover over ‘Max Trace Depth’ option:
So i assume when you increase this parameter, it overrides/surpasses IOR settings.