But the failure mode is different. Float breaks the illusion, but an overlay showing e.g. tagged objects, or dimensions of a box, remains intelligible even with some 'float'.

Meanwhile, latency in VR gives the feeling that 'the entire world is slightly wrong'. I imagine working despite the first problem is a lot easier than working despite the second one.