You need less accuracy in general (it's hard to count cycles when caches are involved), but certain operations (usually audio/video streaming) end up relying pretty tightly on timings even when the programmer didn't actually intend it. And that's one case where being way too fast does hurt
