Yes, graphics often have a large effect on latency
If you plot the times with halscope you can see this
effect dynamically. The latency test typically does
no show these latency issues as it really only shows
dispatch latency, since it does no actual memory access
or I/O.
You can even see the the effect in LinuxCNCs motion controller
