2GB is not enough, 4GB is usable but 8GB are required for anything above the Wheezy version of LinuxCNC.
Still bad latency but i do not see the link being dropped, so this might just work.
First, enter the PC BIOS and disable hyperthreading, TPM, AMT, turbo, any power saving features, virtualisation, etc, then do another test.