I think that's about as good as it gets, and it's perfectly usable for most purposes (especially if you don't plan on using software step generation or encoder counting)
if Mesa or ethercat, disable energy efficient Ethernet with commands for your NIC (Intel/Realtek) and consider adjusting IRQ for the network card to prefer the core the servo thread is running one. There is a script somewhere on the forum here.