Difficulty in achieving optimal network interface card (NIC) saturation due to performance bottlenecks in data transfer processes.
The current KV cache offloading process is bottlenecked by PCIe or NIC bandwidth, limiting performance.
Devices on a gigabit network are not utilizing their full potential speed due to outdated hardware.
Network performance issues with 10 Gigabit Ethernet running at 300 Megabits.