From Dev.to
DPU Offload vs Host Cores: When the 100G NIC Stops Being Free
A serving node that pushes 100 Gbps of model traffic does not do it for free. Depending on kernel, MTU and how many small requests you handle, the host burns somewhere between two and six cores on net...