Hyper-V Virtual Machine Queuing

Hyper-V Sucks sometimes. You should disable VMQ to get better performance on your network:

Get-NetAdapterVmq | Disable-NetAdapterVmq