Hi All,
TLDR :: Promox running a TrueNAS VM with passed through HBA getting very slow NFS speeds. Noob needs help with setup
I am running a proxmox server with the specs:
CPU : Dual Silver 4114
RAM : 10x 16GB ECC 2400 Mhz
MotherBoard : WS C621E SAGE
On the ProxMox I am running a TrueNAS-13.0-U3.1 Vm:
8 Cores
16Gb of ram
q35
Passing through to the TrueNas VM
- Adaptec Asr-71605
- Intel T540-DA2
Connected to the Adaptec
4x Samsung 860 1TB in zfs raidz1 (Called fast) - Compression off
5x 10tb Ironwolf Pro in zfs raidz1 (Called slow) - Compression off
NFSv4 setup to both pools
iPerf3 from pve to nas 20Gb/s
iPerf3 from nas to pve 20Gb/s
Speed over NFS
Speed direct from NAS shell
TLDR :: Promox running a TrueNAS VM with passed through HBA getting very slow NFS speeds. Noob needs help with setup
I am running a proxmox server with the specs:
CPU : Dual Silver 4114
RAM : 10x 16GB ECC 2400 Mhz
MotherBoard : WS C621E SAGE
On the ProxMox I am running a TrueNAS-13.0-U3.1 Vm:
8 Cores
16Gb of ram
q35
Passing through to the TrueNas VM
- Adaptec Asr-71605
- Intel T540-DA2
Connected to the Adaptec
4x Samsung 860 1TB in zfs raidz1 (Called fast) - Compression off
5x 10tb Ironwolf Pro in zfs raidz1 (Called slow) - Compression off
NFSv4 setup to both pools
iPerf3 from pve to nas 20Gb/s
iPerf3 from nas to pve 20Gb/s
Speed over NFS
Code:
Writing Test root@pve:/mnt/pve/nas# dd if=/dev/zero of=testfile bs=4M count=10000 10000+0 records in 10000+0 records out 41943040000 bytes (42 GB, 39 GiB) copied, 78.0714 s, 537 MB/s Reading Test root@pve:/mnt/pve/nas# dd of=/dev/zero if=testfile bs=4M count=10000 10000+0 records in 10000+0 records out 41943040000 bytes (42 GB, 39 GiB) copied, 73.9434 s, 567 MB/s
Speed direct from NAS shell
Code:
Write Test root@truenas[/mnt/fast/testspeed]# dd if=/dev/zero of=testfile bs=4M count=10000 10000+0 records in 10000+0 records out 41943040000 bytes transferred in 35.452023 secs (1183092991 bytes/sec) Read Test root@truenas[/mnt/fast/testspeed]# dd of=/dev/zero if=testfile bs=4M count=10000 10000+0 records in 10000+0 records out 41943040000 bytes transferred in 40.815562 secs (1027623727 bytes/sec) root@truenas[/mnt/fast/testspeed]#