TrueNAS not using full network bandwidth

[jonat]

I'm new to TrueNAS and I'm not entirely sure to fix this. Essentially I had installed a 10Gb NIC recently onto my NAS and personal computer so that I could take easily access my files and make backups of files a lot faster. However it seems that I can only write about about 50MB/s max and and read 300MB/s in actual transfers and Iperf3 ranges from 100Mb/s to 200Mb/s. It seems to show that my computer and TrueNAS is connected at 10Gb but I can't get it to work where I want.

 

[HoneyBadger]

The iPerf results are indicating that you're only sending traffic at just over 100Mbps rather than the 10Gbps the card claims to be capable of. Do you get the same results if you reverse the direction of the iPerf test (add the -r option to the command)?

I also see the CX4 media type - check that it's firmly seated at both ends (using the locking clips or screws), there's no corrosion or bent pins, and the cable itself hasn't been bent or kinked. I haven't used that type of cable in a while but I have a vague recollection of there being different grades of certification based on the intended use (SAS, Ethernet, InfiniBand) so perhaps a replacement cable might be in order.

 

[jonat]

The iPerf results are indicating that you're only sending traffic at just over 100Mbps rather than the 10Gbps the card claims to be capable of. Do you get the same results if you reverse the direction of the iPerf test (add the -r option to the command)?

I also see the CX4 media type - check that it's firmly seated at both ends (using the locking clips or screws), there's no corrosion or bent pins, and the cable itself hasn't been bent or kinked. I haven't used that type of cable in a while but I have a vague recollection of there being different grades of certification based on the intended use (SAS, Ethernet, InfiniBand) so perhaps a replacement cable might be in order

Writing to TrueNAS is a lot slower than reading form it. I made sure again that the NICs are secured well but it still gives the same result. I'll order a new dac cable and see if that fixes it.

 

[jonat]

I just replaced the cables and the NICs but it looks like it still the same results. Not sure what to do now.

 

[danb35]

How is your NAS connected to your Windows computer? Direct point-to-point cable? A switch? More than one switch?

 

[jonat]

How is your NAS connected to your Windows computer? Direct point-to-point cable? A switch? More than one switch?

The NAS and the computer are connected to a CRS305 switch with DACs.

 

[HoneyBadger]

Is the CRS305 running SwitchOS or RouterOS?

 

[jonat]

I've tried both RouterOS and SwitchOS and they both net the same speeds. When I try to do a bandwidth test with RouterOS it does show that it could saturate the 10Gb that its capable of for both systems.

 

[jonat]

Ok so, I tried to use a peer to peer connection since I already have the extra cards and cables to for it. It now can saturate the full 10Gb connection. Now I'm confused if there is something that I have to configure with the CRS305 switch. I tried to reset the switch to its default settings and it still gives the throttled performance.