SOLVED How do to Install Iperf

[GrimmSh0t]

How do I install Iperf3 on TrueNAS scale?

Very new to TrueNAS overall!

Thanks

 

[dffvb]

you dont, scale comes wiht it ;-) Go to System Setting > Shell, enter iper, press tab there you go

 

[GrimmSh0t]

you dont, scale comes wiht it ;-) Go to System Setting > Shell, enter iper, press tab there you go

@dffvb - thanks a bunch for the response, good gosh I feel like a knucklehead...Now its time to find out my network issue...10GB and I'm getting 1.99GB speed yuck!

 

[dffvb]

Have you tried -P 20 ? With this I get nearly full10 Gbit speed, howevery compared to CORE, SCALE is slow af - like 300 MB/s write speeds, and 500-600 MB/s read speed, whereas CORE constantly gave me full 1 GB/s speeds...

 

[GrimmSh0t]

Have you tried -P 20 ? With this I get nearly full10 Gbit speed, howevery compared to CORE, SCALE is slow af - like 300 MB/s write speeds, and 500-600 MB/s read speed, whereas CORE constantly gave me full 1 GB/s speeds...

NOTE: Prior to installing TrueNAS Scale I had Windows 2022 w/HyperV (TrueNAS Virtual) and would get 930-950Gbits/sec

• Tried some tunables from the forum
• Reinstalled TrueNAS - No data yet
• Reformatted my windows 11 box (did all kinds of tweaks, forgot what the hell I did - so many settings lol)
• Jumbo Frames 9000
• Disconnect one of the 10GB ports so I only have one port going

At this point I'm just testing the network, then I'll worry about the pool(s)

• System has Dual Xeon Bronze w/ 96GB of ECC (maybe I am missing the magic check box lol...)

2.79 Gbits/sec - Windows 11 to TrueNAS (10GB - ConnectX3)

6.63 Gbits/sec - TrueNAS to Windows 11 (10GB - ConnectX3)

 

[morganL]

Its similar performance to this thread:

Slow iperf performance in Scale compared to Core

I'm getting poor performance in iperf3 compared to what I got when running TrueNAS Core on the same system/hardware. I have a 10GBe network and is having an Intel X520-DA adapter on my TrueNas Scale. Scale is not running the latest ixgbe driver from Intel but I guess it is tuned for its use. Do...

www.truenas.com

Are you also using an Intel X520 NIC? (Might be a driver issue)

Typically these performance issues are caused by TCP misconfigurations for 10Gbe.
Would you like to investigate how each system is configured?

Things like slow start are good for WAN and high client count applications... but not good for low latency machine-to-machine optimizations.

 

[GrimmSh0t]

Its similar performance to this thread:

Slow iperf performance in Scale compared to Core

I'm getting poor performance in iperf3 compared to what I got when running TrueNAS Core on the same system/hardware. I have a 10GBe network and is having an Intel X520-DA adapter on my TrueNas Scale. Scale is not running the latest ixgbe driver from Intel but I guess it is tuned for its use. Do...

www.truenas.com

Are you also using an Intel X520 NIC? (Might be a driver issue)

Typically these performance issues are caused by TCP misconfigurations for 10Gbe.
Would you like to investigate how each system is configured?

Things like slow start are good for WAN and high client count applications... but not good for low latency machine-to-machine optimizations.

Thanks for the reply, the network card is a CX312A Mellanox ConnectX-3 EN Dual Port 10GB SFP+, so not an Intel NIC...I will take a look what you posted. Also keep in mind, I've had TrueNAS Scale on Windows 2022 w/ HyperV and it ran at full speed. Only difference is its bare metal now.

 

[GrimmSh0t]

@morganL
Tried the different tweaks from what you posted, no luck :(
Prior to even installing the cards I did drop them in Windows and updated the firmware so I know that's up to date.

CX312A Mellanox ConnectX-3 EN Dual Port 10GB SFP+

 

[GrimmSh0t]

@All - Thanks for the responses, I believe its solved. The CX312A Mellanox ConnectX-3 EN Dual Port 10GB SFP+ is an x8 card and I actually it slotted in an x16 slot. Now its sitting in a PCIE 3x 16 (8.4.1)

I guess my learn of the day - put the card in the right spot....

Before: x16 slot (8x card)

After - PCIE 3x 16 (8.4.1)

Thanks again

 

[morganL]

@All - Thanks for the responses, I believe its solved. The CX312A Mellanox ConnectX-3 EN Dual Port 10GB SFP+ is an x8 card and I actually it slotted in an x16 slot. Now its sitting in a PCIE 3x 16 (8.4.1)

I guess my learn of the day - put the card in the right spot....

Before: x16 slot (8x card)
View attachment 53581



After - PCIE 3x 16 (8.4.1)
View attachment 53580

Thanks again

Glad it is solved.. sorry for sending you on a wild goose chase on TCP settings.

 

[GrimmSh0t]

Glad it is solved.. sorry for sending you on a wild goose chase on TCP settings.

@morganL - You did not send me on a wild goose chase, I'm glad you took the time to respond. Through you link I discovered other links which led me to the x16 etc...
Have a great day!

 

[majerus]

Thanks for this thread, honestly I was able to get great speeds out of it right out of the box from a core -> scale migration.

 

[toadman]

Hi,

You confused me. :) The 312A is a PCIe 3.0 x4/x8 card. i.e. should work in any slot x4, x8, x16. So sure, it's won't utilize x16 bandwidth, but putting it in a x16 slot won't hurt.

And it did work, just not at line speed. Are you saying you had it in a PCIe 1.0 or 2.0 slot, and putting it in a PCIe 3.0 slot solved your issue? (i.e you said, "is an x8 card and I actually it slotted in an x16 slot. (Should be irrelevant.) Now its sitting in a PCIE 3x 16" It's still a x4/x8 card no matter what slot it's in.