Successfully mounted SMB share on Linux system but speeds aren't right.

[DenisInternet]

Hello again!

Still a Linux newbie but learning a little bit more everyday. So after reading through the forums for a bit, I am still not exactly sure what is causing the slow speed on my linux system (PopOS) in comparison to my Mac system.

Connecting to SMB share using the following command:

Code:

 sudo mount -t cifs -o username=denismac //192.168.2.251/Post_Main /mnt/Post_Main 

I get very different results on the two systems. (Both connected via SFP28 25Gbe connections.

Any pointers / ideas what I should be looking at / reading more about?

Thank you!

Code:

Speeds between TrueNAS and MacOS system.
Server listening on 5201 (test #1)
Accepted connection from 192.168.1.253, port 34242
[  5] local 192.168.1.251 port 5201 connected to 192.168.1.253 port 34244
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.01   sec  1.98 GBytes  16.9 Gbits/sec                  
[  5]   1.01-2.01   sec  2.07 GBytes  17.8 Gbits/sec                  
[  5]   2.01-3.01   sec  1.98 GBytes  17.0 Gbits/sec                  
[  5]   3.01-4.00   sec  2.02 GBytes  17.4 Gbits/sec                  
[  5]   4.00-5.01   sec  2.04 GBytes  17.4 Gbits/sec                  
[  5]   5.01-6.01   sec  2.02 GBytes  17.3 Gbits/sec                  
[  5]   6.01-7.01   sec  1.98 GBytes  17.0 Gbits/sec                  
[  5]   7.01-8.01   sec  1.99 GBytes  17.1 Gbits/sec                  
[  5]   8.01-9.01   sec  1.94 GBytes  16.6 Gbits/sec                  
[  5]   9.01-10.00  sec  1.97 GBytes  17.0 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec  20.0 GBytes  17.2 Gbits/sec                  receiver

Code:

Speeds between TrueNAS and PopOS system.
dpop@pop-os:~$ iperf3 -c 192.168.2.251
Connecting to host 192.168.2.251, port 5201
[  5] local 192.168.2.253 port 43344 connected to 192.168.2.251 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  50.6 MBytes   424 Mbits/sec  226    197 KBytes       
[  5]   1.00-2.00   sec  47.8 MBytes   401 Mbits/sec   11    170 KBytes       
[  5]   2.00-3.00   sec  50.0 MBytes   420 Mbits/sec    8    161 KBytes       
[  5]   3.00-4.00   sec  48.5 MBytes   407 Mbits/sec    8    192 KBytes       
[  5]   4.00-5.00   sec  48.6 MBytes   408 Mbits/sec   13    157 KBytes       
[  5]   5.00-6.00   sec  47.8 MBytes   401 Mbits/sec    8    192 KBytes       
[  5]   6.00-7.00   sec  49.7 MBytes   417 Mbits/sec    9    160 KBytes       
[  5]   7.00-8.00   sec  48.1 MBytes   404 Mbits/sec   16    192 KBytes       
[  5]   8.00-9.00   sec  48.8 MBytes   409 Mbits/sec    7    167 KBytes       
[  5]   9.00-10.00  sec  48.1 MBytes   403 Mbits/sec    9    133 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   488 MBytes   409 Mbits/sec  315             sender
[  5]   0.00-10.00  sec   487 MBytes   408 Mbits/sec                  receiver

 

[Whattteva]

Dang, that doesn't even reach 1G. Can you do the iperf between the PopOS and the Mac and post the results?

 

[DenisInternet]

Dang, that doesn't even reach 1G. Can you do the iperf between the PopOS and the Mac and post the results?

I am not sure I can connect them as they are on different connections?
192.168.1.251 vs 192.168.2.253

A rough visual of my setup below. (Not sure if this helps)

 

[Whattteva]

Should be

I am not sure I can connect them as they are on different connections?
192.168.1.251 vs 192.168.2.253

Should be fine as long as you have an L3 router that joins the two networks. This does introduce a new variable though (the router's performance) into the speed equation, so you no longer can make an apples-to-apples comparison.

A rough visual of my setup below. (Not sure if this helps)

View attachment 74825

I love your diagram!!!
Let me decipher this to make sure I get this right:

1. Switch
2. Multishelf:
   1. Modem/another switch/router? I am not sure what this device is.
   2. I am also not sure what this device is.
   3. Mac machine.
3. Windows/Linux machine?
4. TrueNAS.

Ok, I get that the top box looks like your switch. The third box is a Linux/Windows machine? Bottom box is your TrueNAS server.

 

[chuck32]

I don't really get your representation. The mac is connected via thunderbolt to a device I can't makeout. And from there it goes to your switch.

The windows/linux machine is connected to the switch and to truenas?
How is that connection realized:

If they are on separate networks, are you actually using the correct IP / network interface? Judging from your diagram I doubt you missed that though.

 

[DenisInternet]

Should be

Should be fine as long as you have an L3 router that joins the two networks. This does introduce a new variable though (the router's performance) into the speed equation, so you no longer can make an apples-to-apples comparison.


I love your diagram!!!
Let me decipher this to make sure I get this right:

1. Switch
2. Multishelf:
   1. Modem/another switch/router? I am not sure what this device is.
   2. I am also not sure what this device is.
   3. Mac machine.
3. Windows/Linux machine?
4. TrueNAS.

Ok, I get that the top box looks like your switch. The third box is a Linux/Windows machine? Bottom box is your TrueNAS server.

Ha thanks :)

1. Yep that's the switch MikroTik CRS504-4XQ-IN
2. Multishelf:

1. Xfinity provided Modem/router (For internet/wifi).
2. Thunderbolt3 to NIC Adapter: Sonnet Twin25G
3. Mac Studio (Apple System).

3. Linux PC running PopOS (I am running Docker/Nextcloud on it) this is the machine that has the slow connection.
4. TrueNAS.

​

 

[chuck32]

So truenas actually has two connections to the switch? The linux machine has one and your Thunderbolt NIC adapter. So in total 4 ports on your switch are occupied with 25 Gb connections?

Did you try switching ports / NICs?

 

[DenisInternet]

I don't really get your representation. The mac is connected via thunderbolt to a device I can't makeout. And from there it goes to your switch.

The windows/linux machine is connected to the switch and to truenas?
How is that connection realized:
View attachment 74830

If they are on separate networks, are you actually using the correct IP / network interface? Judging from your diagram I doubt you missed that though.

Hey, thanks for asking!

Does this make the diagram clearer?

 

[DenisInternet]

So truenas actually has two connections to the switch? The linux machine has one and your Thunderbolt NIC adapter. So in total 4 ports on your switch are occupied with 25 Gb connections?

Did you try switching ports / NICs?

Yes, I suppose I could simplify things, and just have a single 25Gbe connection from TrueNAS to the switch and see if that makes things easier. I thought by giving a second dedicated connection I could increase speed/performance when I really push the systems (Rendering footage with DaVinci Resolve on the Mac while rendering Houdini sims on the linux pc).

I haven't tried switching ports / NICs yet. I guess I could try that next?

 

[probain]

Yes, I suppose I could simplify things, and just have a single 25Gbe connection from TrueNAS to the switch and see if that makes things easier. I thought by giving a second dedicated connection I could increase speed/performance when I really push the systems (Rendering footage with DaVinci Resolve on the Mac while rendering Houdini sims on the linux pc).

I haven't tried switching ports / NICs yet. I guess I could try that next?

You would probably want to do some link aggregation then instead (switch needs to be aware and configured for this too). And have the new aggregated interfaces assigned to a bridge in the Truenas internally. That is if you really need it to be on multiple subnets.. But I could be wrong.

 

[DenisInternet]

That did the trick! Simplified the setup for now all under one subnet and now getting the correct speeds. Will look into if link aggregation is worth it (and supported by the NICs I am using).

Code:

dpop@pop-os:~$ iperf3 -c 192.168.1.253
Connecting to host 192.168.1.253, port 5201
[  5] local 192.168.1.252 port 44454 connected to 192.168.1.253 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  2.69 GBytes  23.1 Gbits/sec    0   3.14 MBytes       
[  5]   1.00-2.00   sec  2.73 GBytes  23.5 Gbits/sec    0   3.14 MBytes       
[  5]   2.00-3.00   sec  2.72 GBytes  23.4 Gbits/sec    0   3.14 MBytes       
[  5]   3.00-4.00   sec  2.73 GBytes  23.5 Gbits/sec    0   3.14 MBytes       
[  5]   4.00-5.00   sec  2.74 GBytes  23.5 Gbits/sec    0   3.14 MBytes       
[  5]   5.00-6.00   sec  2.73 GBytes  23.4 Gbits/sec    0   3.14 MBytes       
[  5]   6.00-7.00   sec  2.74 GBytes  23.6 Gbits/sec    0   3.14 MBytes       
[  5]   7.00-8.00   sec  2.71 GBytes  23.3 Gbits/sec    0   3.14 MBytes       
[  5]   8.00-9.00   sec  2.74 GBytes  23.5 Gbits/sec    0   3.14 MBytes       
[  5]   9.00-10.00  sec  2.73 GBytes  23.5 Gbits/sec    0   3.14 MBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  27.3 GBytes  23.4 Gbits/sec    0             sender
[  5]   0.00-10.00  sec  27.3 GBytes  23.4 Gbits/sec                  receiver

Thank you all very much!