TrueNas with quad 10GBE card

mst

Explorer
Joined
Aug 17, 2014
Messages
95
Experts,

Is it possible to use 10GB quad Intel X540 for ISCSI and each hosts with single port card X540? In that way all 3 hosts would hive direct connection to Freenas besically skipping the switch.

Thank you
 
Last edited:

hescominsoon

Patron
Joined
Jul 27, 2016
Messages
449
yes it is...I have my 520 and 310 connected directly via 10gig sfp+.
 

hescominsoon

Patron
Joined
Jul 27, 2016
Messages
449
in my case 10GB ethernet
it should still not be a problem. modern cards do not usually reqquire a specially built x-over cable. If your nic does they are easy to make or procure..still no switch required.
 

jgreco

Resident Grinch
Joined
May 29, 2011
Messages
18,681
in my case 10GB ethernet

The X540 only does ethernet, no other protocols.

If you meant "in my case 10Gbit copper", do be aware that 10Gbit SFP+ is definitely ethernet; when someone in the industry says "10 gig ethernet", they are probably talking about SFP+.

Uses less power.

Lower latency.

Better technology.

:smile:

I find it mildly curious that you would want a quad 10G card with direct connects to clients but not want to use the lower latency SFP+ stuff. Dedicating ports will get you guaranteed bandwidth, I suppose.
 

mst

Explorer
Joined
Aug 17, 2014
Messages
95
ok what network should look like for ISCSI with quad port? Each port should have different IP? for example
172.16.100.101/24 to Proxmox host 172.16.100.102/24
172.16.100.103/24 to Proxmox host 172.16.100.104/24
172.16.100.105/24 to proxmox host 172.16.100.106/24
4th port not configured
?
 

jgreco

Resident Grinch
Joined
May 29, 2011
Messages
18,681
No, that won't work, because those addresses are in the same broadcast domain, but are separate networks. You need to create separate IPv4 networks.

Number the first one 172.16.100.10/24 to a host at 172.16.100.11/24.
Number the second one 172.16.101.10/24 to a host at 172.16.101.11/24.
Number the third one 172.16.102.10/24 to a host at 172.16.102.11/24.

When you try to create multiple interfaces and configure them into what appears to be the same broadcast domain, UNIX will happily send packets for that network out of any of the interfaces. So you actually need to do what I've shown you to set up properly designed networking.
 

mst

Explorer
Joined
Aug 17, 2014
Messages
95
All works as expected - now I have to figure out hot to set it up on the proxmox side sense their documentation simply is outdated and SUCKS
 
Top