10gb link to Xen server

[Loren Zimmer]

Hello,

I've been trying to get a 10gb link to work between xcp-ng and freenas. I have two Dell R710s with a Chelsio S310E-CR 10Gb in each one and a direct connection between them. I'm able to ping between the two servers and from VMs residing on the servers to the hosts. I have TrueNAS running as a VM on the second server. It is not able to ping the host at 10.1.10.2. Here is the current configuration:

Code:

lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1
        inet 127.0.0.1 netmask 0xff000000
        groups: lo
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
pflog0: flags=0<> metric 0 mtu 33160
        groups: pflog
xn0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        description: xn0
        options=503<RXCSUM,TXCSUM,TSO4,LRO>
        ether 3e:36:d8:7d:bd:6c
        inet 192.168.17.27 netmask 0xffffff00 broadcast 192.168.17.255
        media: Ethernet manual
        status: active
        nd6 options=9<PERFORMNUD,IFDISABLED>
xn1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
        description: xn1
        options=503<RXCSUM,TXCSUM,TSO4,LRO>
        ether 9e:0b:d3:f2:3c:ca
        inet 10.1.10.10 netmask 0xffffff00 broadcast 10.1.10.255
        media: Ethernet manual
        status: active
        nd6 options=9<PERFORMNUD,IFDISABLED>

I've tried to a little googling about this and thought that routing might be a problem but the routing tables seem to be correct:

Code:

root@freenasTwo:~ # route show 10.1.10.0
   route to: 10.1.10.0
destination: 10.1.10.0
       mask: 255.255.255.0
        fib: 0
  interface: xn1
      flags: <UP,DONE,PINNED>
 recvpipe  sendpipe  ssthresh  rtt,msec    mtu        weight    expire
       0         0         0         0      9000         1         0

I also went so far as to install pfsense as a VM on the same host and to set xn1 to DHCP. That has been unsucessfull.

Does anyone have any suggestions as to how I can track this issue down to ultimately use that 10gb link for some iSCSI storage.

Any help would be greatly appreciated.

 

[Elliot Dierksen]

Have you tried arp -a ? No ping response doesn't mean you can't reach it. A number of things (including windows) don't respond to pings because of host firewall rules. If there is an ARP entry, you can see it to some degree. Are there other hosts on the 10.1.10.0/24 network you can reach?