Distinguish Nics - peer to peer problems - TrueNas12

[FabianX2]

Hey,

I did read posts with similar but not same problems with the Asus C100C. In general I´m a noob any help would be appreciated.

NAS-System: TrueNAS 12 U1 (fresh install) R7 2700/AsRock Rack/64gb Ram/LSI SAS9220-8i (Pool 1 5x8TB), 2x 120 GB SSD (System), 2x1TB NVMe (SSD-Pool), External Drives for Backup, 4TB intern, Asus XG-C100C.

My Network is a consistent Unify network, but I couldn’t bring myself to spend 500€ for the 10GbE Switch. So I want to do what many others have done. Build a peer to peer 10Gbit between NAS and Workstation and leave the rest at 1Gbit for now.

The NAS has 4 Nics. On board: 2x1gbe + 1 for IPMI and an Asus XF-C100C 10 GbE. My Workstation has 1x 1Gbe + 1x C100C 10 GbE.


Problem 1:
How to identify the right Nic. Three Nics are detected and show up in UI (Shouldn’t it be four?). The two 1GbE Nics are recognizable. The third one has no information whatsoever. Just the name ue0. How do I know if that’s the IPMI Nic or the C100C? Couldn’t find information in the shell either. IPMI was detected automatically on the first boot up. So if it is the IPMI Nic. How to enable the C100C?

Problem 2:
Assuming the ue0 is the C100C I gave it a static ip (111.1.1.55/24) the workstation got (111.1.1.56 255.0.0.0 also tried 255.255.255.0 – just in case I did misunderstand the principle). 100% packets loss both ways. The Rest of my Network operates between 192.168.1.1 and 192.168.1.254 usually about 20 Devices with Ips most static. But max. 2 heavy unseres at once.

Thanks in advance,
Bob

 

[Chris Moore]

NAS-System: TrueNAS 12 U1 (fresh install) R7 2700/AsRock Rack/64gb Ram/LSI SAS9220-8i (Pool 1 5x8TB), 2x 120 GB SSD (System), 2x1TB NVMe (SSD-Pool), External Drives for Backup, 4TB intern, Asus XG-C100C.

This post has some useful guidance on the kind of information is handy for us to have when helping you:

Forum Rules

Welcome to the TrueNAS Community! Updated 11/28/2023 First and foremost I want to thank you for joining the TrueNAS community! My name is JoshDW19 and I'm the Community Manager here at TrueNAS. The TrueNAS Community is a friendly place to discuss open source software, technology, and products...

www.truenas.com

How to identify the right Nic. Three Nics are detected and show up in UI (Shouldn’t it be four?).

No. The IPMI management port does not show up in the list of regular NICs. Just the two

On board: 2x1gbe

1Gb and the

Asus XF-C100C

10Gb. So, my guess is that the one identified as

Just the name ue0

is your 10Gb port.

Assuming the ue0 is the C100C I gave it a static ip (111.1.1.55/24) the workstation got (111.1.1.56

It has been a LONG time since I studied subnetting in school, but I do remember that is NOT a valid address space for your internal network. You can't just pick numbers out of the air.

IPv4 Private Address Space and Filtering

• 10.0. 0.0/8 IP addresses: 10.0. 0.0 – 10.255. 255.255.
• 172.16. 0.0/12 IP addresses: 172.16. 0.0 – 172.31. 255.255.
• 192.168. 0.0/16 IP addresses: 192.168. 0.0 – 192.168. 255.255.

The Rest of my Network operates between 192.168.1.1 and 192.168.1.254 usually about 20 Devices with Ips most static.

Since you are using the 192.168.1.x range for your main network, I would suggest using the 192.168.2.x range for this "special" network between your NAS and your desktop. You would want to use the net mask 255.255.255.0 on everything.

 

[FabianX2]

Your completly right. The Ip I randomly chose is a public one. Its quite late in Germany. Hope that will make a diffrece. I´ll change that right now. Thanks for the reply.

 

[FabianX2]

So to not be to annoying I tried all I could think of for now bevor asking again. The web interface and therefore the 1GbE Nic is set to 192.168.1.123/24. As long as I don’t temper with any network settings the web interface is reachable though the 1gbe nic.

1. Try: I changed the 10 GbE Nics IP in the UI to 192.168.5.111/24 on the Server and to 192.168.5.112/24 on my PC. After applying the test phase the web interface becomes unreachable. The Windows Adapter shows the no cable sign. No Pings do get through. The web interface became although unreachable for the 1Gbe Nic.

2. Try: I changed the IP via KVM (same values as above). Same result as above. I than changed the settings of the 1GbE Nic in expectation to make it reachable again. Which is partly what happened. Now the Web interface should have been reachable under 192.168.1.123 and under 192.168.5.111. The 10Gbe IP again did nothing. The 1 GbE Nic worked - kind of. It was really leggy not all options where available in the Ui.

Now I stated to wonder if there is a general hardware problem. So I applied my old Image of a Proxmox System running FreeNAS as VM which I used successfully for a year with 1GbE bevor I started to try to switch to a native TrueNAS System and 10GbE today. I did bridge the 10GbE Nic to the FreeNAS VM and did set up the same Ips as mention above. And it worked. Not as fast as I would have liked bit with about 180 mb/s definitely more than the 1 GbE nic could provide. To be sure I disabled the 1 GbE Nic in Windows and had still the same speed.

Conclusion: Nic is works. Client side works. FreeNAS as VM in Proxmox works. Native TrueNAs does not. Why? No Clue.