SOLVED Strange networking issue

Threevil

Cadet
Joined
Apr 5, 2016
Messages
6
I've been beating my head over this issue and so far don't have any solution. So I rebuilt my server about 8 months ago and upgraded from FreeNAS 11.2 to 11.3, to TrueNAS 12 Core, to TrueNAS 12 Scale. I was originally using a mixer of jails and a rancher-based VM for dockers for those things that weren't FreeBSD compatible, but since was upgrading to Scale, I migrated what I could to Kubernetes and the rest stayed dockers for now. Everything had been working swimmingly. Suddenly last night, the network interface goes out. Nothing has changed recently on my setup, not even a new docker. I've tried rebooting, powering everything off, skipping my switch and going directly to the router, and even unplugging and reseating the network card, all without success. I can say something is connecting as any time I disconnect the link goes down on the screen and reconnect the ethernet cable the link goes up on the screen. I have a new ethernet card on order but wanted to ask on the forum to see if I'm missing anything glaring.

Hardware:
Ryzen 9 5900X
GIGABYTE B550 AORUS MASTER ATX
G.SKILL 32GB 2X16 D4 3200 RIPJAWS x4
Intel Gigabit CT PCI-E Network Adapter EXPI9301CTBLK
LSI Logic SAS9200-8E 8PORT Ext 6GB Sata+sas Pcie 2.0
THINKSERVER SA120 DIRECT ATTACHED STORAGE

The adapter is up and IPed. I cannot ping out and I cannot reach the TrueNAS web interface. This is a brand new problem, has never happened before and no changes have been made to the setup.

Please let me know if I'm missing anything and thank you for your help.
 

NugentS

MVP
Joined
Apr 16, 2020
Messages
2,947
What error message do you get when you try to ping the router?
 

WN1X

Explorer
Joined
Dec 2, 2019
Messages
77
I know it sounds obvious, but have you tried replacing the ethernet cable?
 

Threevil

Cadet
Joined
Apr 5, 2016
Messages
6
I know it sounds obvious, but have you tried replacing the ethernet cable?
No worries, I'm glad for any input. Yes I replaced the ethernet cable all the way to the router and moved it to a known good port a different device was using just in case. I also cable tested the new cable and there is continuity on all 8 leads, and all of them are properly connected (1 to 1, 2 to 2, etc).
 

Threevil

Cadet
Joined
Apr 5, 2016
Messages
6
As additional information, I've now performed testing with a bootable thumbdrive both with the Ubuntu Live ISO as well as a bootable Windows USB stick made with Hasleo WinToUSB Free. Both were unable to reach the network. Given all the mounting evidence, I'm becoming more and more convinced there's some sort of hardware failure, as this was working for 8 months and suddenly stopped working for the entire box with no changes or upgrades made anywhere on the network.

I think my next plan is to attempt to move the PCI-E card to the only other available slot on the motherboard, however, I'm not sure there is room. I should also have a replacement ethernet card tomorrow assuming Amazon is on time.
 

Threevil

Cadet
Joined
Apr 5, 2016
Messages
6
I just wanted to update you that I was able to solve my problem and it had nothing to do with the server. Apparently, not one but 2 ports on my router failed. They light up as if they are communicating but do nothing. When I moved the server to the 3rd port, everything instantly resolved and began communicating. Thank you very much for your assistance.
 

NugentS

MVP
Joined
Apr 16, 2020
Messages
2,947
It used to be that switches failed four ports at a time, because 1 chip managed four ports. I guess its something similar here
 
Top