Suddenly dead server and i dono whats wrong

[airbornespoon]

I have a Plex server running on turenas 13.1 it was working fine then a couple days ago it was boot looping.

I've got a new HBA card in and its had no change, still won't boot with all the drives connected. i can connect up to 5 drives to the HBA card using 2x SAS to 4 SATA cables it doesnt matter what drives i connect or which cables i use it boots perfectly… as soon as i try to connect a 6th 7th or 8th drive to the SAS card it won't boot.
I've tried a different MB, different CPU, different PSU, different SAS HBA card, different cables, also tried swapping the HBA card to a different PCI slot with no change either. I honestly can't figure out WTF is wrong with this thing.

I got it to boot with 5 drives connected and then connected the other 3 and then in the shell i did zpool import -o readonly=on tank then my pool showed up as online and healthy on the main screen.
running zpool status shows everything as good to go as well but i cant access the files in windows and plex shows no data available. i have 11TB of videos on here that i cant figure out what the hell is wrong as to why i cant access them

Code:

root@truenas[~]# zpool status
  pool: boot-pool
 state: ONLINE
status: Some supported and requested features are not enabled on the pool.
        The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(7) for details.
  scan: scrub repaired 0B in 00:00:09 with 0 errors on Wed Feb 21 03:45:09 2024
config:

        NAME        STATE     READ WRITE CKSUM
        boot-pool   ONLINE       0     0     0
          nvd0p2    ONLINE       0     0     0

errors: No known data errors

  pool: tank
 state: ONLINE
  scan: scrub repaired 52K in 07:21:40 with 0 errors on Sun Feb  4 07:21:40 2024
config:

        NAME                                            STATE     READ WRITE CKSUM
        tank                                            ONLINE       0     0     0
          raidz2-0                                      ONLINE       0     0     0
            gptid/b592e2e0-abf7-11ec-a43a-000f532b2670  ONLINE       0     0     0
            gptid/b57fed1c-abf7-11ec-a43a-000f532b2670  ONLINE       0     0     0
            gptid/b5bac66d-abf7-11ec-a43a-000f532b2670  ONLINE       0     0     0
            gptid/b5d9fbac-abf7-11ec-a43a-000f532b2670  ONLINE       0     0     0
            gptid/b5bd5af1-abf7-11ec-a43a-000f532b2670  ONLINE       0     0     0
            gptid/b5d8a325-abf7-11ec-a43a-000f532b2670  ONLINE       0     0     0
            gptid/930550a8-93cb-11ee-b2c5-000f532b2670  ONLINE       0     0     0
            gptid/b60d2e8d-abf7-11ec-a43a-000f532b2670  ONLINE       0     0     0
        cache
          gptid/b43f6c84-abf7-11ec-a43a-000f532b2670    ONLINE       0     0     0

errors: No known data errors

 

[chuck32]

Please attach a detailed list of all your used hardware.

I read about a similar issue a few weeks ago, unfortunately that did not get resolved.

 

[airbornespoon]

Please attach a detailed list of all your used hardware.

I read about a similar issue a few weeks ago, unfortunately that did not get resolved.

Original build
MSI B550APro
AMD Ryzen 5 5600G
Boot drive WD Blue SN550 250GB M.2
G.Skill Aegis Series 64GB DDR4-2666
Solar flare 10GB SFP+ NIC
LSI 6Gbps SAS HBA LSI 9211-8i (=9201-8i) P20 IT Mode
8x 10TB WD red NAS drives
1x 480GB random brand SSD cache drive

Replacement parts for testing from a good working system.

MSI X570A pro
Ryzen 7 3700x
1x G.SKILL 8GB TridentZ DDR4 PC4-19200

replaced the HBA card with a new one also
And also used another Ryzen CPU but I don't remember what it was as I'm not at home to see it right now.