SM X10DRH-CLN4 + IBM SAS Expander

kjs

Cadet
Joined
Nov 10, 2019
Messages
2
Hello,

I have a Freenas on 11.2U7 running for 3 years without any issue. I only use LSI 3008 and USB but currently I'm trying to expand/improve it and I'm sure that I'm doing something bad.


HW:
SM X10DRH-CLN4+ 1.01v (LSI 3008 IT mode 16.0)
2x Intel E5-2673 V3
32GB ECC RAM
IBM SAS EXPANDER 46m0997 (0.634a FW updated from 0.510)
LogiCase SC-4824

BOOT:
2x Toshiba 64GB USB 3.1
2x3 raidz1 disk (4TB WD RED -> pool tank)

unused
2 x 2TB Segate
2 x 512 SSD
7 x 1TB (HGST)

Cabling:

3008 p1 (8643) -> (8087) SAS Expander (8087) -> (8087) backplane -> 3x WD vdev1
3008 p2 (8642) -> (8087) SAS Expander (8087) -> (8087) backplane -> 3x WD vdev2
-> (8087) backplane -> 4x HGST 1TB
-> (8087) backplane -> 3x HGST 1TB

SATA/SAS MB (8087) -> (8087) backplane -> 2x 2TB
SATA MB (SATA) -> reverse breakout (8087) -> (8087) backplane -> 2x 512 SSD

The problem is with expander. When I plug it without any disk I can detect it as "ses0" and I could upgrade it from 510 to 634, but when I plug any disk into SAS expander I cannot reboot the system because Freenas couldn't start (Ikvm_capture.jpg) and if I hot plug any disk sometime can handle it and sometimes the systems reboots.

In the bios (disabled boot from SAS) I can see all the disks.


Anybody have any idea or I return back SAS expander?
 

Attachments

  • iKVM_capture.jpg
    iKVM_capture.jpg
    268.7 KB · Views: 207
Top