FreeNAS 9.10 crash on brand new Dell R630 Server

[mosh]

Hi,
I installed FreeNAS on a brand new Dell R630 server.
After configuring the server storage and sharing
using server RAID controller, RAID-1 for OS, and 5 disks configured at RAID-5
FreeNAS installation went well, and after a week of configuration I started moving data onto it using rsync
after a few hours the server crashed and I saw a UEFI0082 error (on the server's side) reporting that "the system was reset due to a timeout from the watchdog timer"
Dell checked the RAID and HW logs and didn't find any issues there

Any Idea what went wrong here?

-Mosh

 

[SweetAndLow]

Don't use raid! Did you read anything before setting this up? Watchdog error means there is a hardware problem. Did you test and burn everything in? I suspect your raid card is causing all the problems, get a supported hba and do it right.

Sent from my Nexus 5X using Tapatalk

 

[mosh]

Hi,
I installed FreeNAS on a brand new Dell R630 server.
After configuring the server storage and sharing
using server RAID controller, RAID-1 for OS, and 5 disks configured at RAID-5
FreeNAS installation went well, and after a week of configuration I started moving data onto it using rsync
after a few hours the server crashed and I saw a UEFI0082 error (on the server's side) reporting that "the system was reset due to a timeout from the watchdog timer"

Don't use raid! Did you read anything before setting this up? Watchdog error means there is a hardware problem. Did you test and burn everything in? I suspect your raid card is causing all the problems, get a supported hba and do it right.

Sent from my Nexus 5X using Tapatalk

Dell checked the RAID and HW logs and didn't find any issues there

Any Idea what went wrong here?

-Mosh

Don't use raid! Did you read anything before setting this up? Watchdog error means there is a hardware problem. Did you test and burn everything in? I suspect your raid card is causing all the problems, get a supported hba and do it right.

Sent from my Nexus 5X using Tapatalk

Hey,
Thanks for your tip
I've found this thread helpful
https://forums.freenas.org/index.ph...dell-servers-with-perc-h730-controller.46631/

I have switched my PERC H730 Mini controller to "HBA Mode"
and I've setup Z1 on 5 disks

Then, I'd like to mirror the OS disk as well, but i don't think it is possible now.
reading here, i saw there is such an option to combine RAID with Non-RAID disks on this controller
http://www.mrvsan.com/configuring-the-dell-perc-h730-controller-for-passthrough-and-raid/

So,
I was thinking switching back to RAID Mode and make the OS sit on RAID 1
while the rest of the disks will be Non-RAID, so I can turn them into a volume using FreeNAS

Did anyone had experience with this type of disk configuration?
What driver I'd have to use to make it work? mfi? mrsas?

Thanks'
Mosh

 

[SweetAndLow]

Hey,
Thanks for your tip
I've found this thread helpful
https://forums.freenas.org/index.ph...dell-servers-with-perc-h730-controller.46631/

I have switched my PERC H730 Mini controller to "HBA Mode"
and I've setup Z1 on 5 disks

Then, I'd like to mirror the OS disk as well, but i don't think it is possible now.
reading here, i saw there is such an option to combine RAID with Non-RAID disks on this controller
http://www.mrvsan.com/configuring-the-dell-perc-h730-controller-for-passthrough-and-raid/

So,
I was thinking switching back to RAID Mode and make the OS sit on RAID 1
while the rest of the disks will be Non-RAID, so I can turn them into a volume using FreeNAS

Did anyone had experience with this type of disk configuration?
What driver I'd have to use to make it work? mfi? mrsas?

Thanks'
Mosh

Why can't you just mirror your boot devices?

Sent from my Nexus 5X using Tapatalk

 

[mosh]

Why can't you just mirror your boot devices?

Sent from my Nexus 5X using Tapatalk

I'm considering other options as well. maybe this hybrid mode will allow me to enjoy both technologies.
BTW,
I'm trying to switch from mfi to mrsas
I did the necessary changes (and reboot) and it still using mfi drivers. Any idea what as I missing here?

Code:

[root@freenas] /boot# grep mrsas /boot/loader.conf
mrsas_load="yes"

[root@freenas] /boot# grep mrsas /boot/device.hints
hw.mfi.mrsas_enable="1"

[root@freenas] /boot# camcontrol devlist
<ATA SSDSC2BB120G7R DL41>  at scbus0 target 0 lun 0 (pass0)
<ATA SSDSC2BB120G7R DL41>  at scbus0 target 1 lun 0 (pass1)
<ATA INTEL SSDSC2BX01 DL2B>  at scbus0 target 2 lun 0 (pass2)
<ATA INTEL SSDSC2BX01 DL2B>  at scbus0 target 3 lun 0 (pass3)
<ATA INTEL SSDSC2BX01 DL2B>  at scbus0 target 4 lun 0 (pass4)
<ATA INTEL SSDSC2BX01 DL2B>  at scbus0 target 5 lun 0 (pass5)
<ATA INTEL SSDSC2BX01 DL2B>  at scbus0 target 6 lun 0 (pass6)

[root@freenas] /boot# dmesg | grep mrsas
AVAGO MegaRAID SAS FreeBSD mrsas driver version: 06.709.07.00-fbsd

[root@freenas] /boot# mfiutil show adapter
mfi0 Adapter:
  Product Name: PERC H730 Mini
  Serial Number: 67C00AU
  Firmware: 25.4.1.0004
  RAID Levels:
  Battery Backup: present
  NVRAM: 32K
  Onboard Memory: 1024M
  Minimum Stripe: 64K
  Maximum Stripe: 1M

[root@freenas] /boot# mfiutil show drives
mfi0 Physical Drives:
0 (  112G) JBOD <SSDSC2BB120G7R DL41 serial=PHDV651400BD150MGN> SATA E1:S0
1 (  112G) JBOD <SSDSC2BB120G7R DL41 serial=PHDV6514003P150MGN> SATA E1:S1
2 ( 1490G) JBOD <INTEL SSDSC2BX01 DL2B serial=BTHC647104UR1P6PGN> SATA E1:S2
3 ( 1490G) JBOD <INTEL SSDSC2BX01 DL2B serial=BTHC648600R21P6PGN> SATA E1:S3
4 ( 1490G) JBOD <INTEL SSDSC2BX01 DL2B serial=BTHC647104VY1P6PGN> SATA E1:S4
5 ( 1490G) JBOD <INTEL SSDSC2BX01 DL2B serial=BTHC648600QJ1P6PGN> SATA E1:S5
6 ( 1490G) JBOD <INTEL SSDSC2BX01 DL2B serial=BTHC647104DD1P6PGN> SATA E1:S6

 

[mosh]

I'm considering other options as well. maybe this hybrid mode will allow me to enjoy both technologies.
BTW,
I'm trying to switch from mfi to mrsas
I did the necessary changes (and reboot) and it still using mfi drivers. Any idea what as I missing here?

Code:

[root@freenas] /boot# grep mrsas /boot/loader.conf
mrsas_load="yes"

[root@freenas] /boot# grep mrsas /boot/device.hints
hw.mfi.mrsas_enable="1"

[root@freenas] /boot# camcontrol devlist
<ATA SSDSC2BB120G7R DL41>  at scbus0 target 0 lun 0 (pass0)
<ATA SSDSC2BB120G7R DL41>  at scbus0 target 1 lun 0 (pass1)
<ATA INTEL SSDSC2BX01 DL2B>  at scbus0 target 2 lun 0 (pass2)
<ATA INTEL SSDSC2BX01 DL2B>  at scbus0 target 3 lun 0 (pass3)
<ATA INTEL SSDSC2BX01 DL2B>  at scbus0 target 4 lun 0 (pass4)
<ATA INTEL SSDSC2BX01 DL2B>  at scbus0 target 5 lun 0 (pass5)
<ATA INTEL SSDSC2BX01 DL2B>  at scbus0 target 6 lun 0 (pass6)

[root@freenas] /boot# dmesg | grep mrsas
AVAGO MegaRAID SAS FreeBSD mrsas driver version: 06.709.07.00-fbsd

[root@freenas] /boot# mfiutil show adapter
mfi0 Adapter:
  Product Name: PERC H730 Mini
  Serial Number: 67C00AU
  Firmware: 25.4.1.0004
  RAID Levels:
  Battery Backup: present
  NVRAM: 32K
  Onboard Memory: 1024M
  Minimum Stripe: 64K
  Maximum Stripe: 1M

[root@freenas] /boot# mfiutil show drives
mfi0 Physical Drives:
0 (  112G) JBOD <SSDSC2BB120G7R DL41 serial=PHDV651400BD150MGN> SATA E1:S0
1 (  112G) JBOD <SSDSC2BB120G7R DL41 serial=PHDV6514003P150MGN> SATA E1:S1
2 ( 1490G) JBOD <INTEL SSDSC2BX01 DL2B serial=BTHC647104UR1P6PGN> SATA E1:S2
3 ( 1490G) JBOD <INTEL SSDSC2BX01 DL2B serial=BTHC648600R21P6PGN> SATA E1:S3
4 ( 1490G) JBOD <INTEL SSDSC2BX01 DL2B serial=BTHC647104VY1P6PGN> SATA E1:S4
5 ( 1490G) JBOD <INTEL SSDSC2BX01 DL2B serial=BTHC648600QJ1P6PGN> SATA E1:S5
6 ( 1490G) JBOD <INTEL SSDSC2BX01 DL2B serial=BTHC647104DD1P6PGN> SATA E1:S6

when running kldstat, i do not see mrsas.ko in the list
how can i fetch it?