Have one of those 36 b bay older supermicro's with 36 3TB drives. Freenas is running great.
Ended up with a free HP MSA-70 with 25 1TB drives in it, that is/was functioning fine on an HP server running esx.
Buy a 3208 external and the cables, drop the board in, hook up the SAS enclosure, and... well, not pretty.
Had to disable the bootable option on the LSI controller or the supermicro board wouldn't even get past the option rom, but that's OK, don't really need it.
FreeNAS boots, and the original pool imports fine, but I'm getting this other kazillion errors on the MSA-70/controller. (also, btw, with the errors pouring out on the dmesg output on the console, I can no longer login wtih the web interface. I don't know if some piece of middleware is hung or what, but it just sits there after I type my password. I can ssh in tho, and use the console, so not the end of the world).
It's not the end of the world if I can't use it, it's only a 3gig SATA connection, but it was free, and I have about 40 drives for it, so it'd be nice if it worked. Any suggestions appreciated.
It starts off OK, finds some devices, think things are going to be OK: then goes to hell in a handbasket. da36-da40 found, right model, right size, all looks well, then kaboom...
mpr0: SAS Address from SAS device page0 = 5001438003153125
mpr0: Found device <4441<SspInit,SspTarg,SepDev>,End Device> <3.0Gbps> handle<0x000a> enclosureHandle<0x0002> slot 0
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address for SATA device = 749718ba398968b
mpr0: SAS Address for SATA device = 749718c9676898b
mpr0: SAS Address for SATA device = 749718b9f77808b
mpr0: SAS Address for SATA device = 749718c978e7a8b
mpr0: SAS Address for SATA device = 749718c9679958b
mpr0: SAS Address for SATA device = 749718c97929a8b
mpr0: SAS Address from SAS device page0 = 5001438003153101
mpr0: SAS Address from SATA device = 749718ba398968b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x000b> enclosureHandle<0x0002> slot 1
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5001438003153102
mpr0: SAS Address from SATA device = 749718c9676898b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x000c> enclosureHandle<0x0002> slot 2
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5001438003153103
mpr0: SAS Address from SATA device = 749718b9f77808b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x000d> enclosureHandle<0x0002> slot 3
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5001438003153104
mpr0: SAS Address from SATA device = 749718c978e7a8b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x000e> enclosureHandle<0x0002> slot 4
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5001438003153105
mpr0: SAS Address from SATA device = 749718c9679958b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x000f> enclosureHandle<0x0002> slot 5
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5001438003153106
mpr0: SAS Address from SATA device = 749718c97929a8b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x0010> enclosureHandle<0x0002> slot 6
mpr0: At enclosure level 0 and connector name ( )
(probe0:mpr0:0:7:0): REPORT LUNS. CDB: a0 00 00 00 00 00 00 00 00 10 00 00
(probe0:mpr0:0:7:0): CAM status: SCSI Status Error
(probe0:mpr0:0:7:0): SCSI status: Check Condition
(probe0:mpr0:0:7:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
(probe0:mpr0:0:7:0): Retrying command (per sense data)
da36 at mpr0 bus 0 scbus1 target 10 lun 0
da36: <ATA HGST HTS721010A9 A3J0> Fixed Direct Access SPC-4 SCSI device
da36: Serial Number JR10006P1LJ78F
da36: 300.000MB/s transfers
da36: Command Queueing enabled
da36: 953869MB (1953525168 512 byte sectors)
da37 at mpr0 bus 0 scbus1 target 12 lun 0
da37: <ATA HGST HTS721010A9 A3J0> Fixed Direct Access SPC-4 SCSI device
da37: Serial Number JR10006P1MA9MF
da37: 300.000MB/s transfers
da37: Command Queueing enabled
da37: 953869MB (1953525168 512 byte sectors)
da38 at mpr0 bus 0 scbus1 target 13 lun 0
da38: <ATA HGST HTS721010A9 A3J0> Fixed Direct Access SPC-4 SCSI device
da38: Serial Number JR10006P1MBRRF
da38: 300.000MB/s transfers
da38: Command Queueing enabled
da38: 953869MB (1953525168 512 byte sectors)
[...] then:
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 893 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe0:mpr0:0:12:0): CAM status: CCB request completed with an error
(probe0:mpr0:0:12:0): Retrying command
(probe12:mpr0:0:13:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 894 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe12:mpr0:0:13:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe12:mpr0:0:13:0): CAM status: CCB request completed with an error
(probe12:mpr0:0:13:0): Retrying command
(probe11:mpr0:0:11:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 895 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe11:mpr0:0:11:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe11:mpr0:0:11:0): CAM status: CCB request completed with an error
(probe11:mpr0:0:11:0): Retrying command
(probe9:mpr0:0:9:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 896 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe9:mpr0:0:9:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe9:mpr0:0:9:0): CAM status: CCB request completed with an error
(probe9:mpr0:0:9:0): Retrying command
(probe10:mpr0:0:10:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 897 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe10:mpr0:0:10:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe10:mpr0:0:10:0): CAM status: CCB request completed with an error
(probe10:mpr0:0:10:0): Retrying command
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 898 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe0:mpr0:0:12:0): CAM status: CCB request completed with an error
(probe0:mpr0:0:12:0): Retrying command
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 905 terminated ioc 804b loginfo 31170000 scsi 0 state c xfer 0
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe0:mpr0:0:12:0): CAM status: CCB request completed with an error
(probe0:mpr0:0:12:0): Error 5, Retries exhausted
da37 at mpr0 bus 0 scbus1 target 12 lun 0
da37: <ATA HGST HTS721010A9 A3J0> s/n JR10006P1MA9MF detached
(probe12:mpr0:0:13:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 899 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe12:mpr0:0:13:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe12:mpr0:0:13:0): CAM status: CCB request completed with an error
(probe12:mpr0:0:13:0): Error 5, Retries exhausted
da38 at mpr0 bus 0 scbus1 target 13 lun 0
da38: <ATA HGST HTS721010A9 A3J0> s/n JR10006P1MBRRF detached
(probe11:mpr0:0:11:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 900 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe11:mpr0:0:11:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe11:mpr0:0:11:0): CAM status: CCB request completed with an error
(probe11:mpr0:0:11:0): Error 5, Retries exhausted
(da37:mpr0:0:12:0): SERVICE ACTION IN(16). CDB: 9e 10 00 00 00 00 00 00 00 00 00 00 00 20 00 00 length 32 SMID 906 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(da37:mpr0:0:12:0): got CAM status 0x44
(da37:mpr0:0:12:0): fatal error, failed to attach to device
(da40:mpr0:0:9:0): Periph destroyed
(da39:mpr0:0:11:0): Periph destroyed
(da36:mpr0:0:10:0): Periph destroyed
(da38:mpr0:0:13:0): Periph destroyed
(da37:mpr0:0:12:0): Periph destroyed
(probe9:mpr0:0:9:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 903 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe9:mpr0:0:9:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe9:mpr0:0:9:0): CAM status: CCB request completed with an error
(probe9:mpr0:0:9:0): Error 5, Retries exhausted
(probe10:mpr0:0:10:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 904 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe10:mpr0:0:10:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe10:mpr0:0:10:0): CAM status: CCB request completed with an error
(probe10:mpr0:0:10:0): Error 5, Retries exhausted
root@freenas[~]#
Ended up with a free HP MSA-70 with 25 1TB drives in it, that is/was functioning fine on an HP server running esx.
Buy a 3208 external and the cables, drop the board in, hook up the SAS enclosure, and... well, not pretty.
Had to disable the bootable option on the LSI controller or the supermicro board wouldn't even get past the option rom, but that's OK, don't really need it.
FreeNAS boots, and the original pool imports fine, but I'm getting this other kazillion errors on the MSA-70/controller. (also, btw, with the errors pouring out on the dmesg output on the console, I can no longer login wtih the web interface. I don't know if some piece of middleware is hung or what, but it just sits there after I type my password. I can ssh in tho, and use the console, so not the end of the world).
It's not the end of the world if I can't use it, it's only a 3gig SATA connection, but it was free, and I have about 40 drives for it, so it'd be nice if it worked. Any suggestions appreciated.
It starts off OK, finds some devices, think things are going to be OK: then goes to hell in a handbasket. da36-da40 found, right model, right size, all looks well, then kaboom...
mpr0: SAS Address from SAS device page0 = 5001438003153125
mpr0: Found device <4441<SspInit,SspTarg,SepDev>,End Device> <3.0Gbps> handle<0x000a> enclosureHandle<0x0002> slot 0
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address for SATA device = 749718ba398968b
mpr0: SAS Address for SATA device = 749718c9676898b
mpr0: SAS Address for SATA device = 749718b9f77808b
mpr0: SAS Address for SATA device = 749718c978e7a8b
mpr0: SAS Address for SATA device = 749718c9679958b
mpr0: SAS Address for SATA device = 749718c97929a8b
mpr0: SAS Address from SAS device page0 = 5001438003153101
mpr0: SAS Address from SATA device = 749718ba398968b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x000b> enclosureHandle<0x0002> slot 1
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5001438003153102
mpr0: SAS Address from SATA device = 749718c9676898b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x000c> enclosureHandle<0x0002> slot 2
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5001438003153103
mpr0: SAS Address from SATA device = 749718b9f77808b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x000d> enclosureHandle<0x0002> slot 3
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5001438003153104
mpr0: SAS Address from SATA device = 749718c978e7a8b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x000e> enclosureHandle<0x0002> slot 4
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5001438003153105
mpr0: SAS Address from SATA device = 749718c9679958b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x000f> enclosureHandle<0x0002> slot 5
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5001438003153106
mpr0: SAS Address from SATA device = 749718c97929a8b
mpr0: Found device <81<SataDev>,End Device> <3.0Gbps> handle<0x0010> enclosureHandle<0x0002> slot 6
mpr0: At enclosure level 0 and connector name ( )
(probe0:mpr0:0:7:0): REPORT LUNS. CDB: a0 00 00 00 00 00 00 00 00 10 00 00
(probe0:mpr0:0:7:0): CAM status: SCSI Status Error
(probe0:mpr0:0:7:0): SCSI status: Check Condition
(probe0:mpr0:0:7:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
(probe0:mpr0:0:7:0): Retrying command (per sense data)
da36 at mpr0 bus 0 scbus1 target 10 lun 0
da36: <ATA HGST HTS721010A9 A3J0> Fixed Direct Access SPC-4 SCSI device
da36: Serial Number JR10006P1LJ78F
da36: 300.000MB/s transfers
da36: Command Queueing enabled
da36: 953869MB (1953525168 512 byte sectors)
da37 at mpr0 bus 0 scbus1 target 12 lun 0
da37: <ATA HGST HTS721010A9 A3J0> Fixed Direct Access SPC-4 SCSI device
da37: Serial Number JR10006P1MA9MF
da37: 300.000MB/s transfers
da37: Command Queueing enabled
da37: 953869MB (1953525168 512 byte sectors)
da38 at mpr0 bus 0 scbus1 target 13 lun 0
da38: <ATA HGST HTS721010A9 A3J0> Fixed Direct Access SPC-4 SCSI device
da38: Serial Number JR10006P1MBRRF
da38: 300.000MB/s transfers
da38: Command Queueing enabled
da38: 953869MB (1953525168 512 byte sectors)
[...] then:
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 893 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe0:mpr0:0:12:0): CAM status: CCB request completed with an error
(probe0:mpr0:0:12:0): Retrying command
(probe12:mpr0:0:13:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 894 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe12:mpr0:0:13:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe12:mpr0:0:13:0): CAM status: CCB request completed with an error
(probe12:mpr0:0:13:0): Retrying command
(probe11:mpr0:0:11:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 895 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe11:mpr0:0:11:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe11:mpr0:0:11:0): CAM status: CCB request completed with an error
(probe11:mpr0:0:11:0): Retrying command
(probe9:mpr0:0:9:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 896 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe9:mpr0:0:9:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe9:mpr0:0:9:0): CAM status: CCB request completed with an error
(probe9:mpr0:0:9:0): Retrying command
(probe10:mpr0:0:10:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 897 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe10:mpr0:0:10:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe10:mpr0:0:10:0): CAM status: CCB request completed with an error
(probe10:mpr0:0:10:0): Retrying command
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 898 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe0:mpr0:0:12:0): CAM status: CCB request completed with an error
(probe0:mpr0:0:12:0): Retrying command
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 905 terminated ioc 804b loginfo 31170000 scsi 0 state c xfer 0
(probe0:mpr0:0:12:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe0:mpr0:0:12:0): CAM status: CCB request completed with an error
(probe0:mpr0:0:12:0): Error 5, Retries exhausted
da37 at mpr0 bus 0 scbus1 target 12 lun 0
da37: <ATA HGST HTS721010A9 A3J0> s/n JR10006P1MA9MF detached
(probe12:mpr0:0:13:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 899 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe12:mpr0:0:13:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe12:mpr0:0:13:0): CAM status: CCB request completed with an error
(probe12:mpr0:0:13:0): Error 5, Retries exhausted
da38 at mpr0 bus 0 scbus1 target 13 lun 0
da38: <ATA HGST HTS721010A9 A3J0> s/n JR10006P1MBRRF detached
(probe11:mpr0:0:11:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 900 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe11:mpr0:0:11:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe11:mpr0:0:11:0): CAM status: CCB request completed with an error
(probe11:mpr0:0:11:0): Error 5, Retries exhausted
(da37:mpr0:0:12:0): SERVICE ACTION IN(16). CDB: 9e 10 00 00 00 00 00 00 00 00 00 00 00 20 00 00 length 32 SMID 906 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(da37:mpr0:0:12:0): got CAM status 0x44
(da37:mpr0:0:12:0): fatal error, failed to attach to device
(da40:mpr0:0:9:0): Periph destroyed
(da39:mpr0:0:11:0): Periph destroyed
(da36:mpr0:0:10:0): Periph destroyed
(da38:mpr0:0:13:0): Periph destroyed
(da37:mpr0:0:12:0): Periph destroyed
(probe9:mpr0:0:9:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 903 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe9:mpr0:0:9:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe9:mpr0:0:9:0): CAM status: CCB request completed with an error
(probe9:mpr0:0:9:0): Error 5, Retries exhausted
(probe10:mpr0:0:10:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 904 terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe10:mpr0:0:10:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe10:mpr0:0:10:0): CAM status: CCB request completed with an error
(probe10:mpr0:0:10:0): Error 5, Retries exhausted
root@freenas[~]#
