900GB/10K/6Gb sas (IBM FRU 81Y9651)

[MarioDespot]

Hello,

Is there anybody who build freenas with 2.5" IBM sas hd 900GB/10K/6Gb sas (IBM FRU 81Y9651)?

i have big issues trying that.
Any help is welcome.

mario

 

[m0nkey_]

Would help if you provided a tad more details, such as your system specifications, what you're trying to achieve, any error messages, etc.?

 

[MarioDespot]

Hello,
platformi is this:

HW:
brand new IBM x3650M4 server with ibm serverRAID M1015 LSI ctrl cross flashed to a LSI9211IT (versions P20) and hard drives 2.5" 900GB/10K/6Gb sas (IBM FRU 81Y9651)
proc Intel(R) Xeon(R) CPU E5-2609 v2 @ 2.50GHz
Memory 32587MB
SW
FreeNAS-9.3-STABLE-201512121950

When i work with sata HD everything is fine.
But when i put any sas or NLsas i have this:

Jan 25 02:11:50 freenas (da2:mps0:0:2:0): CAM status: SCSI Status Error
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): SCSI status: Check Condition
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): Error 22, Unretryable error
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): READ(10). CDB: 28 00 00 00 00 00 00 01 00 00
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): CAM status: SCSI Status Error
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): SCSI status: Check Condition
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): Error 22, Unretryable error
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): READ(10). CDB: 28 00 00 00 02 00 00 01 00 00
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): CAM status: SCSI Status Error
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): SCSI status: Check Condition
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): Error 22, Unretryable error
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): READ(10). CDB: 28 00 68 cb 9a 00 00 01 00 00
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): CAM status: SCSI Status Error
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): SCSI status: Check Condition
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): Error 22, Unretryable error
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): READ(10). CDB: 28 00 68 cb 9c 00 00 01 00 00
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): CAM status: SCSI Status Error
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): SCSI status: Check Condition
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Jan 25 02:11:50 freenas (da2:mps0:0:2:0): Error 22, Unretryable error

All sas and nlsas disks are tested before and after on same hw using linux and vmware. Actuali complete HW is tested and there is not any problems. I tried with different sizes and types hdd (10K, 15K 7200,5K, SAS, NLSAS, sata) and freenas only recognized sata drives. Remark: backlpane is for 2.5" hot-swap drives and all drives are original ibm parts.

for any additional information feel free to ask because right now i'm desperate.

mario

 

[Mirfster]

What is the make/model/type of the SFF-8087 cabling you are using from the M1015 to the backplane?

 

[MarioDespot]

If you read from beginning, you will see that is brand new ibm server x3650M4 with original parts.

IBM sas backlplain (8 pac 2.5-inch hard disk drive backplane (For HDD 1 - 8) FRU 46W9187)
original sas cabling (FRU 69Y2281),
original ibm sas hdd-s (FRU 81Y9651),
only ServerRaid is not from this server but also ibm serverRAID M1015.

mario

 

[tvsjr]

OK, so you've tried multiple types of SAS drives, all with the same failure?

First, I'd try booting to your flashing environment (USB stick, UEFI, whatever) and doing a -listall to get data on the controller. Does everything look good there? Versions right? SAS address isn't all zeroes?
Then try CTRL+C at boot time (I think that's the right two-finger salute) to get into the card's BIOS, to determine if the drives are being recognized there.

Your issue is almost certainly hardware - the question is, where.

 

[MarioDespot]

ctrl is ok, all disks are correctly recognized and addressed correctly, also from freenas shell i can see all disks. I can read or make geometry but any writing or reading from disk produce errors from beginning (very weird error message mins almost nothing). also any insertions of disk produce same message (when i add new hdd).
tomorrow i'm out of office but next day i will provide all messages from shell
mario

 

[MarioDespot]

As i promise
Disks are OK recognized by raid ctrl (booth ctrl bios or freenas boot)
inside freenas cli:

camcontrol devlist
<LENOVO-X ST900MM0006 L56Q> at scbus1 target 1 lun 0 (pass0,da0)
<IBM-ESXS AL13SEB900 SB35> at scbus1 target 2 lun 0 (pass1,da1)
<IBM-ESXS HUC109090CSS60 J2EH> at scbus1 target 3 lun 0 (pass2,da2)
<LENOVO-X ST900MM0006 L56Q> at scbus1 target 4 lun 0 (da3,pass3)
<LENOVO-X ST900MM0006 L56Q> at scbus1 target 10 lun 0 (pass4,da4)
<LENOVO-X ST900MM0006 L56Q> at scbus1 target 11 lun 0 (pass5,da5)
<Kingston DataTraveler 3.0 PMAP> at scbus3 target 0 lun 0 (pass6,da6)

gpart show
=> 34 30277565 da6 GPT (14G)
34 8190 - free - (4M)
8224 1024 1 bios-boot (512k)
9248 30268344 2 freebsd-zfs (14G)
30277592 7 - free - (3.5k)

=> 34 1758174701 da0 GPT (838G)
34 4062 - free - (2M)
4096 4194304 1 freebsd-swap (2.0G)
4198400 1753972736 2 freebsd-zfs (836G)
1758171136 3599 - free - (1.8M)

=> 34 1758174701 da1 GPT (838G)
34 4062 - free - (2M)
4096 4194304 1 freebsd-swap (2.0G)
4198400 1753972736 2 freebsd-zfs (836G)
1758171136 3599 - free - (1.8M)

=> 34 1758174701 da3 GPT (838G)
34 4062 - free - (2M)
4096 4194304 1 freebsd-swap (2.0G)
4198400 1753972736 2 freebsd-zfs (836G)
1758171136 3599 - free - (1.8M)

=> 34 1758174701 da2 GPT (838G)
34 4062 - free - (2M)
4096 4194304 1 freebsd-swap (2.0G)
4198400 1753972736 2 freebsd-zfs (836G)
1758171136 3599 - free - (1.8M)

=> 34 1758174701 da4 GPT (838G)
34 4062 - free - (2M)
4096 4194304 1 freebsd-swap (2.0G)
4198400 1753972736 2 freebsd-zfs (836G)
1758171136 3599 - free - (1.8M)

=> 34 1758174701 da5 GPT (838G)
34 4062 - free - (2M)
4096 4194304 1 freebsd-swap (2.0G)
4198400 1753972736 2 freebsd-zfs (836G)
1758171136 3599 - free - (1.8M)

as you can see freenas recognize all hdd-s, including serial nums, but any work with zpool (doesn't mater gui or cli) produce error in var/log/messages:
for example if i try zpool create -f test da0p2 i have this:

Jan 28 03:09:18 freenas (da0:mps0:0:1:0): WRITE(10). CDB: 2a 00 68 cb 9e 2f 00 00 01 00
Jan 28 03:09:18 freenas (da0:mps0:0:1:0): CAM status: SCSI Status Error
Jan 28 03:09:18 freenas (da0:mps0:0:1:0): SCSI status: Check Condition
Jan 28 03:09:18 freenas (da0:mps0:0:1:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Jan 28 03:09:18 freenas (da0:mps0:0:1:0): Error 22, Unretryable error
.
........

all smartctl test are ok!

if you need more tell me!

mario