Can't create Volume with disks attached to LSI 9300-8e

Status
Not open for further replies.

Matt Kent

Dabbler
Joined
Jun 21, 2016
Messages
24
I use the Wizard, or the Manaul mode to make a volume, It thins for a second, then back to the screen, no error messages posted.

Below is the full tail -f of the messages log while trying to create a RAIDZ2 volume with disks da0-4

Code:
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd0p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd0p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd1p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd1p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd2p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd2p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd3p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd3p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd4p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd4p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd5p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd5p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd6p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd6p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd0p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd1p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd2p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd3p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd4p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd5p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd6p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd7p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd7p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd7p1.eli on last close.
Aug 19 15:43:29 xxxxxxxx notifier: 32+0 records in
Aug 19 15:43:29 xxxxxxxx notifier: 32+0 records out
Aug 19 15:43:29 xxxxxxxx notifier: 33554432 bytes transferred in 2.452569 secs (13681341 bytes/sec)
Aug 19 15:43:31 xxxxxxxx notifier: dd: /dev/da0: short write on character device
Aug 19 15:43:31 xxxxxxxx notifier: dd: /dev/da0: end of device
Aug 19 15:43:31 xxxxxxxx notifier: 33+0 records in
Aug 19 15:43:31 xxxxxxxx notifier: 32+1 records out
Aug 19 15:43:31 xxxxxxxx notifier: 34430976 bytes transferred in 2.516675 secs (13681137 bytes/sec)
Aug 19 15:43:33 xxxxxxxx notifier: dd: /dev/da1: Invalid argument
Aug 19 15:43:33 xxxxxxxx notifier: 1+0 records in
Aug 19 15:43:33 xxxxxxxx notifier: 0+0 records out
Aug 19 15:43:33 xxxxxxxx notifier: 0 bytes transferred in 0.005366 secs (0 bytes/sec)
Aug 19 15:43:33 xxxxxxxx notifier: dd: /dev/da1: Invalid argument
Aug 19 15:43:33 xxxxxxxx notifier: 1+0 records in
Aug 19 15:43:33 xxxxxxxx notifier: 0+0 records out
Aug 19 15:43:33 xxxxxxxx notifier: 0 bytes transferred in 0.005393 secs (0 bytes/sec)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): WRITE(10). CDB: 2a 00 00 00 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be 71 00 00 00 04 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): WRITE(16). CDB: 8a 00 00 00 00 01 d1 bf b8 00 00 00 01 00 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx manage.py: [middleware.exceptions:37] [MiddlewareError: Unable to GPT format the disk "da1"]
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be 71 00 00 00 04 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): WRITE(16). CDB: 8a 00 00 00 00 01 d1 c0 be 8f 00 00 00 20 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
 

Attachments

  • Disks.jpg
    Disks.jpg
    179 KB · Views: 291

Spearfoot

He of the long foot
Moderator
Joined
May 13, 2015
Messages
2,478
I use the Wizard, or the Manaul mode to make a volume, It thins for a second, then back to the screen, no error messages posted.

Below is the full tail -f of the messages log while trying to create a RAIDZ2 volume with disks da0-4

Code:
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd0p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd0p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd1p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd1p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd2p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd2p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd3p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd3p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd4p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd4p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd5p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd5p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd6p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd6p1.eli on last close.
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd0p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd1p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd2p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd3p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd4p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd5p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd6p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx notifier: swapoff: removing /dev/mfisyspd7p1.eli as swap device
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Device mfisyspd7p1.eli destroyed.
Aug 19 15:43:26 xxxxxxxx GEOM_ELI: Detached mfisyspd7p1.eli on last close.
Aug 19 15:43:29 xxxxxxxx notifier: 32+0 records in
Aug 19 15:43:29 xxxxxxxx notifier: 32+0 records out
Aug 19 15:43:29 xxxxxxxx notifier: 33554432 bytes transferred in 2.452569 secs (13681341 bytes/sec)
Aug 19 15:43:31 xxxxxxxx notifier: dd: /dev/da0: short write on character device
Aug 19 15:43:31 xxxxxxxx notifier: dd: /dev/da0: end of device
Aug 19 15:43:31 xxxxxxxx notifier: 33+0 records in
Aug 19 15:43:31 xxxxxxxx notifier: 32+1 records out
Aug 19 15:43:31 xxxxxxxx notifier: 34430976 bytes transferred in 2.516675 secs (13681137 bytes/sec)
Aug 19 15:43:33 xxxxxxxx notifier: dd: /dev/da1: Invalid argument
Aug 19 15:43:33 xxxxxxxx notifier: 1+0 records in
Aug 19 15:43:33 xxxxxxxx notifier: 0+0 records out
Aug 19 15:43:33 xxxxxxxx notifier: 0 bytes transferred in 0.005366 secs (0 bytes/sec)
Aug 19 15:43:33 xxxxxxxx notifier: dd: /dev/da1: Invalid argument
Aug 19 15:43:33 xxxxxxxx notifier: 1+0 records in
Aug 19 15:43:33 xxxxxxxx notifier: 0+0 records out
Aug 19 15:43:33 xxxxxxxx notifier: 0 bytes transferred in 0.005393 secs (0 bytes/sec)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): WRITE(10). CDB: 2a 00 00 00 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be 71 00 00 00 04 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): WRITE(16). CDB: 8a 00 00 00 00 01 d1 bf b8 00 00 00 01 00 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx manage.py: [middleware.exceptions:37] [MiddlewareError: Unable to GPT format the disk "da1"]
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be 71 00 00 00 04 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): WRITE(16). CDB: 8a 00 00 00 00 01 d1 c0 be 8f 00 00 00 20 00 00
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): CAM status: SCSI Status Error
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI status: Check Condition
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 15:43:33 xxxxxxxx (da1:mpr0:0:9:0): Error 22, Unretryable error
Thank you.

Are there any existing partitions on these drives? This error from your log dump causes problems for a lot of users and sometimes it's because partitions exist on the drive:
Code:
MiddlewareError: Unable to GPT format the disk "da1"

Also, the drives named as 'dan' indeed appear to be on the LSI controller, and these are giving you grief. No doubts about that!

The drives named 'mfisyspdn' must therefore be the ones attached to the H730 controller, and their odd name plus lack of serial number displayed on the screenshot confirms my suspicion that this particular controller passes through drives in a less-than-optimal way. Yet you say you are able to create volumes with these drives?

Also... are you by any chance using encryption?
 

Matt Kent

Dabbler
Joined
Jun 21, 2016
Messages
24
Yes I can create volumes with the 'myfisysdn' disks, per the attached screen shot.
I am not using encryption that I know of.
As for the paritions on the drives, as far as I know they are empty.
Code:
[root@soe-almaz] ~# gpart show
=>        34  7814037101  mfisyspd0  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd1  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd2  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd3  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd4  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd5  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd6  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd7  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>      34  30463933  da8  GPT  (15G)
        34      1024    1  bios-boot  (512K)
      1058         6       - free -  (3.0K)
      1064  30462896    2  freebsd-zfs  (15G)
  30463960         7       - free -  (3.5K)

=>        34  7814037101  da0  GPT  (3.6T)
          34          94       - free -  (47K)
         128     4194304    1  freebsd-swap  (2.0G)
     4194432  7809842696    2  freebsd-zfs  (3.6T)
  7814037128           7       - free -  (3.5K)

=>        34  7814037101  da1  GPT  (3.6T)
          34  7814037101       - free -  (3.6T)


Looks like da8 has stuff, but as far as I know that is the internal USB that is hosting the master boot image.

Matt
 

Attachments

  • Volume.jpg
    Volume.jpg
    91 KB · Views: 269

Spearfoot

He of the long foot
Moderator
Joined
May 13, 2015
Messages
2,478
Yes I can create volumes with the 'myfisysdn' disks, per the attached screen shot.
I am not using encryption that I know of.
As for the paritions on the drives, as far as I know they are empty.
Code:
[root@soe-almaz] ~# gpart show
=>        34  7814037101  mfisyspd0  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd1  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd2  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd3  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd4  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd5  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd6  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>        34  7814037101  mfisyspd7  GPT  (3.6T)
          34          94             - free -  (47K)
         128     4194304          1  freebsd-swap  (2.0G)
     4194432  7809842696          2  freebsd-zfs  (3.6T)
  7814037128           7             - free -  (3.5K)

=>      34  30463933  da8  GPT  (15G)
        34      1024    1  bios-boot  (512K)
      1058         6       - free -  (3.0K)
      1064  30462896    2  freebsd-zfs  (15G)
  30463960         7       - free -  (3.5K)

=>        34  7814037101  da0  GPT  (3.6T)
          34          94       - free -  (47K)
         128     4194304    1  freebsd-swap  (2.0G)
     4194432  7809842696    2  freebsd-zfs  (3.6T)
  7814037128           7       - free -  (3.5K)

=>        34  7814037101  da1  GPT  (3.6T)
          34  7814037101       - free -  (3.6T)


Looks like da8 has stuff, but as far as I know that is the internal USB that is hosting the master boot image.

Matt
Yes, da8 appears to be your boot drive. Only da8, da0, and da1 show up in your listing, and da1 is the 'problem' drive that FreeNAS couldn't format. I wonder if that particular drive is bad? I would try creating a volume with sets of the other LSI-connected drives, excluding da1, to check that idea.

Also, did you burn-in your hard drives?

https://forums.freenas.org/index.php?threads/how-to-hard-drive-burn-in-testing.21451/
 

Matt Kent

Dabbler
Joined
Jun 21, 2016
Messages
24
Same issue if I try da4-7.

Code:
Aug 19 17:27:48 xxxxxxxx notifier: swapoff: /dev/mfisyspd0p1.eli: No such file or directory
Aug 19 17:27:48 xxxxxxxx notifier: swapoff: /dev/mfisyspd1p1.eli: No such file or directory
Aug 19 17:27:48 xxxxxxxx notifier: swapoff: /dev/mfisyspd2p1.eli: No such file or directory
Aug 19 17:27:48 xxxxxxxx notifier: swapoff: /dev/mfisyspd3p1.eli: No such file or directory
Aug 19 17:27:48 xxxxxxxx notifier: swapoff: /dev/mfisyspd4p1.eli: No such file or directory
Aug 19 17:27:48 xxxxxxxx notifier: swapoff: /dev/mfisyspd5p1.eli: No such file or directory
Aug 19 17:27:48 xxxxxxxx notifier: swapoff: /dev/mfisyspd6p1.eli: No such file or directory
Aug 19 17:27:48 xxxxxxxx notifier: swapoff: /dev/mfisyspd7p1.eli: No such file or directory
Aug 19 17:27:49 xxxxxxxx notifier: dd: /dev/da4: Invalid argument
Aug 19 17:27:49 xxxxxxxx notifier: 1+0 records in
Aug 19 17:27:49 xxxxxxxx notifier: 0+0 records out
Aug 19 17:27:49 xxxxxxxx notifier: 0 bytes transferred in 0.655720 secs (0 bytes/sec)
Aug 19 17:27:49 xxxxxxxx (da4:mpr0:0:12:0): WRITE(10). CDB: 2a 00 00 00 00 00 00 01 00 00
Aug 19 17:27:49 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:49 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:49 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:49 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be 71 00 00 00 04 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx notifier: dd: /dev/da4: Invalid argument
Aug 19 17:27:50 xxxxxxxx notifier: 1+0 records in
Aug 19 17:27:50 xxxxxxxx notifier: 0+0 records out
Aug 19 17:27:50 xxxxxxxx notifier: 0 bytes transferred in 0.005422 secs (0 bytes/sec)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): WRITE(16). CDB: 8a 00 00 00 00 01 d1 bf b8 00 00 00 01 00 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be 71 00 00 00 04 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): WRITE(16). CDB: 8a 00 00 00 00 01 d1 c0 be 8f 00 00 00 20 00 00
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): CAM status: SCSI Status Error
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI status: Check Condition
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 19 17:27:50 xxxxxxxx (da4:mpr0:0:12:0): Error 22, Unretryable error
Aug 19 17:27:50 xxxxxxxx manage.py: [middleware.exceptions:37] [MiddlewareError: Unable to GPT format the disk "da4"]
Aug 19 17:29:06 xxxxxxxx notifier: swapoff: /dev/mfisyspd0p1.eli: No such file or directory
Aug 19 17:29:06 xxxxxxxx notifier: swapoff: /dev/mfisyspd1p1.eli: No such file or directory
Aug 19 17:29:06 xxxxxxxx notifier: swapoff: /dev/mfisyspd2p1.eli: No such file or directory
Aug 19 17:29:06 xxxxxxxx notifier: swapoff: /dev/mfisyspd3p1.eli: No such file or directory
Aug 19 17:29:06 xxxxxxxx notifier: swapoff: /dev/mfisyspd4p1.eli: No such file or directory
Aug 19 17:29:06 xxxxxxxx notifier: swapoff: /dev/mfisyspd5p1.eli: No such file or directory
Aug 19 17:29:06 xxxxxxxx notifier: swapoff: /dev/mfisyspd6p1.eli: No such file or directory
Aug 19 17:29:06 xxxxxxxx notifier: swapoff: /dev/mfisyspd7p1.eli: No such file or directory
Aug 19 17:29:06 xxxxxxxx notifier: dd: /dev/da4: Operation not permitted
Aug 19 17:29:06 xxxxxxxx notifier: dd: /dev/da4: Operation not permitted
Aug 19 17:29:06 xxxxxxxx manage.py: [middleware.exceptions:37] [MiddlewareError: Unable to GPT format the disk "da4"]
[\code]

No, I have not done a burn in testing. I can do so. I expect it will take some time, so I will post the logs for that once I have them.
Any suggestions in the meantime?

Matt
 

Spearfoot

He of the long foot
Moderator
Joined
May 13, 2015
Messages
2,478
No, I have not done a burn in testing. I can do so. I expect it will take some time, so I will post the logs for that once I have them. Any suggestions in the meantime?
Using the burn-in procedure I posted earlier would take several days... Before pursuing that, I would try moving the drives connected to the LSI controller over to the H730 controller to see if they work there. At the same time, connect the drives that were connected to the H730 over to the LSI, and test that setup as well. I believe you mentioned this approach earlier.

It may simply be that your LSI card is defective and needs to be RMA'd. This is starting to seem more and more likely.

If it were me, I would open a console and start a long SMART test on each device; this should help determine whether or not they are functioning with the relevant controller. This will take ~7 hours to complete. Example follows for da0, do this for all 14 of your hard drives. BTW, you don't have to wait for one drive to complete before starting the test on the next drive.

Code:
smartctl -t long /dev/da0
 

Matt Kent

Dabbler
Joined
Jun 21, 2016
Messages
24
Using the burn-in procedure I posted earlier would take several days... Before pursuing that, I would try moving the drives connected to the LSI controller over to the H730 controller to see if they work there. At the same time, connect the drives that were connected to the H730 over to the LSI, and test that setup as well. I believe you mentioned this approach earlier.

It may simply be that your LSI card is defective and needs to be RMA'd. This is starting to seem more and more likely.

If it were me, I would open a console and start a long SMART test on each device; this should help determine whether or not they are functioning with the relevant controller. This will take ~7 hours to complete. Example follows for da0, do this for all 14 of your hard drives. BTW, you don't have to wait for one drive to complete before starting the test on the next drive.

Code:
smartctl -t long /dev/da0

It's now the weekend, and this is a work server that isn't in production yet, so I'm not going to do the drive swap until Monday, but I am running the long SMART tests now, I'll post the results Saturday.

Matt
 

depasseg

FreeNAS Replicant
Joined
Sep 16, 2014
Messages
2,874
Can you confirm which serial number correlates with which controller?
 

Mirfster

Doesn't know what he's talking about
Joined
Oct 2, 2015
Messages
3,215
If this is a non production system, then I recommend trying it with just the LSI card in there only. Blow away any volumes you already have and physically remove the other card(s).
 
Joined
Aug 21, 2016
Messages
7
You should look for the manual for installing the lsi card. I ran into an issue I think might apply to you. The suggestion to check the cables is a good one. Also make sure the cables are connected properly to the correct ports. I don't know about this server but if it uses backplanes check those & how they are connected also.

I was trying to add more drives & it was not working out. After finding the manual from server manufacturer i found it actually was not setup correctly. There was something very specific in the way it had to be connected.

Can't remember now which sucks cause ill probably run into it again but I'll still let you know how I solved it.

Sent from my SM-N920P using Tapatalk
 

Matt Kent

Dabbler
Joined
Jun 21, 2016
Messages
24
The long SMART test had no reports, and "smartctl -a /dev/da0" and smartctl -a /dev/pass0" showed the same information.

I've physically flipped the drives from the server to the shelf, and shelf to the server, keeping the same relative position of the drives, and still have the errors.
They even showed up as part of the drive disconnect and re-connect.

The first section of the log is below, the full log is attached.
Code:
Aug 22 10:31:56 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da0'
Aug 22 10:31:57 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 8
Aug 22 10:31:57 XXXXXXXXX da0 at mpr0 bus 0 scbus5 target 8 lun 0
Aug 22 10:31:57 XXXXXXXXX da0: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0RPFVNC detached
Aug 22 10:31:57 XXXXXXXXX (da0:mpr0:0:8:0): Periph destroyed
Aug 22 10:31:57 XXXXXXXXX mpr0: clearing target 8 handle 0x000d
Aug 22 10:31:57 XXXXXXXXX mpr0: At enclosure level 0, slot 0, connector name (    )
Aug 22 10:31:57 XXXXXXXXX mpr0: Unfreezing devq for target ID 8
Aug 22 10:32:01 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 9
Aug 22 10:32:01 XXXXXXXXX da1 at mpr0 bus 0 scbus5 target 9 lun 0
Aug 22 10:32:01 XXXXXXXXX da1: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A16EFVNC detached
Aug 22 10:32:01 XXXXXXXXX (da1:mpr0:0:9:0): Periph destroyed
Aug 22 10:32:01 XXXXXXXXX mpr0: clearing target 9 handle 0x000b
Aug 22 10:32:01 XXXXXXXXX mpr0: At enclosure level 0, slot 1, connector name (    )
Aug 22 10:32:01 XXXXXXXXX mpr0: Unfreezing devq for target ID 9
Aug 22 10:32:02 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 10
Aug 22 10:32:02 XXXXXXXXX da2 at mpr0 bus 0 scbus5 target 10 lun 0
Aug 22 10:32:02 XXXXXXXXX da2: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0RNFVNC detached
Aug 22 10:32:02 XXXXXXXXX (da2:mpr0:0:10:0): Periph destroyed
Aug 22 10:32:02 XXXXXXXXX mpr0: clearing target 10 handle 0x000f
Aug 22 10:32:02 XXXXXXXXX mpr0: At enclosure level 0, slot 2, connector name (    )
Aug 22 10:32:02 XXXXXXXXX mpr0: Unfreezing devq for target ID 10
Aug 22 10:32:03 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da1'
Aug 22 10:32:03 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 11
Aug 22 10:32:03 XXXXXXXXX da3 at mpr0 bus 0 scbus5 target 11 lun 0
Aug 22 10:32:03 XXXXXXXXX da3: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0STFVNC detached
Aug 22 10:32:03 XXXXXXXXX (da3:mpr0:0:11:0): Periph destroyed
Aug 22 10:32:03 XXXXXXXXX mpr0: clearing target 11 handle 0x000e
Aug 22 10:32:03 XXXXXXXXX mpr0: At enclosure level 0, slot 3, connector name (    )
Aug 22 10:32:03 XXXXXXXXX mpr0: Unfreezing devq for target ID 11
Aug 22 10:32:05 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 12
Aug 22 10:32:05 XXXXXXXXX da4 at mpr0 bus 0 scbus5 target 12 lun 0
Aug 22 10:32:05 XXXXXXXXX da4: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0RQFVNC detached
Aug 22 10:32:05 XXXXXXXXX mpr0: clearing target 12 handle 0x000c
Aug 22 10:32:05 XXXXXXXXX mpr0: At enclosure level 0, slot 4, connector name (    )
Aug 22 10:32:05 XXXXXXXXX mpr0: Unfreezing devq for target ID 12
Aug 22 10:32:05 XXXXXXXXX (da4:mpr0:0:12:0): Periph destroyed
Aug 22 10:32:06 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 13
Aug 22 10:32:06 XXXXXXXXX da5 at mpr0 bus 0 scbus5 target 13 lun 0
Aug 22 10:32:06 XXXXXXXXX da5: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0S8FVNC detached
Aug 22 10:32:06 XXXXXXXXX mpr0: clearing target 13 handle 0x000a
Aug 22 10:32:06 XXXXXXXXX mpr0: At enclosure level 0, slot 5, connector name (    )
Aug 22 10:32:06 XXXXXXXXX mpr0: Unfreezing devq for target ID 13
Aug 22 10:32:06 XXXXXXXXX (da5:mpr0:0:13:0): Periph destroyed
Aug 22 10:32:08 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 14
Aug 22 10:32:08 XXXXXXXXX da6 at mpr0 bus 0 scbus5 target 14 lun 0
Aug 22 10:32:08 XXXXXXXXX da6: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A16KFVNC detached
Aug 22 10:32:08 XXXXXXXXX mpr0: clearing target 14 handle 0x0010
Aug 22 10:32:08 XXXXXXXXX mpr0: At enclosure level 0, slot 6, connector name (    )
Aug 22 10:32:08 XXXXXXXXX mpr0: Unfreezing devq for target ID 14
Aug 22 10:32:08 XXXXXXXXX (da6:mpr0:0:14:0): Periph destroyed
Aug 22 10:32:09 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 15
Aug 22 10:32:09 XXXXXXXXX da7 at mpr0 bus 0 scbus5 target 15 lun 0
Aug 22 10:32:09 XXXXXXXXX da7: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0BKFVNC detached
Aug 22 10:32:09 XXXXXXXXX mpr0: clearing target 15 handle 0x0011
Aug 22 10:32:09 XXXXXXXXX mpr0: At enclosure level 0, slot 7, connector name (    )
Aug 22 10:32:09 XXXXXXXXX mpr0: Unfreezing devq for target ID 15
Aug 22 10:32:09 XXXXXXXXX (da7:mpr0:0:15:0): Periph destroyed
Aug 22 10:32:09 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da2'
Aug 22 10:32:10 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da3'
Aug 22 10:32:11 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da4'
Aug 22 10:32:12 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da5'
Aug 22 10:32:13 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da6'
Aug 22 10:32:13 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da7'
Aug 22 10:32:39 XXXXXXXXX mfi0: 1419 (525191560s/0x0002/WARN) - PD 00(e0x20/s0) Path 500003972838fdfe  reset (Type 03)
Aug 22 10:32:39 XXXXXXXXX mfi0: 1420 (525191560s/0x0002/WARN) - Removed: PD 00(e0x20/s0)
Aug 22 10:32:39 XXXXXXXXX mfisyspd0: Detaching syspd
Aug 22 10:32:39 XXXXXXXXX mfisyspd0: detached
Aug 22 10:32:39 XXXXXXXXX mfi0: pass0 at mfi0 bus 0 scbus0 target 0 lun 0
Aug 22 10:32:39 XXXXXXXXX 1421 (525191560s/0x0002/info) - Removed: PD 00(e0x20/s0) Info: enclPd=20, scsiType=0, portMap=00, sasAddr=500003972838fdfe,000pass0: 0000000000000
Aug 22 10:32:39 XXXXXXXXX syslog-ng[67869]: Error processing log message: <TOSHIBA MG04SCA40EN DS06>mfi0:  s/n 76L0A16CFVNC1422 (525191560s/0x0002/info) - State change on PD 00(e0x20/s0) from JBOD(40) to UNCONFIGURED_BAD(1)
Aug 22 10:32:39 XXXXXXXXX detached
Aug 22 10:32:39 XXXXXXXXX (pass0:mfi0:0:0:0): Periph destroyed
Aug 22 10:32:42 XXXXXXXXX mpr0: SAS Address from SAS device page0 = 500003972838fdfe
Aug 22 10:32:42 XXXXXXXXX mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0013> enclosureHandle<0x0002> slot 0
Aug 22 10:32:42 XXXXXXXXX mpr0: At enclosure level 0 and connector name (    )
Aug 22 10:32:46 XXXXXXXXX mfi0: 1423 (525191567s/0x0002/WARN) - PD 01(e0x20/s1) Path 5000039728337e5a  reset (Type 03)
Aug 22 10:32:46 XXXXXXXXX mfi0: 1424 (525191567s/0x0002/WARN) - Removed: PD 01(e0x20/s1)
Aug 22 10:32:46 XXXXXXXXX mfisyspd1: Detaching syspd
Aug 22 10:32:46 XXXXXXXXX mfisyspd1: detached
Aug 22 10:32:46 XXXXXXXXX mfi0: pass1 at mfi0 bus 0 scbus0 target 1 lun 0
Aug 22 10:32:46 XXXXXXXXX 1425 (525191567s/0x0002/info) - Removed: PD 01(e0x20/s1) Info: enclPd=20, scsiType=0, portMap=00, sasAddr=5000039728337e5a,000pass1: 0000000000000
Aug 22 10:32:46 XXXXXXXXX syslog-ng[67869]: Error processing log message: <TOSHIBA MG04SCA40EN DS06>mfi0:  s/n 76K0A16XFVNC1426 (525191567s/0x0002/info) - State change on PD 01(e0x20/s1) from JBOD(40) to UNCONFIGURED_BAD(1)
Aug 22 10:32:46 XXXXXXXXX detached
Aug 22 10:32:46 XXXXXXXXX (pass1:mfi0:0:1:0): Periph destroyed
Aug 22 10:32:51 XXXXXXXXX mpr0: SAS Address from SAS device page0 = 5000039728337e5a
Aug 22 10:32:51 XXXXXXXXX mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0014> enclosureHandle<0x0002> slot 1
Aug 22 10:32:51 XXXXXXXXX mpr0: At enclosure level 0 and connector name (    )
Aug 22 10:32:55 XXXXXXXXX mfi0: 1427 (525191576s/0x0002/WARN) - PD 02(e0x20/s2) Path 5000039728337e4a  reset (Type 03)
Aug 22 10:32:55 XXXXXXXXX mfi0: 1428 (525191576s/0x0002/WARN) - Removed: PD 02(e0x20/s2)
Aug 22 10:32:55 XXXXXXXXX mfisyspd2: Detaching syspd
Aug 22 10:32:55 XXXXXXXXX mfisyspd2: detached
Aug 22 10:32:55 XXXXXXXXX mfi0: pass2 at mfi0 bus 0 scbus0 target 2 lun 0
Aug 22 10:32:55 XXXXXXXXX 1429 (525191576s/0x0002/info) - Removed: PD 02(e0x20/s2) Info: enclPd=20, scsiType=0, portMap=00, sasAddr=5000039728337e4a,000pass2: 0000000000000
Aug 22 10:32:55 XXXXXXXXX syslog-ng[67869]: Error processing log message: <TOSHIBA MG04SCA40EN DS06>mfi0:  s/n 76K0A16WFVNC1430 (525191576s/0x0002/info) - State change on PD 02(e0x20/s2) from JBOD(40) to UNCONFIGURED_BAD(1)
Aug 22 10:32:55 XXXXXXXXX detached
Aug 22 10:32:55 XXXXXXXXX (pass2:mfi0:0:2:0): Periph destroyed
Aug 22 10:32:57 XXXXXXXXX mpr0: SAS Address from SAS device page0 = 5000039728337e4a
Aug 22 10:32:57 XXXXXXXXX mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0015> enclosureHandle<0x0002> slot 2
Aug 22 10:32:57 XXXXXXXXX mpr0: At enclosure level 0 and connector name (    )
Aug 22 10:32:59 XXXXXXXXX da0 at mpr0 bus 0 scbus5 target 8 lun 0
Aug 22 10:32:59 XXXXXXXXX da0: <TOSHIBA MG04SCA40EN DS06> Fixed Direct Access SPC-4 SCSI device
Aug 22 10:32:59 XXXXXXXXX da0: Serial Number 76L0A16CFVNC
Aug 22 10:32:59 XXXXXXXXX da0: 1200.000MB/s transfers
Aug 22 10:32:59 XXXXXXXXX da0: Command Queueing enabled
Aug 22 10:32:59 XXXXXXXXX da0: 3815447MB (7814037168 512 byte sectors)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py da0'
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be 71 00 00 00 04 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(10). CDB: 28 00 00 00 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(10). CDB: 28 00 00 00 02 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 ba 00 00 00 01 00 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 bc 00 00 00 01 00 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(10). CDB: 28 00 00 00 00 00 00 01 00 00
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): READ(10). CDB: 28 00 00 00 02 00 00 01 00 00
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 ba 00 00 00 01 00 00 00
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 bc 00 00 00 01 00 00 00
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:33:01 XXXXXXXXX mfi0: 1431 (525191582s/0x0002/WARN) - PD 03(e0x20/s3) Path 5000039728382ae6  reset (Type 03)
Aug 22 10:33:01 XXXXXXXXX mfi0: 1432 (525191582s/0x0002/WARN) - Removed: PD 03(e0x20/s3)
Aug 22 10:33:01 XXXXXXXXX mfisyspd3: Detaching syspd
Aug 22 10:33:01 XXXXXXXXX mfisyspd3: detached
Aug 22 10:33:01 XXXXXXXXX mfi0: pass3 at mfi0 bus 0 scbus0 target 3 lun 0
Aug 22 10:33:01 XXXXXXXXX 1433 (525191582s/0x0002/info) - Removed: PD 03(e0x20/s3) Info: enclPd=20, scsiType=0, portMap=00, sasAddr=5000039728382ae6,000pass3: 0000000000000
Aug 22 10:33:01 XXXXXXXXX syslog-ng[67869]: Error processing log message: <TOSHIBA MG04SCA40EN DS06>mfi0:  s/n 76L0A0B2FVNC1434 (525191582s/0x0002/info) - State change on PD 03(e0x20/s3) from JBOD(40) to UNCONFIGURED_BAD(1)
Aug 22 10:33:01 XXXXXXXXX detached
Aug 22 10:33:01 XXXXXXXXX (pass3:mfi0:0:3:0): Periph destroyed
Aug 22 10:33:02 XXXXXXXXX mpr0: SAS Address from SAS device page0 = 5000039728382ae6
Aug 22 10:33:02 XXXXXXXXX mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0016> enclosureHandle<0x0002> slot 3
Aug 22 10:33:02 XXXXXXXXX mpr0: At enclosure level 0 and connector name (    )
Aug 22 10:33:07 XXXXXXXXX mfi0: 1435 (525191588s/0x0002/WARN) - PD 04(e0x20/s4) Path 500003972838fe46  reset (Type 03)
Aug 22 10:33:07 XXXXXXXXX mfi0: 1436 (525191588s/0x0002/WARN) - Removed: PD 04(e0x20/s4)
Aug 22 10:33:07 XXXXXXXXX mfisyspd4: Detaching syspd
Aug 22 10:33:07 XXXXXXXXX mfisyspd4: detached
Aug 22 10:33:07 XXXXXXXXX mfi0: pass4 at mfi0 bus 0 scbus0 target 4 lun 0
Aug 22 10:33:07 XXXXXXXXX 1437 (525191588s/0x0002/info) - Removed: PD 04(e0x20/s4) Info: enclPd=20, scsiType=0, portMap=00, sasAddr=500003972838fe46,000pass4: 0000000000000
Aug 22 10:33:07 XXXXXXXXX syslog-ng[67869]: Error processing log message: <TOSHIBA MG04SCA40EN DS06>mfi0:  s/n 76L0A16RFVNC1438 (525191588s/0x0002/info) - State change on PD 04(e0x20/s4) from JBOD(40) to UNCONFIGURED_BAD(1)
Aug 22 10:33:07 XXXXXXXXX detached
Aug 22 10:33:07 XXXXXXXXX (pass4:mfi0:0:4:0): Periph destroyed
Aug 22 10:33:09 XXXXXXXXX da1 at mpr0 bus 0 scbus5 target 9 lun 0
Aug 22 10:33:09 XXXXXXXXX da1: <TOSHIBA MG04SCA40EN DS06> Fixed Direct Access SPC-4 SCSI device
Aug 22 10:33:09 XXXXXXXXX da1: Serial Number 76K0A16XFVNC
Aug 22 10:33:09 XXXXXXXXX da1: 1200.000MB/s transfers
Aug 22 10:33:09 XXXXXXXXX da1: Command Queueing enabled
Aug 22 10:33:09 XXXXXXXXX da1: 3815447MB (7814037168 512 byte sectors)
....


First the drives form the server, identified as mfisyspd0-7 removed, then pd0-7 were removed.
Drives previously known as mfisyspd0-7 were placed in the drive enclosure counting down from 7. Getting the new names of pd0-7
Then pd0-7 were put in the server, counting down form 7 to 0 again. and now being named mfisyspd0-7

I did create a volume on mfisyspd0-4 in RaidZ2 configuration, and was not able to create one on pd0-4.

Matt
 

Attachments

  • drive_move.txt
    97.1 KB · Views: 293

Spearfoot

He of the long foot
Moderator
Joined
May 13, 2015
Messages
2,478
The long SMART test had no reports, and "smartctl -a /dev/da0" and smartctl -a /dev/pass0" showed the same information.

I've physically flipped the drives from the server to the shelf, and shelf to the server, keeping the same relative position of the drives, and still have the errors.
They even showed up as part of the drive disconnect and re-connect.

The first section of the log is below, the full log is attached.
Code:
Aug 22 10:31:56 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da0'
Aug 22 10:31:57 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 8
Aug 22 10:31:57 XXXXXXXXX da0 at mpr0 bus 0 scbus5 target 8 lun 0
Aug 22 10:31:57 XXXXXXXXX da0: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0RPFVNC detached
Aug 22 10:31:57 XXXXXXXXX (da0:mpr0:0:8:0): Periph destroyed
Aug 22 10:31:57 XXXXXXXXX mpr0: clearing target 8 handle 0x000d
Aug 22 10:31:57 XXXXXXXXX mpr0: At enclosure level 0, slot 0, connector name (    )
Aug 22 10:31:57 XXXXXXXXX mpr0: Unfreezing devq for target ID 8
Aug 22 10:32:01 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 9
Aug 22 10:32:01 XXXXXXXXX da1 at mpr0 bus 0 scbus5 target 9 lun 0
Aug 22 10:32:01 XXXXXXXXX da1: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A16EFVNC detached
Aug 22 10:32:01 XXXXXXXXX (da1:mpr0:0:9:0): Periph destroyed
Aug 22 10:32:01 XXXXXXXXX mpr0: clearing target 9 handle 0x000b
Aug 22 10:32:01 XXXXXXXXX mpr0: At enclosure level 0, slot 1, connector name (    )
Aug 22 10:32:01 XXXXXXXXX mpr0: Unfreezing devq for target ID 9
Aug 22 10:32:02 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 10
Aug 22 10:32:02 XXXXXXXXX da2 at mpr0 bus 0 scbus5 target 10 lun 0
Aug 22 10:32:02 XXXXXXXXX da2: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0RNFVNC detached
Aug 22 10:32:02 XXXXXXXXX (da2:mpr0:0:10:0): Periph destroyed
Aug 22 10:32:02 XXXXXXXXX mpr0: clearing target 10 handle 0x000f
Aug 22 10:32:02 XXXXXXXXX mpr0: At enclosure level 0, slot 2, connector name (    )
Aug 22 10:32:02 XXXXXXXXX mpr0: Unfreezing devq for target ID 10
Aug 22 10:32:03 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da1'
Aug 22 10:32:03 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 11
Aug 22 10:32:03 XXXXXXXXX da3 at mpr0 bus 0 scbus5 target 11 lun 0
Aug 22 10:32:03 XXXXXXXXX da3: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0STFVNC detached
Aug 22 10:32:03 XXXXXXXXX (da3:mpr0:0:11:0): Periph destroyed
Aug 22 10:32:03 XXXXXXXXX mpr0: clearing target 11 handle 0x000e
Aug 22 10:32:03 XXXXXXXXX mpr0: At enclosure level 0, slot 3, connector name (    )
Aug 22 10:32:03 XXXXXXXXX mpr0: Unfreezing devq for target ID 11
Aug 22 10:32:05 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 12
Aug 22 10:32:05 XXXXXXXXX da4 at mpr0 bus 0 scbus5 target 12 lun 0
Aug 22 10:32:05 XXXXXXXXX da4: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0RQFVNC detached
Aug 22 10:32:05 XXXXXXXXX mpr0: clearing target 12 handle 0x000c
Aug 22 10:32:05 XXXXXXXXX mpr0: At enclosure level 0, slot 4, connector name (    )
Aug 22 10:32:05 XXXXXXXXX mpr0: Unfreezing devq for target ID 12
Aug 22 10:32:05 XXXXXXXXX (da4:mpr0:0:12:0): Periph destroyed
Aug 22 10:32:06 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 13
Aug 22 10:32:06 XXXXXXXXX da5 at mpr0 bus 0 scbus5 target 13 lun 0
Aug 22 10:32:06 XXXXXXXXX da5: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0S8FVNC detached
Aug 22 10:32:06 XXXXXXXXX mpr0: clearing target 13 handle 0x000a
Aug 22 10:32:06 XXXXXXXXX mpr0: At enclosure level 0, slot 5, connector name (    )
Aug 22 10:32:06 XXXXXXXXX mpr0: Unfreezing devq for target ID 13
Aug 22 10:32:06 XXXXXXXXX (da5:mpr0:0:13:0): Periph destroyed
Aug 22 10:32:08 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 14
Aug 22 10:32:08 XXXXXXXXX da6 at mpr0 bus 0 scbus5 target 14 lun 0
Aug 22 10:32:08 XXXXXXXXX da6: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A16KFVNC detached
Aug 22 10:32:08 XXXXXXXXX mpr0: clearing target 14 handle 0x0010
Aug 22 10:32:08 XXXXXXXXX mpr0: At enclosure level 0, slot 6, connector name (    )
Aug 22 10:32:08 XXXXXXXXX mpr0: Unfreezing devq for target ID 14
Aug 22 10:32:08 XXXXXXXXX (da6:mpr0:0:14:0): Periph destroyed
Aug 22 10:32:09 XXXXXXXXX mpr0: mprsas_prepare_remove: Sending reset for target ID 15
Aug 22 10:32:09 XXXXXXXXX da7 at mpr0 bus 0 scbus5 target 15 lun 0
Aug 22 10:32:09 XXXXXXXXX da7: <TOSHIBA MG04SCA40EN DS06> s/n 76L0A0BKFVNC detached
Aug 22 10:32:09 XXXXXXXXX mpr0: clearing target 15 handle 0x0011
Aug 22 10:32:09 XXXXXXXXX mpr0: At enclosure level 0, slot 7, connector name (    )
Aug 22 10:32:09 XXXXXXXXX mpr0: Unfreezing devq for target ID 15
Aug 22 10:32:09 XXXXXXXXX (da7:mpr0:0:15:0): Periph destroyed
Aug 22 10:32:09 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da2'
Aug 22 10:32:10 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da3'
Aug 22 10:32:11 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da4'
Aug 22 10:32:12 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da5'
Aug 22 10:32:13 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da6'
Aug 22 10:32:13 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da7'
Aug 22 10:32:39 XXXXXXXXX mfi0: 1419 (525191560s/0x0002/WARN) - PD 00(e0x20/s0) Path 500003972838fdfe  reset (Type 03)
Aug 22 10:32:39 XXXXXXXXX mfi0: 1420 (525191560s/0x0002/WARN) - Removed: PD 00(e0x20/s0)
Aug 22 10:32:39 XXXXXXXXX mfisyspd0: Detaching syspd
Aug 22 10:32:39 XXXXXXXXX mfisyspd0: detached
Aug 22 10:32:39 XXXXXXXXX mfi0: pass0 at mfi0 bus 0 scbus0 target 0 lun 0
Aug 22 10:32:39 XXXXXXXXX 1421 (525191560s/0x0002/info) - Removed: PD 00(e0x20/s0) Info: enclPd=20, scsiType=0, portMap=00, sasAddr=500003972838fdfe,000pass0: 0000000000000
Aug 22 10:32:39 XXXXXXXXX syslog-ng[67869]: Error processing log message: <TOSHIBA MG04SCA40EN DS06>mfi0:  s/n 76L0A16CFVNC1422 (525191560s/0x0002/info) - State change on PD 00(e0x20/s0) from JBOD(40) to UNCONFIGURED_BAD(1)
Aug 22 10:32:39 XXXXXXXXX detached
Aug 22 10:32:39 XXXXXXXXX (pass0:mfi0:0:0:0): Periph destroyed
Aug 22 10:32:42 XXXXXXXXX mpr0: SAS Address from SAS device page0 = 500003972838fdfe
Aug 22 10:32:42 XXXXXXXXX mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0013> enclosureHandle<0x0002> slot 0
Aug 22 10:32:42 XXXXXXXXX mpr0: At enclosure level 0 and connector name (    )
Aug 22 10:32:46 XXXXXXXXX mfi0: 1423 (525191567s/0x0002/WARN) - PD 01(e0x20/s1) Path 5000039728337e5a  reset (Type 03)
Aug 22 10:32:46 XXXXXXXXX mfi0: 1424 (525191567s/0x0002/WARN) - Removed: PD 01(e0x20/s1)
Aug 22 10:32:46 XXXXXXXXX mfisyspd1: Detaching syspd
Aug 22 10:32:46 XXXXXXXXX mfisyspd1: detached
Aug 22 10:32:46 XXXXXXXXX mfi0: pass1 at mfi0 bus 0 scbus0 target 1 lun 0
Aug 22 10:32:46 XXXXXXXXX 1425 (525191567s/0x0002/info) - Removed: PD 01(e0x20/s1) Info: enclPd=20, scsiType=0, portMap=00, sasAddr=5000039728337e5a,000pass1: 0000000000000
Aug 22 10:32:46 XXXXXXXXX syslog-ng[67869]: Error processing log message: <TOSHIBA MG04SCA40EN DS06>mfi0:  s/n 76K0A16XFVNC1426 (525191567s/0x0002/info) - State change on PD 01(e0x20/s1) from JBOD(40) to UNCONFIGURED_BAD(1)
Aug 22 10:32:46 XXXXXXXXX detached
Aug 22 10:32:46 XXXXXXXXX (pass1:mfi0:0:1:0): Periph destroyed
Aug 22 10:32:51 XXXXXXXXX mpr0: SAS Address from SAS device page0 = 5000039728337e5a
Aug 22 10:32:51 XXXXXXXXX mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0014> enclosureHandle<0x0002> slot 1
Aug 22 10:32:51 XXXXXXXXX mpr0: At enclosure level 0 and connector name (    )
Aug 22 10:32:55 XXXXXXXXX mfi0: 1427 (525191576s/0x0002/WARN) - PD 02(e0x20/s2) Path 5000039728337e4a  reset (Type 03)
Aug 22 10:32:55 XXXXXXXXX mfi0: 1428 (525191576s/0x0002/WARN) - Removed: PD 02(e0x20/s2)
Aug 22 10:32:55 XXXXXXXXX mfisyspd2: Detaching syspd
Aug 22 10:32:55 XXXXXXXXX mfisyspd2: detached
Aug 22 10:32:55 XXXXXXXXX mfi0: pass2 at mfi0 bus 0 scbus0 target 2 lun 0
Aug 22 10:32:55 XXXXXXXXX 1429 (525191576s/0x0002/info) - Removed: PD 02(e0x20/s2) Info: enclPd=20, scsiType=0, portMap=00, sasAddr=5000039728337e4a,000pass2: 0000000000000
Aug 22 10:32:55 XXXXXXXXX syslog-ng[67869]: Error processing log message: <TOSHIBA MG04SCA40EN DS06>mfi0:  s/n 76K0A16WFVNC1430 (525191576s/0x0002/info) - State change on PD 02(e0x20/s2) from JBOD(40) to UNCONFIGURED_BAD(1)
Aug 22 10:32:55 XXXXXXXXX detached
Aug 22 10:32:55 XXXXXXXXX (pass2:mfi0:0:2:0): Periph destroyed
Aug 22 10:32:57 XXXXXXXXX mpr0: SAS Address from SAS device page0 = 5000039728337e4a
Aug 22 10:32:57 XXXXXXXXX mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0015> enclosureHandle<0x0002> slot 2
Aug 22 10:32:57 XXXXXXXXX mpr0: At enclosure level 0 and connector name (    )
Aug 22 10:32:59 XXXXXXXXX da0 at mpr0 bus 0 scbus5 target 8 lun 0
Aug 22 10:32:59 XXXXXXXXX da0: <TOSHIBA MG04SCA40EN DS06> Fixed Direct Access SPC-4 SCSI device
Aug 22 10:32:59 XXXXXXXXX da0: Serial Number 76L0A16CFVNC
Aug 22 10:32:59 XXXXXXXXX da0: 1200.000MB/s transfers
Aug 22 10:32:59 XXXXXXXXX da0: Command Queueing enabled
Aug 22 10:32:59 XXXXXXXXX da0: 3815447MB (7814037168 512 byte sectors)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py da0'
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be 71 00 00 00 04 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be ae 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(10). CDB: 28 00 00 00 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(10). CDB: 28 00 00 00 02 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 ba 00 00 00 01 00 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 be af 00 00 00 01 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 bc 00 00 00 01 00 00 00
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:32:59 XXXXXXXXX (da0:mpr0:0:8:0): READ(10). CDB: 28 00 00 00 00 00 00 01 00 00
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): READ(10). CDB: 28 00 00 00 02 00 00 01 00 00
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 ba 00 00 00 01 00 00 00
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 bc 00 00 00 01 00 00 00
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): CAM status: SCSI Status Error
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI status: Check Condition
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
Aug 22 10:33:00 XXXXXXXXX (da0:mpr0:0:8:0): Error 22, Unretryable error
Aug 22 10:33:01 XXXXXXXXX mfi0: 1431 (525191582s/0x0002/WARN) - PD 03(e0x20/s3) Path 5000039728382ae6  reset (Type 03)
Aug 22 10:33:01 XXXXXXXXX mfi0: 1432 (525191582s/0x0002/WARN) - Removed: PD 03(e0x20/s3)
Aug 22 10:33:01 XXXXXXXXX mfisyspd3: Detaching syspd
Aug 22 10:33:01 XXXXXXXXX mfisyspd3: detached
Aug 22 10:33:01 XXXXXXXXX mfi0: pass3 at mfi0 bus 0 scbus0 target 3 lun 0
Aug 22 10:33:01 XXXXXXXXX 1433 (525191582s/0x0002/info) - Removed: PD 03(e0x20/s3) Info: enclPd=20, scsiType=0, portMap=00, sasAddr=5000039728382ae6,000pass3: 0000000000000
Aug 22 10:33:01 XXXXXXXXX syslog-ng[67869]: Error processing log message: <TOSHIBA MG04SCA40EN DS06>mfi0:  s/n 76L0A0B2FVNC1434 (525191582s/0x0002/info) - State change on PD 03(e0x20/s3) from JBOD(40) to UNCONFIGURED_BAD(1)
Aug 22 10:33:01 XXXXXXXXX detached
Aug 22 10:33:01 XXXXXXXXX (pass3:mfi0:0:3:0): Periph destroyed
Aug 22 10:33:02 XXXXXXXXX mpr0: SAS Address from SAS device page0 = 5000039728382ae6
Aug 22 10:33:02 XXXXXXXXX mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0016> enclosureHandle<0x0002> slot 3
Aug 22 10:33:02 XXXXXXXXX mpr0: At enclosure level 0 and connector name (    )
Aug 22 10:33:07 XXXXXXXXX mfi0: 1435 (525191588s/0x0002/WARN) - PD 04(e0x20/s4) Path 500003972838fe46  reset (Type 03)
Aug 22 10:33:07 XXXXXXXXX mfi0: 1436 (525191588s/0x0002/WARN) - Removed: PD 04(e0x20/s4)
Aug 22 10:33:07 XXXXXXXXX mfisyspd4: Detaching syspd
Aug 22 10:33:07 XXXXXXXXX mfisyspd4: detached
Aug 22 10:33:07 XXXXXXXXX mfi0: pass4 at mfi0 bus 0 scbus0 target 4 lun 0
Aug 22 10:33:07 XXXXXXXXX 1437 (525191588s/0x0002/info) - Removed: PD 04(e0x20/s4) Info: enclPd=20, scsiType=0, portMap=00, sasAddr=500003972838fe46,000pass4: 0000000000000
Aug 22 10:33:07 XXXXXXXXX syslog-ng[67869]: Error processing log message: <TOSHIBA MG04SCA40EN DS06>mfi0:  s/n 76L0A16RFVNC1438 (525191588s/0x0002/info) - State change on PD 04(e0x20/s4) from JBOD(40) to UNCONFIGURED_BAD(1)
Aug 22 10:33:07 XXXXXXXXX detached
Aug 22 10:33:07 XXXXXXXXX (pass4:mfi0:0:4:0): Periph destroyed
Aug 22 10:33:09 XXXXXXXXX da1 at mpr0 bus 0 scbus5 target 9 lun 0
Aug 22 10:33:09 XXXXXXXXX da1: <TOSHIBA MG04SCA40EN DS06> Fixed Direct Access SPC-4 SCSI device
Aug 22 10:33:09 XXXXXXXXX da1: Serial Number 76K0A16XFVNC
Aug 22 10:33:09 XXXXXXXXX da1: 1200.000MB/s transfers
Aug 22 10:33:09 XXXXXXXXX da1: Command Queueing enabled
Aug 22 10:33:09 XXXXXXXXX da1: 3815447MB (7814037168 512 byte sectors)
....


First the drives form the server, identified as mfisyspd0-7 removed, then pd0-7 were removed.
Drives previously known as mfisyspd0-7 were placed in the drive enclosure counting down from 7. Getting the new names of pd0-7
Then pd0-7 were put in the server, counting down form 7 to 0 again. and now being named mfisyspd0-7

I did create a volume on mfisyspd0-4 in RaidZ2 configuration, and was not able to create one on pd0-4.

Matt
I'm out of ideas... :(

@depasseg, @fullspeed : you guys are running 12Gb/s gear; do you have any idea what the problem is here?
 

Spearfoot

He of the long foot
Moderator
Joined
May 13, 2015
Messages
2,478
I remember freenas discouraging hardware RAID....

Sent from my SM-N920P using Tapatalk
Correct, but not the problem here as the OP has configured his LSI card for IT mode.
 

Matt Kent

Dabbler
Joined
Jun 21, 2016
Messages
24
I remember freenas discouraging hardware RAID....

Sent from my SM-N920P using Tapatalk
Ninja, I am using the ZFS Volume creator from the web interface, so no hardware RAID is involved.
What in the log it making you think hardware RAID is involved?

Matt
 
Joined
Aug 21, 2016
Messages
7
I think you should test the lsi card. Try using completely different drives just to test it works properly. I've seen suggestions to check cables & other things. The weather has been hot lately. Unless you keep it in an AC cooled area. I'm just focusing on the last lines UNCONFIGURED BAD & periph destroyed. B4 you go nuts any further make sure the card is 100% good. (Haven't read every response)

Sent from my SM-N920P using Tapatalk
 

depasseg

FreeNAS Replicant
Joined
Sep 16, 2014
Messages
2,874
What in the log it making you think hardware RAID is involved?
seeing /dev/mfi and /dev/pass devices.

Drives can be presented as individual "JBOD" via a HW RAID controller and some think that they aren't using HW RAID, when they actually are. In this case though, the LSI does look like it's in IT mode, but I'm not sure about the H730.

I think there is an issue with the driver and H730 controller combo. And either a physical issue between the LSI and the MD1400, or an incompatibility with the MD1400.
 
Joined
Aug 21, 2016
Messages
7
seeing /dev/mfi and /dev/pass devices.

Drives can be presented as individual "JBOD" via a HW RAID controller and some think that they aren't using HW RAID, when they actually are. In this case though, the LSI does look like it's in IT mode, but I'm not sure about the H730.

I think there is an issue with the driver and H730 controller combo. And either a physical issue between the LSI and the MD1400, or an incompatibility with the MD1400.
Yeah I there are driver compatibility issues with freenas....

Sent from my SM-N920P using Tapatalk
 

depasseg

FreeNAS Replicant
Joined
Sep 16, 2014
Messages
2,874
Status
Not open for further replies.
Top