Problem with LSI HBA after upgrade from FreeNAS 11.3U2 to TrueNAS 12.0

beralt

beralt

Dabbler
Joined
Jan 8, 2019
Messages
18
Hello everyone,

since an update from FreeNAS 11.3.U2 (via 11.3.U5) to TrueNAS 12.0 I have problems with my LSI HBA.
Error messages are as follows.

Code:
mps0: Unfreezing devq for target ID 11
mps0: Unfreezing devq for target ID 9
mps0: Unfreezing devq for target ID 8
mps0: Unfreezing devq for target ID 10
mps0: Firmware: 20.00.07.00, Driver: 21.02.00.00-fbsd
mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
    (da1:mps0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 0f a6 ed 40 00 00 00 58 00 00 length 45056 SMID 1032 Command timeout on target 9(0x0012) 60000 set, 60.78298837 elapsed
mps0: Sending abort to target 9 for SMID 1032
    (da1:mps0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 0f a6 ed 40 00 00 00 58 00 00 length 45056 SMID 1032 Aborting command 0xfffffe00f94c1ac0
    (da0:mps0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 0c ca 3e f8 00 00 00 a0 00 00 length 81920 SMID 23 Command timeout on target 8(0x0011) 60000 set, 60.212799327 elapsed
mps0: Sending abort to target 8 for SMID 23
    (da0:mps0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 0c ca 3e f8 00 00 00 a0 00 00 length 81920 SMID 23 Aborting command 0xfffffe00f946cee8
    (da1:mps0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 0e 8f dc 58 00 00 00 b0 00 00 length 90112 SMID 938 Command timeout on target 9(0x0012) 60000 set, 60.179161024 elapsed
    (da0:mps0:0:8:0): READ(16). CDB: 88 00 00 00 00 01 0e 98 68 88 00 00 00 b0 00 00 length 90112 SMID 856 Command timeout on target 8(0x0011) 60000 set, 60.170157947 elapsed
    (da1:mps0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 0f a7 ff 00 00 00 00 60 00 00 length 49152 SMID 1451 Command timeout on target 9(0x0012) 60000 set, 60.235819399 elapsed
    (da1:mps0:0:9:0): READ(16). CDB: 88 00 00 00 00 01 0f a7 fe 00 00 00 01 00 00 00 length 131072 SMID 1330 Command timeout on target 9(0x0012) 60000 set, 60.300601997 elapsed
    (da0:mps0:0:8:0): READ(10). CDB: 28 00 6a 58 97 50 00 01 00 00 length 131072 SMID 653 Command timeout on target 8(0x0011) 60000 set, 60.366707821 elapsed
    (da0:mps0:0:8:0): READ(10). CDB: 28 00 6a 58 96 50 00 01 00 00 length 131072 SMID 1097 Command timeout on target 8(0x0011) 60000 set, 60.424795289 elapsed
    (da0:mps0:0:8:0): READ(10). CDB: 28 00 6a 58 95 50 00 01 00 00 length 131072 SMID 989 Command timeout on target 8(0x0011) 60000 set, 60.483236665 elapsed
    (da0:mps0:0:8:0): READ(10). CDB: 28 00 6a 58 94 50 00 01 00 00 length 131072 SMID 354 Command timeout on target 8(0x0011) 60000 set, 60.541325694 elapsed
    (da3:mps0:0:11:0): WRITE(16). CDB: 8a 00 00 00 00 01 94 5a 70 08 00 00 01 00 00 00 length 131072 SMID 519 Command timeout on target 11(0x0013) 60000 set, 60.401041195 elapsed
mps0: Sending abort to target 11 for SMID 519
    (da3:mps0:0:11:0): WRITE(16). CDB: 8a 00 00 00 00 01 94 5a 70 08 00 00 01 00 00 00 length 131072 SMID 519 Aborting command 0xfffffe00f9496968
    (da2:mps0:0:10:0): WRITE(16). CDB: 8a 00 00 00 00 01 94 5a 70 08 00 00 01 00 00 00 length 131072 SMID 67 Command timeout on target 10(0x0015) 60000 set, 60.538075190 elapsed
mps0: Sending abort to target 10 for SMID 67
    (da2:mps0:0:10:0): WRITE(16). CDB: 8a 00 00 00 00 01 94 5a 70 08 00 00 01 00 00 00 length 131072 SMID 67 Aborting command 0xfffffe00f9470a08
    (da1:mps0:0:9:0): WRITE(16). CDB: 8a 00 00 00 00 01 8c 42 01 78 00 00 00 08 00 00 length 4096 SMID 399 Command timeout on target 9(0x0012) 60000 set, 60.676508524 elapsed
    (da0:mps0:0:8:0): WRITE(16). CDB: 8a 00 00 00 00 01 8c 42 01 78 00 00 00 08 00 00 length 4096 SMID 1316 Command timeout on target 8(0x0011) 60000 set, 60.740991674 elapsed
    (xpt0:mps0:0:9:0): SMID 4 task mgmt 0xfffffe00f946b560 timed out
mps0: Reinitializing controller
mps0: Unfreezing devq for target ID 10
mps0: Unfreezing devq for target ID 9
mps0: Unfreezing devq for target ID 8
mps0: Unfreezing devq for target ID 11
mps0: Firmware: 20.00.07.00, Driver: 21.02.00.00-fbsd
mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>


My adapter is the following:

Code:
mps0 Adapter:
       Board Name: LSI2116-IT
   Board Assembly:
        Chip Name: LSISAS2116
    Chip Revision: ALL
    BIOS Revision: 7.37.01.00
Firmware Revision: 20.00.07.00


I initially reported the failures in this thread, but at that time, I was not sure yet what exactly caused my problems.
After shutting down all VMs and unmounting all the NFS shares from other machines, the system ran stable without errors, so I marked the old thread with solved.
Since then, I have further managed (after lots of trouble due to the supermicro firmware) to finally upgrade the firmware to the current version (20.00.07).

However, after restarting VMs and/or mounting network drives again, the errors came back.
I also found this thread reporting similar errors on another (equivalent?) LSI HBA, which seems to be the same as mine.

In any case, the current situation leaves my pool constantly degraded, with the only solution to fix it being disconnecting everything and scrubbing/resilvering.

I have not upgraded my pool to the new zfs version, since I am afraid that then there is no possibility of going back. Unfortunately, downgrading easily from TrueNAS 12.0 back to FreeNAS 11.2 seems not to be easily possible.

Does anyone else have these problems and/or a solution? Is there a place (upstream?) to report this bug? Any ideas?

(Edit info: (the original version of the thread stated that I can from FreeNAS 11.2. I just realized that this was not true. I did the upgrade from 11.3.U2 (via 11.3.U5) to TrueNAS - sorry for my confusion)


For completeness, my system specs:
  • Supermicro X10SDV-4C-7TP4F
  • Intel® Xeon® processor D-1518, Single socket FCBGA 1667; 4-Core, 8 Threads, 35W
  • 48 GB RAM
  • 4xWD Red 2TB for storage, 2x32GB SanDisk USB SSD drives for system
 
Last edited:
U

UltimateDogg

Cadet
Joined
Jun 23, 2021
Messages
1
I think i have the same issue. I actually have the same board as you.
  • Supermicro X10SDV-4C-7TP4F
  • Intel® Xeon® processor D-1518, Single socket FCBGA 1667; 4-Core, 8 Threads, 35W
  • 32 GB RAM
  • 6xSamsung PM853T MZ-7GE960 960GB SATA 6SSD drives for iscsi storage to vmware

upgraded from 11.3-U4.1 to 12.0-U4. I get this error on all disks in my iscsi pool. I dont get the error with the old version.

Code:
Jun 23 23:02:01 truenas01     (da0:mps0:0:0:0): WRITE(10). CDB: 2a 00 24 40 d8 c8 00 00 d0 00 length 106496 SMID 485 Command timeout on target 0(0x0011) 60000 set, 60.121722882 elapsed
Jun 23 23:02:01 truenas01 mps0: Sending abort to target 0 for SMID 485
Jun 23 23:02:01 truenas01     (da0:mps0:0:0:0): WRITE(10). CDB: 2a 00 24 40 d8 c8 00 00 d0 00 length 106496 SMID 485 Aborting command 0xfffffe00e9493bb8
Jun 23 23:02:01 truenas01     (da7:mps0:0:7:0): WRITE(10). CDB: 2a 00 6d 5b 07 b8 00 01 00 00 length 131072 SMID 487 Command timeout on target 7(0x0018) 60000 set, 60.122071666 elapsed
Jun 23 23:02:01 truenas01 mps0: Sending abort to target 7 for SMID 487
Jun 23 23:02:01 truenas01     (da7:mps0:0:7:0): WRITE(10). CDB: 2a 00 6d 5b 07 b8 00 01 00 00 length 131072 SMID 487 Aborting command 0xfffffe00e9493e68
Jun 23 23:02:01 truenas01     (da2:mps0:0:2:0): WRITE(10). CDB: 2a 00 6d 5b 07 b8 00 01 00 00 length 131072 SMID 480 Command timeout on target 2(0x0013) 60000 set, 60.122743674 elapsed
Jun 23 23:02:01 truenas01 mps0: Sending abort to target 2 for SMID 480
Jun 23 23:02:01 truenas01     (da2:mps0:0:2:0): WRITE(10). CDB: 2a 00 6d 5b 07 b8 00 01 00 00 length 131072 SMID 480 Aborting command 0xfffffe00e9493500
Jun 23 23:02:01 truenas01     (da6:mps0:0:6:0): WRITE(10). CDB: 2a 00 3e 40 bf d0 00 00 f8 00 length 126976 SMID 431 Command timeout on target 6(0x0017) 60000 set, 60.123074849 elapsed
Jun 23 23:02:01 truenas01 mps0: Sending abort to target 6 for SMID 431
Jun 23 23:02:01 truenas01     (da6:mps0:0:6:0): WRITE(10). CDB: 2a 00 3e 40 bf d0 00 00 f8 00 length 126976 SMID 431 Aborting command 0xfffffe00e948f328
Jun 23 23:02:01 truenas01     (da6:mps0:0:6:0): WRITE(10). CDB: 2a 00 3e 40 c0 c8 00 00 80 00 length 65536 SMID 484 Command timeout on target 6(0x0017) 60000 set, 60.123451760 elapsed
Jun 23 23:02:01 truenas01     (da4:mps0:0:4:0): WRITE(10). CDB: 2a 00 24 40 d8 38 00 01 00 00 length 131072 SMID 432 Command timeout on target 4(0x0015) 60000 set, 60.123858040 elapsed
Jun 23 23:02:01 truenas01 mps0: Sending abort to target 4 for SMID 432
Jun 23 23:02:01 truenas01     (da4:mps0:0:4:0): WRITE(10). CDB: 2a 00 24 40 d8 38 00 01 00 00 length 131072 SMID 432 Aborting command 0xfffffe00e948f480
Jun 23 23:02:01 truenas01     (da5:mps0:0:5:0): WRITE(10). CDB: 2a 00 3e 40 be d8 00 00 f8 00 length 126976 SMID 450 Command timeout on target 5(0x0016) 60000 set, 60.124197030 elapsed
Jun 23 23:02:01 truenas01 mps0: Sending abort to target 5 for SMID 450
Jun 23 23:02:01 truenas01     (da5:mps0:0:5:0): WRITE(10). CDB: 2a 00 3e 40 be d8 00 00 f8 00 length 126976 SMID 450 Aborting command 0xfffffe00e9490cb0
Jun 23 23:02:01 truenas01     (da4:mps0:0:4:0): READ(10). CDB: 28 00 11 9b 24 30 00 00 20 00 length 16384 SMID 474 Command timeout on target 4(0x0015) 60000 set, 60.108585607 elapsed
Jun 23 23:02:01 truenas01     (da0:mps0:0:0:0): READ(10). CDB: 28 00 12 f3 ab e0 00 00 10 00 length 8192 SMID 460 Command timeout on target 0(0x0011) 60000 set, 60.88226395 elapsed
Jun 23 23:02:01 truenas01     (da2:mps0:0:2:0): READ(10). CDB: 28 00 11 40 ea e8 00 00 08 00 length 4096 SMID 466 Command timeout on target 2(0x0013) 60000 set, 60.75375064 elapsed
Jun 23 23:02:01 truenas01     (da5:mps0:0:5:0): READ(10). CDB: 28 00 11 41 30 48 00 00 08 00 length 4096 SMID 531 Command timeout on target 5(0x0016) 60000 set, 60.75558369 elapsed
Jun 23 23:02:01 truenas01     (da4:mps0:0:4:0): READ(10). CDB: 28 00 12 fd ea 70 00 00 08 00 length 4096 SMID 500 Command timeout on target 4(0x0015) 60000 set, 60.63773880 elapsed
Jun 23 23:02:01 truenas01     (da7:mps0:0:7:0): READ(10). CDB: 28 00 0c f7 60 18 00 00 18 00 length 12288 SMID 486 Command timeout on target 7(0x0018) 60000 set, 60.4796761 elapsed
Jun 23 23:02:01 truenas01     (da2:mps0:0:2:0): READ(10). CDB: 28 00 57 74 28 50 00 00 18 00 length 12288 SMID 477 Command timeout on target 2(0x0013) 60000 set, 60.98431544 elapsed
Jun 23 23:02:01 truenas01     (da5:mps0:0:5:0): READ(10). CDB: 28 00 63 4a fe 88 00 00 10 00 length 8192 SMID 515 Command timeout on target 5(0x0016) 60000 set, 60.53166855 elapsed
Jun 23 23:02:01 truenas01     (da6:mps0:0:6:0): READ(10). CDB: 28 00 63 4a fe 40 00 00 08 00 length 4096 SMID 499 Command timeout on target 6(0x0017) 60000 set, 60.53381841 elapsed
Jun 23 23:02:01 truenas01     (da5:mps0:0:5:0): READ(10). CDB: 28 00 63 4a fd d0 00 00 08 00 length 4096 SMID 449 Command timeout on target 5(0x0016) 60000 set, 60.54382791 elapsed
Jun 23 23:02:01 truenas01     (da6:mps0:0:6:0): READ(10). CDB: 28 00 63 4a fd 78 00 00 10 00 length 8192 SMID 439 Command timeout on target 6(0x0017) 60000 set, 60.54534658 elapsed
Jun 23 23:02:01 truenas01     (da5:mps0:0:5:0): READ(10). CDB: 28 00 63 4a fc f0 00 00 20 00 length 16384 SMID 514 Command timeout on target 5(0x0016) 60000 set, 60.55861971 elapsed
Jun 23 23:02:01 truenas01     (da6:mps0:0:6:0): READ(10). CDB: 28 00 63 4a fc 48 00 00 10 00 length 8192 SMID 527 Command timeout on target 6(0x0017) 60000 set, 60.56038241 elapsed
Jun 23 23:02:01 truenas01     (da6:mps0:0:6:0): READ(10). CDB: 28 00 63 4a fc 70 00 00 08 00 length 4096 SMID 507 Command timeout on target 6(0x0017) 60000 set, 60.57058704 elapsed
Jun 23 23:02:01 truenas01     (da5:mps0:0:5:0): READ(10). CDB: 28 00 63 4a fb 60 00 00 10 00 length 8192 SMID 479 Command timeout on target 5(0x0016) 60000 set, 60.57244220 elapsed
Jun 23 23:02:01 truenas01     (da5:mps0:0:5:0): READ(10). CDB: 28 00 63 4a fb 58 00 00 08 00 length 4096 SMID 490 Command timeout on target 5(0x0016) 60000 set, 60.58704253 elapsed
Jun 23 23:02:01 truenas01     (da6:mps0:0:6:0): READ(10). CDB: 28 00 63 4a fa a8 00 00 08 00 length 4096 SMID 471 Command timeout on target 6(0x0017) 60000 set, 60.58856198 elapsed
Jun 23 23:02:01 truenas01     (da5:mps0:0:5:0): READ(10). CDB: 28 00 63 4a fa 68 00 00 10 00 length 8192 SMID 518 Command timeout on target 5(0x0016) 60000 set, 60.59678754 elapsed
Jun 23 23:02:01 truenas01     (da6:mps0:0:6:0): READ(10). CDB: 28 00 63 4a f9 f0 00 00 08 00 length 4096 SMID 502 Command timeout on target 6(0x0017) 60000 set, 60.59838507 elapsed
Jun 23 23:02:01 truenas01     (da5:mps0:0:5:0): READ(10). CDB: 28 00 63 4a f9 c0 00 00 08 00 length 4096 SMID 523 Command timeout on target 5(0x0016) 60000 set, 60.60924918 elapsed
Jun 23 23:02:01 truenas01     (da6:mps0:0:6:0): READ(10). CDB: 28 00 63 4a f9 48 00 00 08 00 length 4096 SMID 434 Command timeout on target 6(0x0017) 60000 set, 60.61079510 elapsed
Jun 23 23:02:01 truenas01     (da5:mps0:0:5:0): READ(10). CDB: 28 00 63 4a f9 18 00 00 10 00 length 8192 SMID 426 Command timeout on target 5(0x0016) 60000 set, 60.62250669 elapsed
Jun 23 23:02:02 truenas01     (da6:mps0:0:6:0): READ(10). CDB: 28 00 03 6e 1b 28 00 00 18 00 length 12288 SMID 455 Command timeout on target 6(0x0017) 60000 set, 60.52656959 elapsed
Jun 23 23:02:02 truenas01     (da6:mps0:0:6:0): READ(10). CDB: 28 00 03 6e 1b 10 00 00 18 00 length 12288 SMID 494 Command timeout on target 6(0x0017) 60000 set, 60.53051089 elapsed
Jun 23 23:02:04 truenas01     (da5:mps0:0:5:0): READ(10). CDB: 28 00 34 bd 41 10 00 00 18 00 length 12288 SMID 503 Command timeout on target 5(0x0016) 60000 set, 60.232897433 elapsed
Jun 23 23:02:05 truenas01     (da7:mps0:0:7:0): READ(10). CDB: 28 00 64 3e 41 18 00 00 18 00 length 12288 SMID 475 Command timeout on target 7(0x0018) 60000 set, 60.93230818 elapsed
Jun 23 23:02:05 truenas01     (da0:mps0:0:0:0): READ(10). CDB: 28 00 50 ec cd 38 00 00 18 00 length 12288 SMID 509 Command timeout on target 0(0x0011) 60000 set, 60.6634622 elapsed
Jun 23 23:02:05 truenas01     (da4:mps0:0:4:0): READ(10). CDB: 28 00 50 ec cd 80 00 00 18 00 length 12288 SMID 482 Command timeout on target 4(0x0015) 60000 set, 60.655121064 elapsed
Jun 23 23:02:05 truenas01     (da14:mps0:0:14:0): WRITE(10). CDB: 2a 00 06 91 22 80 00 00 08 00 length 4096 SMID 492 Command timeout on target 14(0x001f) 60000 set, 60.186979883 elapsed
Jun 23 23:02:05 truenas01 mps0: Sending abort to target 14 for SMID 492
Jun 23 23:02:05 truenas01     (da14:mps0:0:14:0): WRITE(10). CDB: 2a 00 06 91 22 80 00 00 08 00 length 4096 SMID 492 Aborting command 0xfffffe00e9494520
Jun 23 23:02:05 truenas01     (da2:mps0:0:2:0): READ(10). CDB: 28 00 64 3e 40 e8 00 00 18 00 length 12288 SMID 520 Command timeout on target 2(0x0013) 60000 set, 60.188226546 elapsed
Jun 23 23:02:05 truenas01     (xpt0:mps0:0:5:0): SMID 6 task mgmt 0xfffffe00e946b810 timed out
Jun 23 23:02:05 truenas01 mps0: Reinitializing controller
Jun 23 23:02:06 truenas01 mps0: Unfreezing devq for target ID 0
Jun 23 23:02:06 truenas01 mps0: Unfreezing devq for target ID 7
Jun 23 23:02:06 truenas01 mps0: Unfreezing devq for target ID 2
Jun 23 23:02:06 truenas01 mps0: Unfreezing devq for target ID 6
Jun 23 23:02:06 truenas01 mps0: Unfreezing devq for target ID 4
Jun 23 23:02:06 truenas01 mps0: Unfreezing devq for target ID 5
Jun 23 23:02:06 truenas01 mps0: Unfreezing devq for target ID 14
Jun 23 23:02:06 truenas01 mps0: Firmware: 20.00.07.00, Driver: 21.02.00.00-fbsd
Jun 23 23:02:06 truenas01 mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc



Code:
root@truenas01:~ # dmesg | grep mps

mps0: <Avago Technologies (LSI) SAS2116> port 0xe000-0xe0ff mem 0xfb5c0000-0xfb5c3fff,0xfb580000-0xfb5bffff irq 16 at device 0.0 on pci3

mps0: Firmware: 20.00.07.00, Driver: 21.02.00.00-fbsd

mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>

da0 at mps0 bus 0 scbus0 target 0 lun 0

da1 at mps0 bus 0 scbus0 target 1 lun 0

da2 at mps0 bus 0 scbus0 target 2 lun 0

da5 at mps0 bus 0 scbus0 target 5 lun 0

da4 at mps0 bus 0 scbus0 target 4 lun 0

da7 at mps0 bus 0 scbus0 target 7 lun 0

da6 at mps0 bus 0 scbus0 target 6 lun 0

da3 at mps0 bus 0 scbus0 target 3 lun 0

da8 at mps0 bus 0 scbus0 target 8 lun 0

da9 at mps0 bus 0 scbus0 target 9 lun 0
 
beralt

beralt

Dabbler
Joined
Jan 8, 2019
Messages
18
Hey @UltimateDogg
did you find a solution yet? After just having the system down (because I had so much other stuff to do), I am about to try again to find the solution.
I have also the feeling that at some point something went wrong with the SAS controller firmware, so the first thing I will do is to reflash it with supermicro firmware.
 
beralt

beralt

Dabbler
Joined
Jan 8, 2019
Messages
18
Can also confirm that the problem persists at 12.0-U5

Forgot to mention:
Running FreeNAS 11.3 works without problems.
 
Last edited:
beralt

beralt

Dabbler
Joined
Jan 8, 2019
Messages
18
Update:
This did not help. I confirmed that with the loader option the maximum transfer size changed back to 128kb

Code:
mps0: maximum transfer size: 131072 bytes


but errors persist:


Code:
Dec 14 23:27:44 heimii     (pass0:mps0:0:8:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 135 Command timeout on target 8(0x0011) 30000 set, 30.3884696 elapsed
Dec 14 23:27:44 heimii mps0: Sending abort to target 8 for SMID 135
Dec 14 23:27:44 heimii     (pass0:mps0:0:8:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 135 Aborting command 0xfffffe00f9476568
Dec 14 23:27:44 heimii     (pass1:mps0:0:9:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 105 Command timeout on target 9(0x0012) 30000 set, 30.3633079 elapsed
Dec 14 23:27:44 heimii mps0: Sending abort to target 9 for SMID 105
Dec 14 23:27:44 heimii     (pass1:mps0:0:9:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 105 Aborting command 0xfffffe00f9473d18
Dec 14 23:27:44 heimii     (pass2:mps0:0:10:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 138 Command timeout on target 10(0x0013) 30000 set, 30.40296877 elapsed
Dec 14 23:27:44 heimii mps0: Sending abort to target 10 for SMID 138
Dec 14 23:27:44 heimii     (pass2:mps0:0:10:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 138 Aborting command 0xfffffe00f9476970
Dec 14 23:27:44 heimii     (pass3:mps0:0:11:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 70 Command timeout on target 11(0x0014) 30000 set, 30.70950537 elapsed
Dec 14 23:27:44 heimii mps0: Sending abort to target 11 for SMID 70
Dec 14 23:27:44 heimii     (pass3:mps0:0:11:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 70 Aborting command 0xfffffe00f9470e10
Dec 14 23:27:45 heimii     (pass5:mps0:0:15:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 90 Command timeout on target 15(0x0015) 30000 set, 30.3607776 elapsed
Dec 14 23:27:45 heimii mps0: Sending abort to target 15 for SMID 90
Dec 14 23:27:45 heimii     (pass5:mps0:0:15:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 90 Aborting command 0xfffffe00f94728f0
Dec 14 23:27:45 heimii     (pass4:mps0:0:14:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 87 Command timeout on target 14(0x0016) 30000 set, 30.91806572 elapsed
Dec 14 23:27:45 heimii mps0: Sending abort to target 14 for SMID 87
Dec 14 23:27:45 heimii     (pass4:mps0:0:14:0): ATA COMMAND PASS THROUGH(16). CDB: 85 06 00 00 00 00 00 00 00 00 00 00 00 40 e3 00 length 0 SMID 87 Aborting command 0xfffffe00f94724e8
Dec 14 23:27:50 heimii     (xpt0:mps0:0:8:0): SMID 1 task mgmt 0xfffffe00f946b158 timed out
Dec 14 23:27:50 heimii mps0: Reinitializing controller
Dec 14 23:27:50 heimii mps0: Unfreezing devq for target ID 8
Dec 14 23:27:50 heimii mps0: Unfreezing devq for target ID 9
Dec 14 23:27:50 heimii mps0: Unfreezing devq for target ID 10
Dec 14 23:27:50 heimii mps0: Unfreezing devq for target ID 11
Dec 14 23:27:50 heimii mps0: Unfreezing devq for target ID 15
Dec 14 23:27:50 heimii mps0: Unfreezing devq for target ID 14
Dec 14 23:27:50 heimii mps0: Firmware: 20.00.07.00, Driver: 21.02.00.00-fbsd
Dec 14 23:27:50 heimii mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>



So back to 11.3 again and waiting to try out TrueNAS scale...
 
Samuel Tai

Samuel Tai

Never underestimate your own stupidity
Moderator
Joined
Apr 24, 2020
Messages
5,399
Did you reboot after setting the loader option? It only takes effect on reboot.
 
beralt

beralt

Dabbler
Joined
Jan 8, 2019
Messages
18
Samuel Tai said:
Did you reboot after setting the loader option? It only takes effect on reboot.
Click to expand...
I did and made sure by checking whether the loader option was applied:
Code:
# cat /boot/loader.conf.local
hw.mps.max_io_pages="32"
hint.isp.0.role="2"
hint.isp.1.role="2"
hint.isp.2.role="2"
hint.isp.3.role="2"
kernel="kernel"
kern.cam.ctl.ha_id=0
loader_logo="TrueNASCore"


Code:
# camcontrol negotiate da4 -v
Current parameters:
(pass4:mps0:0:14:0): transfer speed: 600.000MB/s
(pass4:mps0:0:14:0): tagged queueing: enabled
mps0: SIM/HBA version: 1
mps0: supports tag queue messages
mps0: supports SDTR message
mps0: supports 16 bit wide SCSI
mps0: does its own scanning
mps0: unmapped I/O supported
mps0: user has disabled initial BUS RESET or controller is in target/mixed mode
mps0: HBA engine count: 0
mps0: maximum target: 125
mps0: maximum LUN: 255
mps0: highest path ID in subsystem: 0
mps0: initiator ID: 126
mps0: SIM vendor: FreeBSD
mps0: HBA vendor: Avago Tech
mps0: HBA vendor ID: 0x0000
mps0: HBA device ID: 0x0000
mps0: HBA subvendor ID: 0x0000
mps0: HBA subdevice ID: 0x0000
mps0: bus ID: 0
mps0: base transfer speed: 150.000MB/sec
mps0: maximum transfer size: 131072 bytes


In fact, in TrueNAS 11.3 everything works fine without the loader option, i.e. with
Code:
mps0: maximum transfer size: 4722688 bytes
 
You must log in or register to reply here.

Similar threads

Alibuba
Uncorrectable I/O failure while resilvering
Replies
4
Views
1K
NugentS
NugentS
braiam
SAS2008 controller timeouts whenever performance is pushed (Sending abort to target X)
Replies
8
Views
573
braiam
braiam
K
SAS array is significantly slower than SATA on same hardware
Replies
2
Views
750
kristin
K
D0peX
Upgrading to 13 results in controller reinitialization
Replies
7
Views
816
mardel
M
K
Timeout errors when mving files to TrueNAS Server
Replies
9
Views
2K
Vlad_Chudo
V
Top