SOLVED ISCSI stopped working after upgrade to Cobia 23.10.1.3

[baas54]

Hi,

Upgraded my Truenas Scale to 23.10.1.3 (from 23.10.1).
After this ISCSI stopped working. Truenas reports this over and over again (as the system that uses its ISCSI share tries to (re)establish the session):

Code:

68811.009362] [0]: iscsi-scst: ***ERROR***: Connection 0000000063bc8353 with initiator iqn.1993-08.org.debian:01:67adb2853c2d unexpectedly closed!
[68811.015817] [37749]: scst: TM fn NEXUS_LOSS_SESS/6 (mcmd 0000000046dc79d6, initiator iqn.1993-08.org.debian:01:67adb2853c2d#10.1.254.1, target iqn.2005-10.org.freenas.ctl:lun0)
[68811.019804] [37517]: scst: TM fn 6 (mcmd 0000000046dc79d6) finished, status 0
[68811.021895] [37749]: iscsi-scst: Freeing conn 0000000063bc8353 (sess=0000000040fbe67b, 0x60600003d0200 0, initiator iqn.1993-08.org.debian:01:67adb2853c2d#10.1.254.1)
[68811.025274] [37749]: iscsi-scst: Freeing session 0000000040fbe67b (SID 60600003d0200)
[68812.011596] [37554]: scst: Using security group "security_group" for initiator "iqn.1993-08.org.debian:01:67adb2853c2d#10.1.254.1" (target iqn.2005-10.org.freenas.ctl:lun0)
[68812.017850] [37554]: iscsi-scst: Session 000000009f5aeebd created: target 0000000028e24592, tid 1, sid 0x70600003d0200, initiator iqn.1993-08.org.debian:01:67adb2853c2d#10.1.254.1
[68812.020805] [37554]: iscsi-scst: Negotiated parameters: InitialR2T No, ImmediateData Yes, MaxConnections 1, MaxRecvDataSegmentLength 1048576, MaxXmitDataSegmentLength 262144,
[68812.024416] [37554]: iscsi-scst:     MaxBurstLength 1048576, FirstBurstLength 65536, DefaultTime2Wait 0, DefaultTime2Retain 0,
[68812.026332] [37554]: iscsi-scst:     MaxOutstandingR2T 1, DataPDUInOrder Yes, DataSequenceInOrder Yes, ErrorRecoveryLevel 0,
[68812.028062] [37554]: iscsi-scst:     HeaderDigest None, DataDigest None, OFMarker No, IFMarker No, OFMarkInt 2048, IFMarkInt 2048, RDMAExtensions No
[68812.030113] [37554]: iscsi-scst: Target parameters set for session 70600003d0200: QueuedCommands 32, Response timeout 90, Nop-In interval 30, Nop-In timeout 30
[68812.033484] [37554]: iscsi-scst: Creating connection 00000000dc514558 for sid 0x70600003d0200, cid 0 (initiator iqn.1993-08.org.debian:01:67adb2853c2d#10.1.254.1)

Booted the previous version: no change.

I also have a minmal test system that works correctly on both versions.
Something went wrong during upgrade and it look like i cannot clear this condition by removing all the iscsi shares completely and redefining them. The error stays.

How do I completely remove all ISCSI configurations fromt the system to start witha clean slate?
Do I need to reinstall the system from scratch? Is there a tried procedure for this?

 

[baas54]

Problem solved.
My confusion was completely created by me. And the result of doing two changes on the same day.
I upgraded to Cobia 23.10.1.3, but also changed a configuration in the network. The adapters on both sides of the ISCSI connection had an MTU of 9000, but a switch in the middle was still using 1500 as the MTU, hence coneection problems.