Hello,
We have been trying to use FreeNAS in our ESX environments for Veeam, VCB, etc... We also run some of our junk IT utility server VM's directly on those LUNs as well.
The problem we have been experiencing is the ESX hosts are experiencing hangs with iscsi software service. All the symptoms and logs seem to be pointing to other articles that claim ESX issues because FreeNAS uses IET style iscsi.
Not being an expert in this area I have to ask if there is a way to change the FreeNAS side to use SCST instead of IET.
In our environment, the ESX clusters all attach to the shared volumes/luns so that we have all of the capabilities of VM migration, clustering, fail-over, etc. It appears that when these seizures occur, one host eventually locks the VMFS volume and the rest in the cluster cannot access it and of course we all know how vmware reacts when it loses access to a disk... it's not pretty. So at that point, one ESX server in the cluster is happy and running fine while the rest go into a non-responsive state. Any input would really help me out here.
Below are a few excerpt lines from the ESX host logs, FreeNAS has no idea anything is even wrong so all looks normal on that side.
Apr 3 15:35:05 vmkernel: 3:08:46:24.692 cpu0:727982)NMP: nmp_CompleteCommandForPath: Command 0x16 (0x41027fa54440) to NMP device "t10.FreeBSD_iSCSI_Disk______003048c9f2Ddcnvtd0_______________" failed on physical path "vmhba35:C0:T3:L0" H:0x5 D:0x0 P
Apr 3 15:35:05 :0x0 Possible sense data: 0x0
Apr 3 15:35:05 vmkernel: 3:08:46:24.692 cpu0:727982)NMP: nmp_PathDetermineFailure: SCSI cmd RESERVE failed on path vmhba35:C0:T3:L0, reservation state on device t10.FreeBSD_iSCSI_Disk______003048c9f2Ddcnvtd0_______________ is unknown.
Apr 3 15:35:05 vmkernel: 3:08:46:24.692 cpu0:727982)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe: NMP device "t10.FreeBSD_iSCSI_Disk______003048c9f2Ddcnvtd0_______________" state in doubt; requested fast path state update...
Apr 3 15:35:05 vmkernel: 3:08:46:24.692 cpu0:727982)ScsiDeviceIO: 1672: Command 0x16 to device "t10.FreeBSD_iSCSI_Disk______003048c9f2Ddcnvtd0_______________" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Apr 3 15:35:05 vmkernel: 3:08:46:24.692 cpu5:4134)WARNING: FS3: 7096: Reservation error: Timeout
We have been trying to use FreeNAS in our ESX environments for Veeam, VCB, etc... We also run some of our junk IT utility server VM's directly on those LUNs as well.
The problem we have been experiencing is the ESX hosts are experiencing hangs with iscsi software service. All the symptoms and logs seem to be pointing to other articles that claim ESX issues because FreeNAS uses IET style iscsi.
Not being an expert in this area I have to ask if there is a way to change the FreeNAS side to use SCST instead of IET.
In our environment, the ESX clusters all attach to the shared volumes/luns so that we have all of the capabilities of VM migration, clustering, fail-over, etc. It appears that when these seizures occur, one host eventually locks the VMFS volume and the rest in the cluster cannot access it and of course we all know how vmware reacts when it loses access to a disk... it's not pretty. So at that point, one ESX server in the cluster is happy and running fine while the rest go into a non-responsive state. Any input would really help me out here.
Below are a few excerpt lines from the ESX host logs, FreeNAS has no idea anything is even wrong so all looks normal on that side.
Apr 3 15:35:05 vmkernel: 3:08:46:24.692 cpu0:727982)NMP: nmp_CompleteCommandForPath: Command 0x16 (0x41027fa54440) to NMP device "t10.FreeBSD_iSCSI_Disk______003048c9f2Ddcnvtd0_______________" failed on physical path "vmhba35:C0:T3:L0" H:0x5 D:0x0 P
Apr 3 15:35:05 :0x0 Possible sense data: 0x0
Apr 3 15:35:05 vmkernel: 3:08:46:24.692 cpu0:727982)NMP: nmp_PathDetermineFailure: SCSI cmd RESERVE failed on path vmhba35:C0:T3:L0, reservation state on device t10.FreeBSD_iSCSI_Disk______003048c9f2Ddcnvtd0_______________ is unknown.
Apr 3 15:35:05 vmkernel: 3:08:46:24.692 cpu0:727982)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe: NMP device "t10.FreeBSD_iSCSI_Disk______003048c9f2Ddcnvtd0_______________" state in doubt; requested fast path state update...
Apr 3 15:35:05 vmkernel: 3:08:46:24.692 cpu0:727982)ScsiDeviceIO: 1672: Command 0x16 to device "t10.FreeBSD_iSCSI_Disk______003048c9f2Ddcnvtd0_______________" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Apr 3 15:35:05 vmkernel: 3:08:46:24.692 cpu5:4134)WARNING: FS3: 7096: Reservation error: Timeout
