iSCSI errors - poor performnce...

[atakacs]

iSCSI errors - poor performance...

Hi

I have finally managed to publish my FreeNAS as a iSCSI target to my Windows 2008 server.

Things seemed to work as expected but once I tried to put some load on the system I am seeing very poor performance (about 20Mb/s sustained write) and, more worrying, lot of errors being reported both in the windows event log

Code:

Log Name:      System
Source:        iScsiPrt
Date:          2012-04-25 01:27:41
Event ID:      9
Task Category: None
Level:         Error
Keywords:      Classic
User:          N/A
Computer:      myserver.domain.local
Description:
Target did not respond in time for a SCSI request. The CDB is given in the dump data.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
  <System>
    <Provider Name="iScsiPrt" />
    <EventID Qualifiers="49152">9</EventID>
    <Level>2</Level>
    <Task>0</Task>
    <Keywords>0x80000000000000</Keywords>
    <TimeCreated SystemTime="2012-04-24T23:27:41.528174200Z" />
    <EventRecordID>28344</EventRecordID>
    <Channel>System</Channel>
    <Computer>myserver.domain.local</Computer>
    <Security />
  </System>
  <EventData>
    <Data>\Device\RaidPort1</Data>
    <Binary>000054000100000000000000090000C00000000000000000000000000000000000000000000000002A00009E552000020000690071006E002E0032003000310031002D00300033002E006500780061006D0070006C0065002E006F00720067002E00690073007400670074003A0066007200650065006E0061007300</Binary>
  </EventData>
</Event>

and the Freenas log

Code:

Apr 25 01:28:07 freenas istgt[2249]: istgt_lu_disk.c:5209:istgt_lu_disk_queue_start: ***WARNING*** transfer abort CmdSN=42996
Apr 25 01:28:07 freenas istgt[2249]: istgt_lu.c:2865:luworker: ***WARNING*** LU1: lu_disk_queue_start() aborted
Apr 25 01:28:43 freenas istgt[2249]: istgt_iscsi.c: 777:istgt_iscsi_write_pdu_internal: ***ERROR*** iscsi_write() failed (errno=32)
Apr 25 01:28:43 freenas istgt[2249]: istgt_iscsi.c:3518:istgt_iscsi_task_response: ***ERROR*** iscsi_write_pdu() failed
Apr 25 01:28:43 freenas istgt[2249]: istgt_iscsi.c:4967:sender: ***ERROR*** iscsi_task_response() failed on iqn.2011-03.example.org.istgt:freenas,t,0x0001(iqn.1991-05.com.microsoft:myserver.domain.local,i,0x400001370001)
Apr 25 01:28:43 freenas istgt[2249]: istgt_iscsi.c: 777:istgt_iscsi_write_pdu_internal: ***ERROR*** iscsi_write() failed (errno=32)
Apr 25 01:28:43 freenas istgt[2249]: istgt_iscsi.c:4984:sender: ***ERROR*** iscsi_write_pdu() failed on iqn.2011-03.example.org.istgt:freenas,t,0x0001(iqn.1991-05.com.microsoft:myserver.domain.local,i,0x400001370001)
Apr 25 01:28:43 freenas istgt[2249]: Login from iqn.1991-05.com.microsoft:myserver.domain.local (172.16.100.5) on iqn.2011-03.example.org.istgt:freenas LU1 (172.16.100.10:3260,1), ISID=400001370001, TSIH=4, CID=1, HeaderDigest=off, DataDigest=off
Apr 25 01:34:53 freenas istgt[2249]: Configuration refresh requested from 172.16.100.10

Anything I can do about it !?

Thanks

 

[wbrco]

If you see my post re: Windows Server and iSCSI, you might check the partitioning of the target.

While not in a true loaded production environment, I have good performance from the iSCSI target. Note however, that
my target is a striped SAS array, not a SATA drive, and both systems are on a dedicated iSCSI vlan supporting Jumbo frames. I use a separate nic for my management address. Make sure your NIC are fixed both in the switch and in the system for speed and duplex on both machines. I've seen my share of problems in this area (big time on HP 530 Access Points).

I am running ZFS on a 32 bit machine, and I did have some bugs, but they seem to have worked themselves out.

Are you using a file extent or a device extent? And confirm all your targets/access/Chap is set right (doubt it's chap, or you wouldn't be this far).

Post some screen shots of your config.

 

[atakacs]

Thanks for your input.

If you see my post re: Windows Server and iSCSI, you might check the partitioning of the target.

Will have a look to your post. Using only one partition on the target.

While not in a true loaded production environment, I have good performance from the iSCSI target. Note however, that
my target is a striped SAS array, not a SATA drive, and both systems are on a dedicated iSCSI vlan supporting Jumbo frames. I use a separate nic for my management address. Make sure your NIC are fixed both in the switch and in the system for speed and duplex on both machines. I've seen my share of problems in this area (big time on HP 530 Access Points).

Ok maybe I should have mentioned that I am running an all virtual (vmware) shop here. So the FreenNAS and Windows 2008 are on the same host, linked by a virtual internal "host only" NIC. The idea is to fully virtualize the storage an be able to eventually deploy it using different underlying hardware. The hard disks are local SATA disks on the host presented to the Freenas a two independent disks, with a RAID-1 ZFS mirrored volume.

[/QUOTE]I am running ZFS on a 32 bit machine, and I did have some bugs, but they seem to have worked themselves out.[/QUOTE]

Running 64bits with 4Gb RAM allocated.

Are you using a file extent or a device extent? And confirm all your targets/access/Chap is set right (doubt it's chap, or you wouldn't be this far).

Using file extents - no authentication.