VERY slow performance with disk.

[Chris Bayne]

This is a Supermicro server with an Intel Raid controller. It has 32GB RAM it is quad-core Xeon. One user me :) but when I do stuff like copy files, remove files it is insanely slow. A rm -R -v for files takes forever. When I copy files to it it goes 100 MB a second then slows to 20 then stalls some time times out but a retry works and it goes back to 100 plus for a couple seconds and starts dropping. I don't think it is a network issue since local commands have the same issue. This box was running windows for years at full speed. What logs can I post to get some help?

 

[Chris Moore]

This is a Supermicro server with an Intel Raid controller.

Please share hardware details as explained here:
Updated Forum Rules 12/5/18
https://forums.freenas.org/index.php?threads/updated-forum-rules-12-5-18.45124/

When I copy files to it it goes 100 MB a second then slows to 20 then stalls some time times out but a retry works and it goes back to 100 plus for a couple seconds and starts dropping.

This type of thing is most often related to hardware.

 

[Chris Bayne]

root@freenas[/mnt/RaidDisk/Backup/S_Drive/backup3]# pciconf -lv
hostb0@pci0:0:0:0: class=0x060000 card=0x00008086 chip=0xd1308086 rev=0x11 hdr=0x00
vendor = 'Intel Corporation'
device = 'Core Processor DMI'
class = bridge
subclass = HOST-PCI
pcib1@pci0:0:3:0: class=0x060400 card=0x00008086 chip=0xd1388086 rev=0x11 hdr=0x01
vendor = 'Intel Corporation'
device = 'Core Processor PCI Express Root Port 1'
class = bridge
subclass = PCI-PCI
none0@pci0:0:8:0: class=0x088000 card=0x00f20086 chip=0xd1558086 rev=0x11 hdr=0x00
vendor = 'Intel Corporation'
device = 'Core Processor System Management Registers'
class = base peripheral
none1@pci0:0:8:1: class=0x088000 card=0x00f20086 chip=0xd1568086 rev=0x11 hdr=0x00
vendor = 'Intel Corporation'
device = 'Core Processor Semaphore and Scratchpad Registers'
class = base peripheral
none2@pci0:0:8:2: class=0x088000 card=0x00f20086 chip=0xd1578086 rev=0x11 hdr=0x00
vendor = 'Intel Corporation'
device = 'Core Processor System Control and Status Registers'
class = base peripheral
none3@pci0:0:8:3: class=0x088000 card=0x00f20086 chip=0xd1588086 rev=0x11 hdr=0x00
vendor = 'Intel Corporation'
device = 'Core Processor Miscellaneous Registers'
class = base peripheral
none4@pci0:0:16:0: class=0x088000 card=0x00f20086 chip=0xd1508086 rev=0x11 hdr=0x00
vendor = 'Intel Corporation'
device = 'Core Processor QPI Link'
class = base peripheral
none5@pci0:0:16:1: class=0x088000 card=0x00f20086 chip=0xd1518086 rev=0x11 hdr=0x00
vendor = 'Intel Corporation'
device = 'Core Processor QPI Routing and Protocol Registers'
class = base peripheral
ehci0@pci0:0:26:0: class=0x0c0320 card=0x34f28086 chip=0x3b3c8086 rev=0x05 hdr=0x00
vendor = 'Intel Corporation'
device = '5 Series/3400 Series Chipset USB2 Enhanced Host Controller'
class = serial bus
subclass = USB
pcib7@pci0:0:28:0: class=0x060400 card=0x34f28086 chip=0x3b428086 rev=0x05 hdr=0x01
vendor = 'Intel Corporation'
device = '5 Series/3400 Series Chipset PCI Express Root Port 1'
class = bridge
subclass = PCI-PCI
pcib8@pci0:0:28:4: class=0x060400 card=0x34f28086 chip=0x3b4a8086 rev=0x05 hdr=0x01
vendor = 'Intel Corporation'
device = '5 Series/3400 Series Chipset PCI Express Root Port 5'
class = bridge
subclass = PCI-PCI
pcib9@pci0:0:28:6: class=0x060400 card=0x34f28086 chip=0x3b4e8086 rev=0x05 hdr=0x01
vendor = 'Intel Corporation'
device = '5 Series/3400 Series Chipset PCI Express Root Port 7'
class = bridge
subclass = PCI-PCI
ehci1@pci0:0:29:0: class=0x0c0320 card=0x34f28086 chip=0x3b348086 rev=0x05 hdr=0x00
vendor = 'Intel Corporation'
device = '5 Series/3400 Series Chipset USB2 Enhanced Host Controller'
class = serial bus
subclass = USB
pcib10@pci0:0:30:0: class=0x060401 card=0x34f28086 chip=0x244e8086 rev=0xa5 hdr=0x01
vendor = 'Intel Corporation'
device = '82801 PCI Bridge'
class = bridge
subclass = PCI-PCI
isab0@pci0:0:31:0: class=0x060100 card=0x34f28086 chip=0x3b148086 rev=0x05 hdr=0x00
vendor = 'Intel Corporation'
device = '3420 Chipset LPC Interface Controller'
class = bridge
subclass = PCI-ISA
ahci0@pci0:0:31:2: class=0x010601 card=0x34f28086 chip=0x3b228086 rev=0x05 hdr=0x00
vendor = 'Intel Corporation'
device = '5 Series/3400 Series Chipset 6 port SATA AHCI Controller'
class = mass storage
subclass = SATA
none6@pci0:0:31:3: class=0x0c0500 card=0x34f28086 chip=0x3b308086 rev=0x05 hdr=0x00
vendor = 'Intel Corporation'
device = '5 Series/3400 Series Chipset SMBus Controller'
class = serial bus
subclass = SMBus
pcib2@pci0:1:0:0: class=0x060400 card=0x00000000 chip=0x806f111d rev=0x02 hdr=0x01
vendor = 'Integrated Device Technology, Inc. [IDT]'
device = 'HIO524G2 PCI Express Gen2 Switch'
class = bridge
subclass = PCI-PCI
pcib3@pci0:2:2:0: class=0x060400 card=0x00000000 chip=0x806f111d rev=0x02 hdr=0x01
vendor = 'Integrated Device Technology, Inc. [IDT]'
device = 'HIO524G2 PCI Express Gen2 Switch'
class = bridge
subclass = PCI-PCI
pcib4@pci0:2:3:0: class=0x060400 card=0x00000000 chip=0x806f111d rev=0x02 hdr=0x01
vendor = 'Integrated Device Technology, Inc. [IDT]'
device = 'HIO524G2 PCI Express Gen2 Switch'
class = bridge
subclass = PCI-PCI
pcib5@pci0:2:4:0: class=0x060400 card=0x00000000 chip=0x806f111d rev=0x02 hdr=0x01
vendor = 'Integrated Device Technology, Inc. [IDT]'
device = 'HIO524G2 PCI Express Gen2 Switch'
class = bridge
subclass = PCI-PCI
pcib6@pci0:2:5:0: class=0x060400 card=0x00000000 chip=0x806f111d rev=0x02 hdr=0x01
vendor = 'Integrated Device Technology, Inc. [IDT]'
device = 'HIO524G2 PCI Express Gen2 Switch'
class = bridge
subclass = PCI-PCI
igb0@pci0:3:0:0: class=0x020000 card=0x34f28086 chip=0x10c98086 rev=0x01 hdr=0x00
vendor = 'Intel Corporation'
device = '82576 Gigabit Network Connection'
class = network
subclass = ethernet
igb1@pci0:3:0:1: class=0x020000 card=0x34f28086 chip=0x10c98086 rev=0x01 hdr=0x00
vendor = 'Intel Corporation'
device = '82576 Gigabit Network Connection'
class = network
subclass = ethernet
igb2@pci0:6:0:0: class=0x020000 card=0x34f28086 chip=0x10c98086 rev=0x01 hdr=0x00
vendor = 'Intel Corporation'
device = '82576 Gigabit Network Connection'
class = network
subclass = ethernet
igb3@pci0:6:0:1: class=0x020000 card=0x34f28086 chip=0x10c98086 rev=0x01 hdr=0x00
vendor = 'Intel Corporation'
device = '82576 Gigabit Network Connection'
class = network
subclass = ethernet
mfi0@pci0:11:0:0: class=0x010400 card=0x35088086 chip=0x00601000 rev=0x04 hdr=0x00
vendor = 'LSI Logic / Symbios Logic'
device = 'MegaRAID SAS 1078'
class = mass storage
subclass = RAID
em0@pci0:12:0:0: class=0x020000 card=0x34f28086 chip=0x10d38086 rev=0x00 hdr=0x00
vendor = 'Intel Corporation'
device = '82574L Gigabit Network Connection'
class = network
subclass = ethernet
vgapci0@pci0:13:0:0: class=0x030000 card=0x01018086 chip=0x0522102b rev=0x02 hdr=0x00
vendor = 'Matrox Electronics Systems Ltd.'
device = 'MGA G200e [Pilot] ServerEngines (SEP1)'
class = display
subclass = VGA


With 4 WD Red 2 TB drives in Hardware Raid5.
Also, It ran fine with Windows 2012 for years at about 125 MB a second transfers over the network.

 

[l@e]

With 4 WD Red 2 TB drives in Hardware Raid5

Are using raid 5 of the onboard intel controller?
And u build the pool over a single volume exported from intel?

 

[Chris Moore]

First thing to do, get any data you have in this system out to some backup location because you need to start over.

mfi0@pci0:11:0:0: class=0x010400 card=0x35088086 chip=0x00601000 rev=0x04 hdr=0x00
vendor = 'LSI Logic / Symbios Logic'
device = 'MegaRAID SAS 1078'
class = mass storage
subclass = RAID

This is NOT what I asked for. Did you see a list like this anywhere in the Forum Rules? Did you even read them?
If you expect to get help, you can follow the rules.

With 4 WD Red 2 TB drives in Hardware Raid5.

FreeNAS does not use hardware RAID controllers. You need to remove that and get a SAS HBA to control your drives.
Something like this:
https://www.ebay.com/itm/HP-H220-6G...9205-8i-P20-IT-Mode-From-US-Ship/192639052923

Also, It ran fine with Windows 2012 for years at about 125 MB a second transfers over the network.

You must also come to grips with the fact that FreeNAS is BSD Unix based, not Windows. Things like that hardware RAID controller that work fine in Windows will not work fine with FreeNAS.

 

[Chris Bayne]

Thank you for your reply. I found the problem it was the SSD Cache for the ZFS volume it was somehow slowing everything down removed the cache drives and now rocking the performance numbers I was expecting. Freenas can 100% use hardware raid LUN is a LUN to Linux. Sorry, I did not read the forum rules and if I post in the future I will.

Yes it is 1 6tb raid 5 exported from the raid card and that is the ZFS volume.

 

[Chris Moore]

Linux

FreeNAS is not Linux and ZFS is not a file system like any other. You are loosing most of the benefits of ZFS by giving it only one disk and relying on the underlying hardware RAID.

Why not to use RAID-5 or RAIDz1
https://www.zdnet.com/article/why-raid-5-stops-working-in-2009/

 

[SweetAndLow]

I smell a raid card came

Thank you for your reply. I found the problem it was the SSD Cache for the ZFS volume it was somehow slowing everything down removed the cache drives and now rocking the performance numbers I was expecting. Freenas can 100% use hardware raid LUN is a LUN to Linux. Sorry, I did not read the forum rules and if I post in the future I will.

Yes it is 1 6tb raid 5 exported from the raid card and that is the ZFS volume.

You will still have performance issues with a raid card and you will one day just magically lose all your data. Good luck

 

[l@e]

Yes it is 1 6tb raid 5 exported from the raid card and that is the ZFS volume.

you are totaly out of the purpose of zfs and fn.
in case of smth wrong with the array you will not get notified till everything stops.