Very slow performance after upgrading to 9.2.1.7

[onthax]

I've just upgraded from 8.2.x to 9.2.1.7 and am now having massive performance issues.

8GB Ram HP N40 microserver

previously 4 5400rpm drives in raid 10.

changed to 4 5400 rpm drives in raid z (ashift is 12)

however getting it at 30MB/s over ssh/rsync then slowing to 300-500kbps

Also find the same thing locally in shell and web interface, the system will freeze/run very very slowly then unfreeze and respond normally.

I've checked top and when this happens CPU usage drops to nothing and swap is still sitting untouched so there is no cpu or memory contention.

i have run dd and get 100MBps running dd if=/dev/zero of=tmp.dat bs=2048k count=50k with compression off.

tried with compression on (lz4) and off

Any ideas?

 

[dlavigne]

Which NIC driver (from ifconfig)?

 

[onthax]

em0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 150 0
options=42098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,VLAN_HWTSO>
ether 68:05:ca:10:be:e7
inet 192.168.30.150 netmask 0xffffff00 broadcast 192.168.30.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active

i've got 3 seperate NICs in there only 1 of which is plugged in (not in a team) i will try one of the others, thanks for the thought

 

[onthax]

tried with the other nics

bge0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=c0099<RXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,VLAN_HWTSO,LINKSTATE>
ether a0:b3:cc:e3:f5:e7
inet 192.168.30.142 netmask 0xffffff00 broadcast 192.168.30.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active

Same issue experienced.

 

[onthax]

example copy over ssh using rsync.

1073739776 100% 34.08MB/s 0:00:30 (xfer#5442, to-check=1009/22517)
archive/Music DVD/Ministry Of Sound - Pump It Up Workout MUSIC DVD/VIDEO_TS/VTS_01_2.VOB
1073739776 100% 36.20MB/s 0:00:28 (xfer#5443, to-check=1008/22517)
archive/Music DVD/Ministry Of Sound - Pump It Up Workout MUSIC DVD/VIDEO_TS/VTS_01_3.VOB
1073739776 100% 2.00MB/s 0:08:32 (xfer#5444, to-check=1007/22517)
archive/Music DVD/Ministry Of Sound - Pump It Up Workout MUSIC DVD/VIDEO_TS/VTS_01_4.VOB
1073739776 100% 1.97MB/s 0:08:39 (xfer#5445, to-check=1006/22517)
archive/Music DVD/Ministry Of Sound - Pump It Up Workout MUSIC DVD/VIDEO_TS/VTS_01_5.VOB
110624768 50% 562.51kB/s 0:03:15

 

[onthax]

strangely enough when i started a scrub the transfer speeds were largely unaffected.

 

[onthax]

discovered the issue, had a dodgy drive, replaced it, speeds working great now!

 

[jgreco]

Good job. ;-)