Poor performance with 2TB/4k HDDs and Raid-Z

[Tekkie]

CPU: AMD Athlon II X3 (unlocked to x4) 415e
RAM: 8GB RAM
Mainboard: ASUS M4A78LT-M LE

Top reports CPU usage at 13-15% of a single core for the workload

 

[Bohs Hansen]

I had exactly same problem when I upgraded from 8.0 -> 8.0.1-beta initially. I thought it had to do with me setting the swap partition to be 1GB per drive on new volumes, but I can't reproduce this problem anymore.

You may want to try to clear your browser cache, or do another reboot or so?

lol, i feel so stupid - ofcourse it was the browser cache... *hits himself with a shovel"

 

[marcusmarcus]

I did not test this when I was on 8.0 Release and I never tried under i386 install, but here is my results of the following on amd64 build

Code:

Write: dd if=/dev/zero of=/mnt/Volume1/ddtest bs=1024k count=20000
Read: dd if=/mnt/Volume1/ddtest of=/dev/zero bs=1024k count=20000

Beta1
512b sector size
Write: 155MBps
Read: 100MBps

Beta2 came out before I tried 4k drive so did not test that

Beta2
512b sector size
Write: 163MBps
Read: 100MBps

4k sector size
Write: 166MBps
Read: 105MBps

Not a huge difference but I'll take every bit of speed I can get.

 

[jfr2006]

Here are my results:

Code:

Write: dd if=/dev/zero of=/mnt/volume1/ddtest bs=1024k count=20000
Read: dd if=/mnt/volume1/ddtest of=/dev/zero bs=1024k count=20000

Using my compiled version of freenas (FreeNAS-8r6613M-amd64), with 4K sectors:

Write: 320MB/s :D
Read: 752MB/s :D

 

[marcusmarcus]

Write: 320MB/s :D
Read: 752MB/s :D

What are your system specs?

 

[jfr2006]

Let's see if this work...Yaps..it worked.. see my signature ;)

 

[golemcito]

Let's see if this work...Yaps..it worked.. see my signature ;)

And what about your CIFS specs?

 

[jfr2006]

I get around 80~90MB/s reading and 70MB/s writing ;)

 

[HolyK]

Thanks for all of the information!

BTW: I think, you have a typo in your signature ... it should be ASUS E35M1-M , not ASUS EM35M1-M ;)

 

[sjieke]

Beta2
512b sector size
Write: 163MBps
Read: 100MBps

4k sector size
Write: 166MBps
Read: 105MBps

I ordered the exact same components as in your signature to build my first NAS.
Motherboard: GIGABYTE GA-D525TUD
CPU: Intel Atom D525 1.8Ghz
RAM: 4GB (2x2GB DDR3 1333)
Storage Drives: 4x 2TB Samsung Spinpoint drives
LAN Chipset: Realtek 8111E

Still waiting on the delivery. Did you do some ZFS tuning, or are these results with all settings left to defaults. As those speeds will be able to saturate a Gbit network. If I have my NAS build I will post my results.

 

[golemcito]

I get around 80~90MB/s reading and 70MB/s writing ;)

Great numbers What did you do?

 

[marcusmarcus]

I ordered the exact same components as in your signature to build my first NAS.
Motherboard: GIGABYTE GA-D525TUD
CPU: Intel Atom D525 1.8Ghz
RAM: 4GB (2x2GB DDR3 1333)
Storage Drives: 4x 2TB Samsung Spinpoint drives
LAN Chipset: Realtek 8111E

Still waiting on the delivery. Did you do some ZFS tuning, or are these results with all settings left to defaults. As those speeds will be able to saturate a Gbit network. If I have my NAS build I will post my results.

I left it at the defaults right now.

 

[Bohs Hansen]

bit offtopic, but close enough I think. What must I change the path of the speed test to, to test my bootdrive. Wondering how fast that ssd is. I'm not that familiar with the NIX system structure yet

 

[geordie2011]

if i use the beta2 release to take advantage of 4k will i not need to redo the volume again once the stable release comes out as its taken a lifetime to back things up thanks

 

[Milhouse]

if i use the beta2 release to take advantage of 4k will i not need to redo the volume again once the stable release comes out as its taken a lifetime to back things up thanks

No, you should be able to upgrade from beta2 to beta3 and finally the stable release while keeping your current volume intact.

 

[geordie2011]

thanks very much! i have created the vol and have created two seperate datasets one called MyMovies and one called MyTVSeries, with each share mapped accordingly is that the best way to do it? what is zvol for? thanks

 

[jfr2006]

Thanks for all of the information!

BTW: I think, you have a typo in your signature ... it should be ASUS E35M1-M , not ASUS EM35M1-M ;)

You are right. Thanks.. I did have the feeling there was one more "M" letter than it should be, but i could not find it ;)

I think that 8GB of RAM really help a lot ;)

Now i have a problem with one of the discs..bad sectors :(

 

[Bohs Hansen]

ok, I'm getting confused. Last time I tested i got around 250mb/s. now I get the same on read but only 60 on write. Any idea what could cause this or how I can debug it further?

Code:

freenas# dd if=/dev/zero of=/mnt/jcube1/ddtest bs=1024k count=20000
20000+0 records in
20000+0 records out
20971520000 bytes transferred in 337.632268 secs (62113494 bytes/sec)
freenas# dd of=/dev/zero if=/mnt/jcube1/ddtest bs=1024k count=20000
20000+0 records in
20000+0 records out
20971520000 bytes transferred in 82.097577 secs (255446272 bytes/sec)
freenas# dd if=/dev/zero of=/mnt/jcube1/ddtest bs=1024k count=20000
20000+0 records in
20000+0 records out
20971520000 bytes transferred in 344.034804 secs (60957554 bytes/sec)

 

[Milhouse]

Just for reference, these are the results for a zpool created under 8.0.1-BETA2 with two stacked vdevs (4x2TB RAIDZ1/4K Sectors + 4x500GB RAIDZ1/4K Sectors) using an LSI 9211-8i controller (IT firmware) with zfs.prefetch enabled:

Code:

freenas# dd if=/dev/zero of=/mnt/share/ddfile bs=1M count=10000
10000+0 records in
10000+0 records out
10485760000 bytes transferred in 41.732805 secs (251259411 bytes/sec)
freenas# dd of=/dev/null if=/mnt/share/ddfile bs=1M count=10000
10000+0 records in
10000+0 records out
10485760000 bytes transferred in 32.062324 secs (327043042 bytes/sec)
freenas#

WRITE: 251MB/s
READ: 327MB/s

The 2TB disks are Samsung HD204UI (3.5") and the 500GB are Samsung HM500JI (2.5"), the server (HP N36L) has 4GB RAM.

 

[golemcito]

Just for reference, these are the results for a zpool created under 8.0.1-BETA2 with two stacked vdevs (4x2TB RAIDZ1/4K Sectors + 4x500GB RAIDZ1/4K Sectors) using an LSI 9211-8i controller (IT firmware) with zfs.prefetch:

Code:

freenas# dd if=/dev/zero of=/mnt/share/ddfile bs=1M count=10000
10000+0 records in
10000+0 records out
10485760000 bytes transferred in 41.732805 secs (251259411 bytes/sec)
freenas# dd of=/dev/null if=/mnt/share/ddfile bs=1M count=10000
10000+0 records in
10000+0 records out
10485760000 bytes transferred in 32.062324 secs (327043042 bytes/sec)
freenas#

WRITE: 251MB/s
READ: 327MB/s

The 2TB disks are Samsung HD204UI (3.5") and the 500GB are Samsung HM500JI (2.5"), the server (HP N36L) has 4GB RAM.

Interesting machine the microserver...And what about the CIFS tranfers?