Perf results of different SLOGs on ESXi

[cryptyk]

Hi all,
I thought I'd share these DD perf stats. They're not big enough or controlled enough to be considered definitive, but I thought I'd share anyway to give some directional numbers to the community.

Here is the test machine
- Supermicro x9drd-jbod
- 2x Xeon CPUs with 12 cores each
- 92GB RAM
- 12x 3TB WD Re drives
- 1 Corsair F120 SSD for the ESXI and FreeNas images
- 1 SLOG drive as described below. This is the variable I changed for each test.
- Awesome find on Ebay. Fully loaded with disks and almost brand new. $1,600

Here are the four disks
No SLOG. ZIL lives on the spinners inside the ZFS storage array.
$Free

SanDisk Extreme PRO 240GB SATA 6.0Gb/s 2.5-Inch 7mm Height Solid State Drive (SSD) with 10-Year Warranty- SDSSDXPS-240G-G25
$117 on Amazon

Intel (DC S3700) 2.5-Inch 200 GB Internal Solid State Drive SSDSC2BA200G301
$180 on Amazon

STEC S840Z16S2 16GB 2.5" SAS SSD s840Z ZIL NEX00-02054-SI3BCCTU
$84 used on Ebay

Here are the tests

--- No SLOG ---
No SLOG in the NFS mount of the FreeNas shared folder.
dd if=/dev/zero of=./testfile bs=4M count=1000
4194304000 bytes (4.2 GB, 3.9 GiB) copied, 252.601 s, 16.6 MB/s

No SLOG in home folder of Linux VM running on FreeNas NFS storage.
No Test Results. I forgot to run this one :( From memory, I think it was around 6 MB/s

--- SanDisk ---
SanDisk in NFS mount of FreeNas shared folder.
dd if=/dev/zero of=./testfile bs=4M count=3000
12582912000 bytes (13 GB, 12 GiB) copied, 112.686 s, 112 MB/s

SanDisk in home folder of Linux VM running on FreeNas NFS storage.
dd if=/dev/zero of=./testfile bs=4M count=2000
8388608000 bytes (8.4 GB, 7.8 GiB) copied, 160.984 s, 52.1 MB/s

--- Intel S3700 ---
Intel in NFS mount of FreeNas shared folder.
dd if=/dev/zero of=./testfile bs=4M count=3000
12582912000 bytes (13 GB, 12 GiB) copied, 87.5764 s, 144 MB/s

Intel in home folder of Linux VM running on FreeNas NFS storage.
dd if=/dev/zero of=./testfile bs=4M count=2000
8388608000 bytes (8.4 GB, 7.8 GiB) copied, 59.6797 s, 141 MB/s

--- Stec RAM ---
Stec RAM in NFS mount of FreeNas shared folder.
dd if=/dev/zero of=./testfile bs=4M count=3000
12582912000 bytes (13 GB, 12 GiB) copied, 83.149 s, 151 MB/s

Stec RAM in home folder of Linux VM running on FreeNas NFS storage.
dd if=/dev/zero of=./testfile bs=4M count=2000
8388608000 bytes (8.4 GB, 7.8 GiB) copied, 46.7727 s, 179 MB/s


----------
Finally, just for kicks, here's a test of when I ssh into the FreeNas box and run the test in the storage array directly, without ESXI getting in the way:
dd if=/dev/zero of=./testfile bs=4M count=10000
41943040000 bytes transferred in 13.056244 secs (3212489008 bytes/sec) 3.2 GB/s