T7500 - My god-awful machine...

[Stux]

It may have impacted the performance you saw. Which is the point right?

 

[Stux]

I suggest running solnet array tester across all your drives simultaneously.

It’s a read only test, so is safe.

https://forums.freenas.org/index.php?resources/solnet-array-test.1/


Possible your controllers have good single disk perf but bad multi-disk perf

 

[Robert Thomspon]

It may have impacted the performance you saw. Which is the point right?

So... you suggest:

Write: dd if=/dev/null of=./testfile bs=1M count=100k
Read: dd if=./testfile of=/dev/zero bs=1M count 100k

???

 

[Robert Thomspon]

I believe I ran the solnet array test (as, iirc Chris Moore suggested using it) but didn't finish it... I sort of think we had a pole hit in the area that took out power longer than my 2 UPSs were capable of powering the machine (I think it was about 3 hours we were out of power) and, iirc, I forgot to rerun the test...

I will do so tonight and let it run over the weekend. I will report back the results.

 

[Robert Thomspon]

Initial results lead me to believe it's not my read/write speeds...

Code:

root@freenas:/mnt/Storage # ./solnet.sh

sol.net disk array test v2


1) Use all disks (from camcontrol)

2) Use selected disks (from camcontrol|grep)

3) Specify disks

4) Show camcontrol list


Option: 2


Enter grep match pattern (e.g. ST150176): ST


Selected disks: da0 da1 da2 da3 da4 da5 

<ATA ST5000DM000-1FK1 CC49>		at scbus0 target 5 lun 0 (pass0,da0)

<ATA ST6000DM003-2CY1 0001>		at scbus0 target 6 lun 0 (pass1,da1)

<ATA ST5000DM000-1FK1 CC49>		at scbus0 target 7 lun 0 (pass2,da2)

<ATA ST5000DM000-1FK1 CC49>		at scbus0 target 8 lun 0 (pass3,da3)

<ATA ST6000DM003-2CY1 0001>		at scbus0 target 9 lun 0 (pass4,da4)

<ATA ST5000DM003-2FH1 0001>		at scbus0 target 10 lun 0 (pass5,da5)

Is this correct? (y/N): y

Performing initial serial array read (baseline speeds)

Thu Mar 22 19:50:38 EDT 2018

Thu Mar 22 20:04:09 EDT 2018				

Completed: initial serial array read (baseline speeds)


Array's average speed is 174.388 MB/sec per disk


Disk	Disk Size  MB/sec %ofAvg

------- ---------- ------ ------

da0	  4769307MB	183	105

da1	  5723166MB	174	100

da2	  4769307MB	180	103

da3	  4769307MB	166	 95

da4	  5723166MB	170	 98

da5	  4769307MB	173	 99


Performing initial parallel array read

Thu Mar 22 20:04:09 EDT 2018

The disk da0 appears to be 4769307 MB.		

Disk is reading at about 173 MB/sec		 

This suggests that this pass may take around 461 minutes

										   

				  Serial Parall % of

Disk	Disk Size  MB/sec MB/sec Serial

------- ---------- ------ ------ ------

da0	  4769307MB	183	182	100

da1	  5723166MB	174	174	100

da2	  4769307MB	180	178	 99

da3	  4769307MB	166	170	102

da4	  5723166MB	170	172	101

da5	  4769307MB	173	174	101


Awaiting completion: initial parallel array read

 

[wblock]

For a simple, best-case, read-only test: diskinfo -tv da0

diskinfo appears to now have write tests (see diskinfo(8)), but I have not tried them.