Fast Write but slow Read

[Ryle]

Hello All

I seen that on my Freenas I get decent write speed but completely slow read one and can't find out why:

Code:

I:\iperf-3.1.3-win64\iperf-3.1.3-win64>iperf3.exe -c 192.168.1.200
Connecting to host 192.168.1.200, port 5201
[  4] local 192.168.1.100 port 58701 connected to 192.168.1.200 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  86.9 MBytes   729 Mbits/sec
[  4]   1.00-2.00   sec   113 MBytes   945 Mbits/sec
[  4]   2.00-3.00   sec   113 MBytes   948 Mbits/sec
[  4]   3.00-4.00   sec   113 MBytes   945 Mbits/sec
[  4]   4.00-5.00   sec   112 MBytes   941 Mbits/sec
[  4]   5.00-6.00   sec   112 MBytes   944 Mbits/sec
[  4]   6.00-7.00   sec   113 MBytes   948 Mbits/sec
[  4]   7.00-8.00   sec   113 MBytes   947 Mbits/sec
[  4]   8.00-9.00   sec   113 MBytes   946 Mbits/sec
[  4]   9.00-10.00  sec   113 MBytes   947 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  1.08 GBytes   924 Mbits/sec                  sender
[  4]   0.00-10.00  sec  1.08 GBytes   924 Mbits/sec                  receiver



I:\iperf-3.1.3-win64\iperf-3.1.3-win64>iperf3.exe -R -c 192.168.1.200
Connecting to host 192.168.1.200, port 5201
Reverse mode, remote host 192.168.1.200 is sending
[  4] local 192.168.1.100 port 58883 connected to 192.168.1.200 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  3.86 MBytes  32.4 Mbits/sec
[  4]   1.00-2.00   sec  5.01 MBytes  42.1 Mbits/sec
[  4]   2.00-3.00   sec  4.57 MBytes  38.3 Mbits/sec
[  4]   3.00-4.00   sec  4.01 MBytes  33.7 Mbits/sec
[  4]   4.00-5.00   sec  7.58 MBytes  63.6 Mbits/sec
[  4]   5.00-6.00   sec  5.32 MBytes  44.6 Mbits/sec
[  4]   6.00-6.50   sec  3.71 MBytes  62.9 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-6.50   sec  0.00 Bytes  0.00 bits/sec                  sender
[  4]   0.00-6.50   sec  34.1 MBytes  44.0 Mbits/sec                  receiver
iperf3: interrupt - the client has terminated

I already read this thread were issue seems to be the same:

SOLVED! Very Slow Disk Performance

Trying FreeNAS for first time. Built low end system (just a bit better hardware than low end Synology that can be a plex server) using ASRock J4105-ITX and 16G of ram. I have two 4TB HGSTs in a mirror with my Plex media dataset. I have a cheap WD SSD for my jails. Took a bit of study and...

www.ixsystems.com

But sadly I change cable and switch port but this does not help at all

I check also

SOLVED - Very slow 6 MB/sec read speeds vs 111 MB/sec writes on FreeNAS 11 stable

Hi team, new FreeNAS user (FreeNAS 11-Stable) on new hardware for video editing needs. I am migrating from an ancient Thecus NAS. While I wait for the new disk order to arrive, I have built the system but am using retired but error free 3x 1TB disks and 1 x 2TB disk to experiment with. I am...

www.ixsystems.com

check the SMART indicator but not sure how to interpret it:
I run
smartctl -t shot /dev/ada[0-3]
smartctl -a /dev/ada[0-3]

got a similar result on all drive

Code:

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   100   097   051    Pre-fail  Always       -       195
  2 Throughput_Performance  0x0026   252   252   000    Old_age   Always       -       0
  3 Spin_Up_Time            0x0023   067   064   025    Pre-fail  Always       -       10193
  4 Start_Stop_Count        0x0032   096   096   000    Old_age   Always       -       4276
  5 Reallocated_Sector_Ct   0x0033   252   252   010    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   252   252   051    Old_age   Always       -       0
  8 Seek_Time_Performance   0x0024   252   252   015    Old_age   Offline      -       0
  9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       40314
10 Spin_Retry_Count        0x0032   252   252   051    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       5
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       533
181 Program_Fail_Cnt_Total  0x0022   064   064   000    Old_age   Always       -       796968738
191 G-Sense_Error_Rate      0x0022   100   100   000    Old_age   Always       -       77
192 Power-Off_Retract_Count 0x0022   252   252   000    Old_age   Always       -       0
194 Temperature_Celsius     0x0002   061   042   000    Old_age   Always       -       39 (Min/Max 12/58)
195 Hardware_ECC_Recovered  0x003a   100   100   000    Old_age   Always       -       0
196 Reallocated_Event_Count 0x0032   252   252   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   252   252   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   252   252   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0036   100   100   000    Old_age   Always       -       8
200 Multi_Zone_Error_Rate   0x002a   100   100   000    Old_age   Always       -       1212
223 Load_Retry_Count        0x0032   100   100   000    Old_age   Always       -       5
225 Load_Cycle_Count        0x0032   099   099   000    Old_age   Always       -       10294

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     40314         -
# 2  Short offline       Completed without error       00%      4810         -

SMART Selective self-test log data structure revision number 0
Note: revision number not 1 implies that no selective self-test has ever been run
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Completed [00% left] (0-65535)
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Not sure to interpret it but for me seems OK


-> Yes i know i'm on realtek chip but I remember when getting the nas up to work on freenas 9 i haven't this issue. I can't exactly tell when I got this issue, but I fear it's link to my switch to freenas 11


-> I tried also to change the record size of the dataset to 1M, i saw it on some forum it helps, but here no difference should I wipe all and recreate the dataset??? - this will be painfull)

-> seems not to be my host or cables up to my PC (windows7) because I can get ~300 Mbps to my ISP

My freenas config

ASUS-E35M1-I-DELUXE
4 x 2To Samsung HDD SpinPoint F4
8go RAM
1 Gb ethernet

ZFS / RAIDZ
No compression
Sync standard



thanks in advance

 

[SweetAndLow]

lol

• Realtek® 8111E PCIe Gigabit LAN controller

this is why. choose a better motherboard. Read the hardware resources for suggestions.

 

[Ryle]

I sadly don't have money to spend on that, morevoer I was fine with this board until now..
I'm ok to say it's not a high perf chip but either chip is dying or something is wrong in the configuration because I do not have this kind of issue at the beginning, from what I remember speed were around 500Mb, so yes not as good as possible but not that bad...

I will try to get a pcie ethernet board to test, and also will try to get a hand on my old freenas 9 configuration

 

[Ryle]

Ok i switch to Freenas 11.2->11.3 reboot and now speed are back to 450 mbs and write still a 970

I remember when starting on freenas having to change the MTU to upgrade speed transfer. I try to play with this but seems sometime even worse than the default settings... (here i'm ok chipset seems to sucks) i will still try to get some intel nic, this is a cheap change