I'm having trouble with my TrueNAS Installation. It has historically been a Freenas (... back in the days of FreeNAS 11), which worked wonderful for the last years. With freeNAS 11 I've managed to copy and read easily around 90-100mb/s from and to the NAS on SMB, AFP, or RSYNC.
However, I've noted that as of lately, no matter what I do, I can't seem to achieve those speeds anymore but instead am limited to 4-11mb/s. I've searched around the forum, but unlike most others both read and writes are slow (and non of the there-mentioned solutions seemed to help).
Since it's slow on RSYNC as well as SMB or AFP, I think I can rule these as culprits out. So this lead me to two conclusions: Harddrive failure or networking problem.
However, it seems to be none of these two options - iperf3 shows the full gigabit connection speed, so it likely is not a networking issue. Harddrive SMART Values look fine, do a periodic selftest (and complete them successfully without errors), so I decided to remove one drive from the pool and readd it again. The result had been a resilvering tasks with 2.4TB of data, which completed in about 9 hours, leading to an average of 73mb/s when resilvering, so I think it's safe to rule that one too out.
Does anyone have a clue, what could possibly be any other culprit?
My system specs are as follows:
Motherboard: Gigabyte H87-HD3
CPU: Intel(R) Xeon(R) CPU E3-1230 v3 @ 3.30GH
RAM: 4*8GB DDR3 -> 32GB total
HDD: 2* 4TB WD RED (Mirrored)
Systemload is usually pretty idle, as this is my personal NAS device, nothing with lots of users or something.
TrueNAS Version: 12.0-U4.1
Thanks in advance!
However, I've noted that as of lately, no matter what I do, I can't seem to achieve those speeds anymore but instead am limited to 4-11mb/s. I've searched around the forum, but unlike most others both read and writes are slow (and non of the there-mentioned solutions seemed to help).
Since it's slow on RSYNC as well as SMB or AFP, I think I can rule these as culprits out. So this lead me to two conclusions: Harddrive failure or networking problem.
However, it seems to be none of these two options - iperf3 shows the full gigabit connection speed, so it likely is not a networking issue. Harddrive SMART Values look fine, do a periodic selftest (and complete them successfully without errors), so I decided to remove one drive from the pool and readd it again. The result had been a resilvering tasks with 2.4TB of data, which completed in about 9 hours, leading to an average of 73mb/s when resilvering, so I think it's safe to rule that one too out.
Does anyone have a clue, what could possibly be any other culprit?
My system specs are as follows:
Motherboard: Gigabyte H87-HD3
CPU: Intel(R) Xeon(R) CPU E3-1230 v3 @ 3.30GH
RAM: 4*8GB DDR3 -> 32GB total
HDD: 2* 4TB WD RED (Mirrored)
Systemload is usually pretty idle, as this is my personal NAS device, nothing with lots of users or something.
TrueNAS Version: 12.0-U4.1
Code:
smartctl 7.2 2020-12-30 r5155 [FreeBSD 12.2-RELEASE-p6 amd64] (local build) Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Family: Western Digital Red Device Model: WDC WD40EFRX-68WT0N0 Serial Number: WD-WCC4E1620954 LU WWN Device Id: 5 0014ee 2b4c4b086 Firmware Version: 80.00A80 User Capacity: 4,000,787,030,016 bytes [4.00 TB] Sector Sizes: 512 bytes logical, 4096 bytes physical Rotation Rate: 5400 rpm Device is: In smartctl database [for details use: -P show] ATA Version is: ACS-2 (minor revision not indicated) SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Tue Aug 3 15:00:17 2021 CEST SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x00) Offline data collection activity was never started. Auto Offline Data Collection: Disabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: (53520) seconds. Offline data collection capabilities: (0x7b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 2) minutes. Extended self-test routine recommended polling time: ( 535) minutes. Conveyance self-test routine recommended polling time: ( 5) minutes. SCT capabilities: (0x703d) SCT Status supported. SCT Error Recovery Control supported. SCT Feature Control supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 16 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0 3 Spin_Up_Time 0x0027 175 175 021 Pre-fail Always - 8208 4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 96 5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0 7 Seek_Error_Rate 0x002e 100 253 000 Old_age Always - 0 9 Power_On_Hours 0x0032 014 014 000 Old_age Always - 63325 10 Spin_Retry_Count 0x0032 100 253 000 Old_age Always - 0 11 Calibration_Retry_Count 0x0032 100 253 000 Old_age Always - 0 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 40 192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 19 193 Load_Cycle_Count 0x0032 182 182 000 Old_age Always - 55470 194 Temperature_Celsius 0x0022 110 103 000 Old_age Always - 42 196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0 197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0030 100 253 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0 200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 0 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Extended offline Completed without error 00% 63274 - # 2 Short offline Completed without error 00% 63166 - # 3 Short offline Completed without error 00% 62999 - # 4 Short offline Completed without error 00% 62831 - # 5 Short offline Completed without error 00% 62663 - # 6 Extended offline Completed without error 00% 62530 - # 7 Short offline Completed without error 00% 62447 - # 8 Short offline Completed without error 00% 62279 - # 9 Short offline Completed without error 00% 62112 - #10 Short offline Completed without error 00% 61944 - #11 Extended offline Completed without error 00% 61813 - #12 Short offline Completed without error 00% 61704 - #13 Short offline Completed without error 00% 61536 - #14 Short offline Completed without error 00% 61368 - #15 Short offline Completed without error 00% 61200 - #16 Extended offline Completed without error 00% 61068 - #17 Short offline Completed without error 00% 60984 - #18 Short offline Completed without error 00% 60817 - #19 Short offline Completed without error 00% 60649 - #20 Short offline Completed without error 00% 60481 - #21 Extended offline Completed without error 00% 60349 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay.
Code:
smartctl 7.2 2020-12-30 r5155 [FreeBSD 12.2-RELEASE-p6 amd64] (local build) Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Family: Western Digital Red Device Model: WDC WD40EFRX-68WT0N0 Serial Number: WD-WCC4E1628473 LU WWN Device Id: 5 0014ee 25f6efbb5 Firmware Version: 80.00A80 User Capacity: 4,000,787,030,016 bytes [4.00 TB] Sector Sizes: 512 bytes logical, 4096 bytes physical Rotation Rate: 5400 rpm Device is: In smartctl database [for details use: -P show] ATA Version is: ACS-2 (minor revision not indicated) SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Tue Aug 3 15:03:08 2021 CEST SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x00) Offline data collection activity was never started. Auto Offline Data Collection: Disabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: (52080) seconds. Offline data collection capabilities: (0x7b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 2) minutes. Extended self-test routine recommended polling time: ( 521) minutes. Conveyance self-test routine recommended polling time: ( 5) minutes. SCT capabilities: (0x703d) SCT Status supported. SCT Error Recovery Control supported. SCT Feature Control supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 16 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0 3 Spin_Up_Time 0x0027 179 179 021 Pre-fail Always - 8041 4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 106 5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0 7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 2 9 Power_On_Hours 0x0032 014 014 000 Old_age Always - 63326 10 Spin_Retry_Count 0x0032 100 100 000 Old_age Always - 0 11 Calibration_Retry_Count 0x0032 100 253 000 Old_age Always - 0 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 40 192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 20 193 Load_Cycle_Count 0x0032 184 184 000 Old_age Always - 49366 194 Temperature_Celsius 0x0022 113 106 000 Old_age Always - 39 196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0 197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0030 100 253 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0 200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 0 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Extended offline Completed without error 00% 63274 - # 2 Short offline Completed without error 00% 63167 - # 3 Short offline Completed without error 00% 62999 - # 4 Short offline Completed without error 00% 62831 - # 5 Short offline Completed without error 00% 62664 - # 6 Extended offline Completed without error 00% 62530 - # 7 Short offline Completed without error 00% 62448 - # 8 Short offline Completed without error 00% 62280 - # 9 Short offline Completed without error 00% 62113 - #10 Short offline Completed without error 00% 61944 - #11 Extended offline Completed without error 00% 61813 - #12 Short offline Completed without error 00% 61705 - #13 Short offline Completed without error 00% 61537 - #14 Short offline Completed without error 00% 61369 - #15 Short offline Completed without error 00% 61201 - #16 Extended offline Completed without error 00% 61069 - #17 Short offline Completed without error 00% 60985 - #18 Short offline Completed without error 00% 60817 - #19 Short offline Completed without error 00% 60650 - #20 Short offline Completed without error 00% 60482 - #21 Extended offline Completed without error 00% 60349 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay.
Thanks in advance!