I have a big problem here.
I use a shared NFS folder from my freenas mounted on around 100 virtual machines and I execute the Oracle database backup using rman and writing in this share limiting 20 backups at the same time for avoid I/O problem.
All backups are terminated with success without errors, but after I try read theses files for validation and I receive the error:
ORA-19599: block number 256190 is corrupt in backup piece /nfsshare/FILENAME
I moved to a new server think was a hardware issue , but I have the same problem.
When I use the same process using a NFS SharPe at NETAPP storage I don't have this issue.
- I try change server, no success
- I decrease the concurrency from 20 for 5, no success
I don't receive any erros on freenas:
Freenas Version: FreeNAS-11.2-U5
Processor: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz (16 cores)
Memory: 36GB DDR3-1333 REGISTERD ECC MEMORY MODULE 9965447-030.A00LF
Disk Controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03) - IT MODE/JBOD
disk boot: 2x KINGSTON SA400S37120G
disk data: 8x Seagate Archive HDD ST6000AS0002-1N917X
Zpool: Sync disable / Compression OFF / Deduplication Off
NFS mount point option in clients:
rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768
The corruption is random, same server fail on day works in another day.
Someone Can help me ?
I use a shared NFS folder from my freenas mounted on around 100 virtual machines and I execute the Oracle database backup using rman and writing in this share limiting 20 backups at the same time for avoid I/O problem.
All backups are terminated with success without errors, but after I try read theses files for validation and I receive the error:
ORA-19599: block number 256190 is corrupt in backup piece /nfsshare/FILENAME
I moved to a new server think was a hardware issue , but I have the same problem.
When I use the same process using a NFS SharPe at NETAPP storage I don't have this issue.
- I try change server, no success
- I decrease the concurrency from 20 for 5, no success
I don't receive any erros on freenas:
Freenas Version: FreeNAS-11.2-U5
Processor: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz (16 cores)
Memory: 36GB DDR3-1333 REGISTERD ECC MEMORY MODULE 9965447-030.A00LF
Disk Controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03) - IT MODE/JBOD
disk boot: 2x KINGSTON SA400S37120G
disk data: 8x Seagate Archive HDD ST6000AS0002-1N917X
Zpool: Sync disable / Compression OFF / Deduplication Off
NFS mount point option in clients:
rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768
The corruption is random, same server fail on day works in another day.
# zpool status
pool: freenas-boot
state: ONLINE
scan: scrub repaired 0 in 0 days 00:03:52 with 0 errors on Fri Nov 1 03:48:52 2019
config:
NAME STATE READ WRITE CKSUM
freenas-boot ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
ada0p2 ONLINE 0 0 0
ada1p2 ONLINE 0 0 0
errors: No known data errors
pool: vol
state: ONLINE
scan: scrub repaired 0 in 1 days 00:18:21 with 0 errors on Mon Oct 21 00:18:24 2019
config:
NAME STATE READ WRITE CKSUM
vol ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
gptid/31138b9b-b245-11e9-86e0-0025902d086c ONLINE 0 0 0
gptid/38e6d6be-b245-11e9-86e0-0025902d086c ONLINE 0 0 0
gptid/40c09b56-b245-11e9-86e0-0025902d086c ONLINE 0 0 0
gptid/4898448d-b245-11e9-86e0-0025902d086c ONLINE 0 0 0
raidz1-1 ONLINE 0 0 0
gptid/b7b8e9cc-ce71-11e9-acde-0025902d086c ONLINE 0 0 0
gptid/c53be1d6-ce71-11e9-acde-0025902d086c ONLINE 0 0 0
gptid/c97ae6c4-ce71-11e9-acde-0025902d086c ONLINE 0 0 0
gptid/cb85b363-ce71-11e9-acde-0025902d086c ONLINE 0 0 0
errors: No known data errors
Someone Can help me ?