AlexGG
Contributor
- Joined
- Dec 13, 2018
- Messages
- 171
likely caused from a cable issue,
Another good candidate to blame is PCI-E x1 SATA controller. Some models do not do well under load.
likely caused from a cable issue,
OMG, this looks like it came straight out of my nightmare. I suspect all your power cycle issues is at least, in part, due to this crazy card & cabling, which in turn, causes all the data corruptions.No judging, I was broke and this all I had to work with.. Not my best work.. I use these female connectors to male all the hard drives. I only plug into the main power supply with them. No daisy chains. 500 watt power supply. There are 3 chains for all the drives.
12 Drives total.
View attachment 59305
View attachment 59306
View attachment 59307
View attachment 59308
If this was you what parts would you buy? Brand new build for only ZFS. Please try to keep it under $550. Its needs to hold all 12 drives. Keep the same power supply and sata cables that are new?OMG, this looks like it came straight out of my nightmare. I suspect all your power cycle issues is at least, in part, due to this crazy card & cabling, which in turn, causes all the data corruptions.
I'm not trying to judge, but you're a brave soul for doing this on 16 TB drives on data you actually care about losing with no backup.
ZFS is rock solid with proper setup, but you can't blame it when you set it up for failure though, all bets are off.
Let this be a lesson that when it comes to data you care about losing, it really isn't worth playing with fire. Better to wait when you're not broke and build, then play with fire while you're broke and cry and weep 1 year later after it all crashes and burns spectacularly.
If I were you, I'd start the process of migrating the remaining drives of your other pools to a more sane setup before you encounter another fate like this one.
My storage server is offline my next resilver is in a few days, not letting that happen this month.Did you not have any warning signs of data issues before this occurred? Do you know when the last SCRUB was completed and if it have any error messages? On your other systems that are operational, I'd see when the last SCRUB was completed and if it's been a while, run a SCRUB. The default is monthly but you can change that. I leave mine on the default. Do you have email notification setup?
I'm trying to make sure that you do not suffer this again on a different system. It's a terrible feeling to lose your data.
I’d get at least 1 if not 2 ($50 each) LSI 9200 / 9211 cards with 2 or 4 mini sas to 4 sata splitters ($10 each) and a 650w seasonic psu ($150-200). Keep your case motherboard cpu ram for now but look to upgrade them when you have more budget. Also toss all those jank splitter cables you’re using at the moment.If this was you what parts would you buy? Brand new build for only ZFS. Please try to keep it under $550. Its needs to hold all 12 drives. Keep the same power supply and sata cables that are new?
You can start here.If this was you what parts would you buy? Brand new build for only ZFS. Please try to keep it under $550. Its needs to hold all 12 drives. Keep the same power supply and sata cables that are new?
I am going to buy 3 9211 cards. Link:I’d get at least 1 if not 2 ($50 each) LSI 9200 / 9211 cards with 2 or 4 mini sas to 4 sata splitters ($10 each) and a 650w seasonic psu ($150-200). Keep your case motherboard cpu ram for now but look to upgrade them when you have more budget. Also toss all those jank splitter cables you’re using at the moment.
500 watt power supply. There are 3 chains for all the drives.
12 Drives total.
Should get rid of the power spitters for all the drives?
Ok, ok ok, I'll buy a power supply.. I still don't want to spend money.. What about the power connectors. What should I buy? Just show me what to buy on amazon, ebay, newegg for the cables.Ah, with picture.
BUILD - Please review my Intel Skylake FreeNAS build
If you do want the SATA adapters, get crimped not moulded ones. GOOD BADwww.truenas.com
I mentioned it in one of the earlier posts but did not force the issue and did not reference the guide. I suggested that the power supply may be faulty or undersized.I'm ashamed that no one climbed all over that one.
I mentioned it in one of the earlier posts but did not force the issue and did not reference the guide. I suggested that the power supply may be faulty or undersized.
Agreed. I've never seen drives with so many power cycles. One with basically double the power cycles than hours, crazy.I was referring to the power splitter cables. These are almost never a good idea.
It very well could be the power splitters, that makes more sense since there was no report of the computer crashing.
I didn't catch that. Good thing you did.