FAULTED drive and failed to read SMART

[Visseroth]

To answer your question, no I have not fixed the issue.
I've had one drive give write faults and aren't responding to SMART.
Supposedly there was a smart bug that would cause the drives to start kicking out and mine still periodically give errors but don't get kicked unless they have faults.
They used to get kicked for faults.
I've pulled the drives that have had errors, tested them and they pass so I put them back in.
So far in my system da11 and da4 are giving me fits though da11 gives write faults every now and then. about every few months

So in summary I don't have the answer but I do know it's still a issue, it just isn't as bad as it has been.

If you are getting faults on the same port/cable/bay you may have a cable issue. You could try swapping the cable. In my case I have a backplane so if indeed the problem persists on the same drives (of which I've been watching) I'd suspect a problem with those ports on the backplane.
This of course has to be confirmed with a drive swap of which I have yet to do since the errors are so far apart in time.

Oh, and if you start another thread about your issue, could you post the link to the thread here for reference? I'd like to see where your issue goes as well, whether it be resolution or not.

 

[Visseroth]

Well that depends on the hard drive model to be honest but most would say anything above 50C is too hot. Ideal in my opinion is below 40C.


I would request that you examine the new case specifically for operating fans and to figure out your airflow, I suspect you have improper airflow. For example, lets look at the 24 bay enclosure (I'm thinking of a generic case that pulls air from the front of the case to the rear) where you load it with up to 24 drives from the front, directly behind the hard drives is a series of fans hopefully, those fans will pull air across all those drives and even the non-populated drive slots. If you have a cheaper case you could be looking at only a few fans pulling air from the entire box or not well designed to pull air across all drive bays. I suspect that in your system you are pulling most of your air throught the empty drive bays and little air is being pulled across the actual hard drives. My advice, apply some tape to block air from coming in from most of the empty drive bays, do not block all of them, that is not good either. Take your time and use your brain to figure it out. If you think you have a fan issue, you should be able to address that too. If you need someones advice, a few good photos of the front, rear, and inside of the case would make it easier to offer assistance. I'm pretty big on air flow design, I like silent systems, I can't even hear my server it's so quiet under normal load and that wouldn't be possible without a good airflow strategy.

And then there is me, I don't like it loud but I like to know it's working and I put a box fan on the front of my cabinet with a 1x20x20 filter mounted to the back of the fan which positively pressurizes the cabinet.
Air flow isn't fast but as long as the filter isn't too dirty it's enough to keep things cool and clean. I have yet to need to blow the dust out of my equipment and the filter cleans the air in the room! :P

 

[Visseroth]

thank you @joeschmuck and yes I was asking him the question, I wasn't trying to get help yet as I read everything and I am about to start doing the smartctl test and the hardware test also before I bother you guys.

I was just curious to see what was the result @Visseroth had and if he where able to fix the issue or end up swaping the disks.

thank you for keeping an eye on things, I appressiate it.

And taking advatage that you are here and answering, I want to ask a question. I am playing around just for the heck of learning this so I bought an old rackable system enclouser whit 24 bays, I only put 3 disks on raidz3 to test but I see the disks are being kept between 45 and 47 deegrees but my dell server keeps them at 34 -36. what is the maximum tempeture for the disks? will that tempeture damage them?

and just to bluf a little (lol) I olso have an ECM enclouser with 15 bays that came with 520 bit sectors drives that I was able to reformat to 512 with the camcontrol command. this forum has give me a lot of fun. I just still can't figure out how to do properly the firmware updates on the HBA Cards so I can only do it with the bootable CD that broadcome provides.

sorry for all the mininless information lol.

The information is good.
Your temps are a little warm but not horrible. Drives are supposed to be able to handle up to 60C but that doesn't mean we should run them there and according to a backblaze article I found on correlations between drive failures and temps, temps don't necessarily mean higher failure rates.
In short, 45C is a little warm but not alarming however joeschmuck does make some good points about air flow. Air flow is important so it is worth looking into that all components are getting enough air flow and are staying cool.

 

[joeschmuck]

And then there is me, I don't like it loud but I like to know it's working and I put a box fan on the front of my cabinet with a 1x20x20 filter mounted to the back of the fan which positively pressurizes the cabinet.
Air flow isn't fast but as long as the filter isn't too dirty it's enough to keep things cool and clean. I have yet to need to blow the dust out of my equipment and the filter cleans the air in the room! :p

Funny you say that, my FreeNAS case uses an 18x18x1 filter (fits perfectly to cover the side of the case) and I think it's a 240mm fan running on 7VDC, it actually blows on the motherboard and just keeps air flow in those sections, however the hard drives have air intake fans blowing air across them. I have two exhaust fans (one in the power supply and one case fan) and lots of open holes for air to escape. I do have positive pressure in the case however the side fan cannot overpower the hard drive fans by design. And I agree, even in my situation the large filter rarely gets dirty but my wife likes to do her craft work in the basement, refinishing furniture which means some sanding. I have found wood dust trapped in the filter. I do tend to shut down my system about twice a year to take it to the garage and use the air compressor to blow out all the crap. When my house was in a new construction area, this was really needed, lots of dirt in the air.

To answer your question, no I have not fixed the issue.

Wow, that really sucks. Something like that would drive me crazy. I like what yu have said, to verify if the drives location/cables make a difference.

@Darklion Before investing too much money into this project, try to figure out the problem and maybe you will want to change the drive chassis for one known to work properly. Also, you could try a different operating system for testing purposes. Out of curiosity, are you running FreeNAS directly on bare metal or have you tried using VMware ESXi or similar hypervisor? ESXi works great and you can expose each hard drive fairly easily without altering the drives you are using right now. I would recommend you start another thread if you want to discuss this. Maybe if you use a hypervisor to host this, the problem would just be gone. I make this statement hoping that the issue is a problem with FreeNAS handing the hardware directly. I'm just trying to think outside the box here, maybe something will provide an answer to the problem.

Good Luck to both of you!

 

[Darklion]

Wow a lot of information lol.
To start, you lost me on VMware ESXi, Hypervisor and all that lol. I am a guy that use to be a computer engineer on 2005 and then give up and never do anything againg till now, so I am lost on all this new stuff, I was left on Mandrake linux and windows XP lol. almost no knowlage on networking and servers, I was use to code a little and that was it.

That rackable system enclouser is a pretty old and bad looking that I found for $60 just to start messing around so the air flow is horrible as is comes with 2 tiny fans for the hole system (I new this whould be a problem) I was just asking to find out the proper tempeture that I have to look for, before I start moodin the enclouser. I already had to open the power supply and get rid of the little tiny fan that came with it cuz the sound was driving me crazy and put like 4 more fans just on a ugly way to try, not anything serius cuz I only have like 5 to 7 hours a week that I can dedicate on this on troubleshooting.

Then I have bought like 30 ECM NetApp hard dives for like $10 a piece that I have being reformating on to 512 sectors, so I though this might be the problem, but I havent done any burn out test to find out if they are actualy good or not, I just need to find some time to do this.

For now I am just trying to collect information so I have a better picture on what to do before I start going serius on this issues, I still need to find out how to properly update the firmware on the raid cards, troublewhoot the SMART issue and the air flow problem on the rackable enclouser. For now the poweredge r510 server and the ECM encloser are working fine, I am transfering like 6 terabites of movies to the server and using the 2 enclousers to play with. My goal right now is to make plex work and be able to watch my movies, I need to figureout my network connection issue as well as I dont want to use the 4 1gb cards that the server comes with, but 1 SPF 10gb card that I bought but is heating up pretty bad and stocking the system, so I need to replace it.

So to make it short, I am just trying to collect information before I scream for help lol. But time is a big issue for me though, so all this will take me a while.

But I want to thank you all for all the information and help.

 

[Visseroth]

Yea, sounds like you have a lot going on there and I'm sure joeschmuck and many others including myself will have a lot of suggestions.
Let's start you another thread, post the link up here and I'll join in on it because I can tell you right now I already have more questions about your system.
In the new thread include your system information, memory, cpu, raid cards and the mode they are running in, drives, power supplies, NICs, ect and look around at other people's hardware specs as well.

@joeschmuck yea, it is annoying but so far it hasn't been a huge deal because it doesn't happen often. I have yet to determine if it's hard drive or a port issue and can't unless it happens enough to be able to narrow it down.
All in due time.