Current setup:
Supermicro X9SCM
Xenon E3 2nd gen.
32 Gig ECC memory
Crossflashed LSI 9212 4i4e to IT mode
3x SE30611 Rackable Jbods with 16x drives slots. Only 10 slots used per Jbod. (heavily customized - backplanes replaced with direct connect cables, PSU replaced with ATX 760, and 120mm fans in front and back in push-pull config.) Nice and quiet.
***(3 x Zpools each set up in 2 x 5 drive RaidZ1 for a 10 drive Zpool. 2x Zpools are full and 1x Zpool is open)
ONLY 3 Client computers and at worst only 2 accessing the server at once -
2 clients are connected directly SFP+ to 2 port Myricom 10 Gig-e
3 clients (2 are the same as above) connected to a 1 gig-e switch to the server
Server Usage: 1 clients at most playing a video file in real time from the full Zpools, while the other renders (or copies to the empty zpool). All drives 4TB HGST coolspin SATA. (there might be a few 7200 RPMs in there.) Will want to replace with 8TB drives in the future or add another Jbod. The whole thing is a video archive, and the server is hardly turned on, but when it is, it can run for a few days. Current setup is very stable but I think it heats up and all of sudden I get CAM SCSI errors with drives dropping off and coming back. No data is lost. After much trouble shooting I believe its the Port expanders overheating or al the external cabling every so slightly becoming less conductive. Just time to rebuild.
I am going to transfer the MB, FreeNAS and drives to the new build. The real issue is making sure I have the correct HBA/Expanders in there.
New Build:
Looks like I am going to build a 30 drive setup from 45 drives as I want the server to be quiet and as cool as possible without running the air con all the time.
1) Is the 92101-16i fully ZFS compatible - meaning can be be flashed to IT mode? (or is there some other solution I don't know about). A lot of people seem to be be using it, so I think it works, but I don't see a clear post that says this card is great with FreeNAS. I want to make sure as the data I have is an archive I don't want to half guess this move.
2) Is there a problem running 2 x LSI SAS 9201-16i with FreeNAS 9.3?
3) All my drives are now Coolspin HGST SATA drives. Does SATA pose any issues?
Other build Option:
Using the same 30 drive setup from 45 drives are there any problems with using M1015 and Intel 36 port expander? From my other post, you all have said that is more or less fine, but here I added more details of what I am up to, so just wanted to make sure there was nothing I was missing.
Supermicro X9SCM
Xenon E3 2nd gen.
32 Gig ECC memory
Crossflashed LSI 9212 4i4e to IT mode
3x SE30611 Rackable Jbods with 16x drives slots. Only 10 slots used per Jbod. (heavily customized - backplanes replaced with direct connect cables, PSU replaced with ATX 760, and 120mm fans in front and back in push-pull config.) Nice and quiet.
***(3 x Zpools each set up in 2 x 5 drive RaidZ1 for a 10 drive Zpool. 2x Zpools are full and 1x Zpool is open)
ONLY 3 Client computers and at worst only 2 accessing the server at once -
2 clients are connected directly SFP+ to 2 port Myricom 10 Gig-e
3 clients (2 are the same as above) connected to a 1 gig-e switch to the server
Server Usage: 1 clients at most playing a video file in real time from the full Zpools, while the other renders (or copies to the empty zpool). All drives 4TB HGST coolspin SATA. (there might be a few 7200 RPMs in there.) Will want to replace with 8TB drives in the future or add another Jbod. The whole thing is a video archive, and the server is hardly turned on, but when it is, it can run for a few days. Current setup is very stable but I think it heats up and all of sudden I get CAM SCSI errors with drives dropping off and coming back. No data is lost. After much trouble shooting I believe its the Port expanders overheating or al the external cabling every so slightly becoming less conductive. Just time to rebuild.
I am going to transfer the MB, FreeNAS and drives to the new build. The real issue is making sure I have the correct HBA/Expanders in there.
New Build:
Looks like I am going to build a 30 drive setup from 45 drives as I want the server to be quiet and as cool as possible without running the air con all the time.
1) Is the 92101-16i fully ZFS compatible - meaning can be be flashed to IT mode? (or is there some other solution I don't know about). A lot of people seem to be be using it, so I think it works, but I don't see a clear post that says this card is great with FreeNAS. I want to make sure as the data I have is an archive I don't want to half guess this move.
2) Is there a problem running 2 x LSI SAS 9201-16i with FreeNAS 9.3?
3) All my drives are now Coolspin HGST SATA drives. Does SATA pose any issues?
Other build Option:
Using the same 30 drive setup from 45 drives are there any problems with using M1015 and Intel 36 port expander? From my other post, you all have said that is more or less fine, but here I added more details of what I am up to, so just wanted to make sure there was nothing I was missing.
