ETSCORP
Cadet
- Joined
- Aug 31, 2014
- Messages
- 3
Let me start out by saying I am new to the community and I appreciate the efforts of everyone to provide constructive feedback and help for those who are learning. I especially want to thank Cyberjock for his “ZFS Storage Design and other FreeNAS information” powerpoint guide.
With introductions out of the way I want to layout what I am thinking and ask for your honest feedback.
Goals:
Learn as much as I can about ZFS and FreeNAS.
Learn and Understand Best Pratices, and NOT cut corners.
Provide high storage solutions for a small datacenter that I own. The core hardware in the datacenter is Dell 10 GbE switches (Powerconnect 8024F) and Dell Power Edge Servers. The software layer is VMware ESXi 5.5.
Storage will be provided to the hosts via 10GbE iSCSI (2 x 10GbE with LACP per VMware host). I am open to suggestions if there are better options than iSCSI.
Design a highend storage solution based upon FreeNAS and commodity hardware and then build 2 identical units. (1 storage unit for live production and 1 storage unit for backup).
Basic Design Concepts
Known Details for Build/Hardware on Hand (I currently own the following):
Software:
FreeNAS 9.2.1.7
I had considered Windows 2012 R2 Storage Server (ReFS) but I feel ZFS had to many advantages.
Head end for JBOD Storage:
Server(s) for FreeNAS: 2 x Dell PowerEdge R420 (Identical Build)
2 x Intel Xeon E5-2430 Processor (2.20GHz, 15M Cache, 6 Core,)
192 GB of (12 x KTD-PE316/16G) DDR3, 1600MHz, ECC, Registered
Dual Hot Plug Redundant Power Supplies 550W
PERC H710P Integrated RAID Controller, 1GB NV Cache
8 x Intel Pro 2500 2.5" 120GB SATA 6Gb/s MLC Enterprise SSD on PERC H710P
Dell iDRAC Enterprise (Remote Access and Management)
1 x Intel X520-DA2 Dual Port 10GbE
1 x Intel i350qp Quad Port 1 GbE
Unknown Details for Build/Hardware to buy (I am looking for input):
JBOD enclosure options:
Option 1: Chenbro 9U 50 Bay Storage Chassis (Preferred Option Based on drive QTY)
http://usa.chenbro.com/corporatesite/products_detail.php?sku=45
I believe for Option 1 I would need to use the following SAS Expander in order to use the above-mentioned chassis. Is this a deal breaker? http://usa.chenbro.com/corporatesite/products_detail.php?sku=76
Option 2: SuperChassis 847E26-RJBOD1 (Second choice but only 45 drives, might be a winner due to the fact as I understand it the backplanes have dual-port expanders that access all the hard drives. These dual-port expanders support cascading, failover, and multipath. I think that is desirable?)
http://www.supermicro.com/products/chassis/4U/847/SC847E26-RJBOD1.cfm?parts=SHOW
Option 3: E9M50 9U 50-Bay Storage Server Rackmount Chassis (Losts of unknows. I am not able to find info on connection options or even a manual for this chassis)
http://rma.istarusa.com/rackmount_chassis/estorm/raid/e9m50.aspx
HBA Controller:
Option 1: LSI Logic SAS 9300-16e SGL
http://store.lsi.com/index.cfm/Host-Bus-Adapters/12Gb-SAS-9300-Adapters/LSI00342/
Option 2: LSI SAS9206-16e
http://store.lsi.com/index.cfm/Host-Bus-Adapters/6Gb-SAS-9206-Adapters-PCIe-3.0/LSI00299/
Option 3: LSI SAS 9201-16e
http://store.lsi.com/index.cfm/Host-Bus-Adapters/6Gb-SAS-9201-Adapters/LSI00276/
Hard Drive Options:
Hard Drive Option 1: Seagate Constellation ES.3 ST4000NM0023 4TB 7200 RPM 128MB Cache SAS 6Gb/s 3.5" Enterprise Internal Hard Drive
http://www.newegg.com/Product/Product.aspx?Item=9SIA5EM1PU0823
Hard Drive Option 2: TOSHIBA MG03SCA400 4TB 7200 RPM 64MB Cache SAS 6Gb/s 3.5" Enterprise Hard Drive
http://www.newegg.com/Product/Product.aspx?Item=9SIA5EM1R03009
Hard Drive Option 3 (If I were a rich man option) HGST He6 HUS726060ALS640(0F18370) 6TB 7200 RPM 64MB Cache SAS 6Gb/s 3.5" Enterprise Hard Drive
http://www.newegg.com/Product/Product.aspx?Item=9SIA5EM1PY9126
So what I am looking for is an affirmation that the hardware above looks solid. I am also open to alternatives. Including purchasing a prebuilt enterprise grade unit if my plans look too foolish. I figure that with the hardware I have on hand I should be able to assemble the storage enclosure with the 4TB option and get it connected for about ~$25,000.00 or less.
I have considered a BackBlaze style unit and looked at 45Drives offering but I ruled it out as I want easy front load access to the drives and I am willing to provide the rack space to due so. I am going SAS because I believe it will provide for better stability and hopefully that will translate into a safer environment. I am also somewhat confused by how I would go about connecting the storage enclosure to the server. I know I will use an 8088 or something like it cable or a series of cables or a fan 8088. If any one has any insight I would appreciate as this is my first JBOD build.
As far as the actually storage design I am considering using a ZPOOL composed of two VDEVs each with 25 drives or 22 if I go with the super micro chassis configured as RAID-Z3. Suggestions or improvements or betters configuration options are welcomed.
I am also very confused by the lack of support for a true hot spare. How can iXsystems, which is based on FreeNAS, offer this but FreeNAS lack it. I know some people think it is over kill but I like a security blanket.
I am sorry if this is not enough information. Please ask me questions and make lots of suggestions. I am open and willing to learn and I want to build something that works for me but also excites and attracts the interest of the community. If others have built what I am describing please point me to the posts and I will read before asking further questions.
Thanks in advance, Jacob
Last edited: