My Latest NAS Build - 8-bay Silent Low-Power SuperMicro - with plenty of pictures

seb101

Contributor
Joined
Jun 29, 2019
Messages
142
Intro

This is my 3rd NAS and my 2nd home-build. My first NAS was a Netgear ReadyNAS NV+, which despite being quite a basic device, served me very well and was still going strong 6 years later when I sold it.

My first home-build was hap-hazard and was mostly focused on lowest possible cost. It was based around an LGA 1150 mini-ITX Intel AIO board from ASUS (the Q87T) which for some reason at the time were retailing, boxed new, for just £30. With 4 onboard SATA3 ports, mSATA, dual LAN NIC and built-in DC-DC power conversion (so no PSU required) this was an absolute steal. I ended up buying 4 for future projects! Combined with this, I had a compatible i5 from a decommissioned desktop and 8GB SODIMM DDR3 RAM from an old laptop that I could drop straight in. This meant my total compute costs for the build were… £30!

For the chassis I ended up going for the In-Win IW-MS04-01 case, retailing at £105. This just left a low-profile CPU cooler and a few SATA cables to be procured, around another £25. So the build total cost was just £160. Not bad for a 4-bay i5 based NAS server (although if I’d had to buy all the components the real cost would have been closer to £250). I eventually ended up buying another 8GB memory to take it up to 16GB to allow for a few VMs to run (another £20).

This setup served me well, I was very pleased with the simplicity, low-power and quiet design. All power was provided from a 19V 180W laptop PSU, which plugged directly into the motherboard. The board has a male SATA power header for the drives, which was plenty capable of powering 4 NAS grade spinning drives. In terms of uptime and data integrity it was rock-solid.

It did have it’s drawbacks however. Something about the design of the Q87T meant that it didn’t fully support SATA hot-plug with FreeNAS (despite saying it was enabled in the BIOS settings). Any time a disk was hot-pulled under FreeNAS it would re-index the entire SATA bus, making it appear as if every device had just been pulled and re-inserted. All pools would subsequently detach then re-attach but in error state and would have to be manually cleared. This was annoying, but easy to work around, especially on a home system as I would just shut the unit down before doing any drive moves/adds/replacements.

However what eventually moved me to build my 3rd gen NAS was running out of disk slots. The RAID acronym ‘Redundant Array of Inexpensive Disks’ is ironic when you have to keep buying larger more expensive disks to replace perfectly good smaller ones in your limited slots!


Design Ethos

Some things were clear, I was going for 8x 3.5” bays. It would have a server grade mini-ITX motherboard and 32GB of ECC RAM, internal SSDs for boot and I would likely need a PCIE HBA to get the number of ports required. I also wanted to keep it as compact, quiet and low-power as possible, and this would influence PSU and fan choices.


Sourcing the Parts

Most of the time spent on this build was online, researching and sourcing the parts for the lowest possible cost. For a long time I had 2 possible compute builds in mind, with similar (pre-owned) costings:

  • Supermicro A1SRI series board with onboard processor (~£280)
  • Asrock LGA2011 X99E board (~£200) with an 8 core Xeon E5-2630L (~£60)
I cursed myself when I just missed out on an Asrock X99E ITX board that went on eBay for £124 however it turned out to be a blessing in disguise.

Endlessly trawling eBay for specific product numbers (in this case A1SRI-2758F) eventually threw up an interesting lot from a fixed asset removal company. From the picture it was a battered old NAS case, dented, knocked around and not even assembled properly and they were asking £400 for it, however the very limited description caught my eye.

1580329587037.png


“Supermicro A1SRI-2758F Intel C2758 8 Core 32GB 8 Bay NAS Quad RJ45 IPMI 12TB LSI” was all that was on the listing, along with a note that it was ‘tested working’ (whatever that may mean). No more details at all.

Dissecting these limited characters in the title however, got me excited, it would appear this unassuming box already contained almost everything I needed:

  • A1SRI-2758F Motherboard with Integrated Intel C2758 8 Core Processor
  • 32GB - which was highly likely ECC RAM because that’s all that the A1SRI board officially supports
  • 8 Bay enclosure - highly likely to include the cables/PSU
  • 12TB – as a bonus it would appear there is some disk storage also installed
  • LSI – probably indicating some sort of LSI HBA installed
I tried asking the seller a few more questions but they had no further details. So I decided to take a leap of faith and made an offer of £300. This was rejected, but we eventually settled on £350 for the lot, with delivery.

Deal done. Then the horrible wait for it to arrive… what had I actually bought here?!

The packaging it arrived in did not inspire much confidence, it was in a cardboard bundle held together with endless wrappings of packaging tape, but under this shell the seller had as least encased it in several layers of bubble-wrap and shipping foam. Once it was freed from the packaging I removed the cover and started my inspection.

It turned out to be an appliance originally built by a company called DATTO – even containing a sticker on the interior stating it was ‘Proudly Built in the USA by Michael for Datto’. Taking stock of the components I had:

  • 1x U-NAS NSC-800 8-bay chassis. Despite being a little knocked around it was a very solid and well-designed enclosure (which I decided to stick with, as you will see from the build pics below)
  • 1x SuperMicro A1SRI Motherboard with integrated C2758 8-core processor
  • 32GB (4x 8GB) Kingston DDR3 Unbuffered ECC SODIMMs
  • LSI 9211-8i SAS HBA
  • 2x MiniSAS to 4xSATA breakout cables
  • 2x 6TB HGST Ultrastar 7K6 drives
  • 1x 120GB Kingston SSD
  • 1x 400W AsPower 1U ATX PSU
Of course this is meaningless if it’s damaged, so the next step was to see what condition it was in. I tentatively popped a fresh FreeNAS 11.2 USB in the port and hit the power button, to my delight, it booted first time – not a single error on POST or Boot. Next I read the SMART data on HGST 6TB drives. ~2500 operating hours, 62 power cycles, no errors. Nearly new!

The only thing of note during the test was the LSI 9211 HBA had been left in RAID (IR) mode. Following the very comprehensive instructions I found here: https://nguvu.org/freenas/Convert-LSI-HBA-card-to-IT-mode/ this took less than 5 minutes to flash to the correct version of IT mode firmware.

So far, so lucky. However there was an issue lurking which I discovered after more in-depth reading on the A1SRI-2758F board. Being an Intel C2000 based board, the onboard SoC was affected by the so called AVR54 ‘Clock Death’ hardware bug that renders these systems unbootable sometime after 18 months, but with increasing certainty after 36 months of use. I checked the manufacture date on the board… September 2016… just over 36 months old. This means my board was likely to fail anytime soon and there is no way to predict when. Not a good start for a new NAS build!

However a glimmer of hope, allegedly Intel did secret deals with the hardware manufacturers that they would cover the costs of replacing the C2000 SoCs on these integrated boards in return for silence on the issue to the press. Intel’s press strategy worked – Googling this issue shows that apart from a few tech-press articles based on speculation back in 2017, there has never really been any negative press against Intel for this – despite this being a fundamental failure in their design and quality processes that will have impacts lasting decades as these SoCs are embedded in thousands of products like network routers, firewalls, NAS etc that will all begin to silently fail in the next few years. The flip side to this, is that the hardware manufacturers are able offer generous warranty extensions and replacement programs, presumably with Intel picking up at least some of the cost.

My board was over 3 years old, out of its original warranty and I was the second owner with no proof of purchase, so I was not holding out much hope for Supermicro to do anything for me. How wrong I was.

Just 1 hour after dropping an email to SM’s RMA department they confirmed they would offer a no-cost RMA repair on the board with a 5-10 day turnaround time. All I had to pay was the shipping, one way. If this was a retail board, they would have cross-shipped me a replacement immediately, however as this board was originally sold to an OEM customer (presumably DATTO) they said this wasn’t an option. I wasn’t too concerned about this, it would only delay my build by a couple of weeks. I have a gained a lot of respect for SuperMicro through this, their support is truly first class.

With the replacement board off being repaired, there were only a couple more ancillary components to source. For cooling two Arctic P12 silent cooling fans (£10). A second internal SSD to pair with the one that came in the case (£16) and a couple of SATA cables (~£5).

I wanted a silent PSU because I cannot stand the drone of the 40mm fans installed in 99% of 1U ATX PSU, so I purchased an FSP150-50FGBBB Silent 1U 150W PSU (£72).

150W power for an 8 Bay NAS system may seem foolishly conservative but components have got considerably more efficient in recent years. In fact, even with ‘worst case’ and ‘under load’ estimates from the manufacturers I will actually use under 97W at full load, leaving me 53W of headroom for any USB devices attached.

ComponentQtyFull Load Power (W)TotalSource
Board, CPU & RAM
1​
40​
40​
HBA
1​
15​
15​
Fans
2​
1​
2​
HGST Drives
2​
8​
16​
WD Drives
2​
5​
10​
Seagate Drives
2​
5​
10​
SSDs
4​
1​
4​
Total
97W
Budget
150W
Overhead
53W

That was it, ready to build. Below is the full hardware list.

PartDescriptionSourceCost
ChassisU-NAS NSC-800 8-Bay 3.5” Enclosure with 2 internal 2.5” mounts.eBayIncluded in the eBay lot
MotherboardSuperMicro A1SRI-2758FeBayIncluded in the eBay lot
CPUIntel C2758eBay/SupermicroIncluded in the eBay lot then replaced by SuperMicro
RAM32GB (4x8GB) Kingston KVR16LSE11 DDR3 1600 ECC SODIMMeBayIncluded in the eBay lot
HBALSI 9811-8i SAS HBAeBayIncluded in the eBay lot
Backplane2x 4 Port SAS Discreet Unknown MfgeBayIncluded in the eBay lot
PSUFSP150-50FGBBB Fanless 150W Flex ATX 1UOverTech£72
Cables2 x MiniSAS to 4xSATAeBayIncluded in the eBay lot
StarTech 8” LSATA CableAmazon£2.50
StarTech 12” LSATA CableAmazon£2.50
Fans2x Arctic Cooling P12 Silent PWMAmazon£10
eBay Lot£350
Total Server Cost£442
Drives2x 2TB WD RedOwned£0
2x 4TB Seagate IronwolfOwned£0
2x 6TB HGST Ultrastar 7K6Included in eBay Lot£0
2x Kingston 120GB SSD1 included in eBay lot, 1 from Amazon£16
2x Other SSD 250GBOwned£0
Total Drives Cost£16
Total for New Build£453

The Build

The first step in any build is to temporarily install all the fixed components, to check for fit and work out the cable routings and lengths. Almost immediately I could see this was going to be a challenge as a lot of wiring needed to be wedged in the very small clearance at the bottom of the motherboard bay where the ATX Power, USB3 and fan headers were all located, taking care not to push against the lower 2 RAM modules or restricting airflow to the CPU heatsink. More importantly it transpired the cables on the Flex ATX PSU were too short all round, not being able to reach the ATX header on the board or the required interfaces for SATA on the internal drives or Molex for the backplane. Not a big issue, approx. £8 of additional cable extenders/splitters needed.

The bigger issue with the PSU was that it was physically smaller in every dimension than the original case PSU. I had not realised that the 'standards' around PSU form factor for ‘1U’ devices are not really that standard at all. In order to securely attach it to the chassis required me to fashion an adapter for the backplate and a small bracket internally. I purchased some 1mm aluminium sheet from Amazon for £3.50 to make these.

The rest of the cabling was fairly simple, there being an ample amount of space under the drive bays to feed the fan cables and a large amount of free space on the top, partly as I was using a slightly smaller PSU as noted.

It also transpired the case had some interesting mounts for the 2.5” internal bays. The drives affixed to some custom metal brackets which then in turn mounted to the case. The case as I received it (from eBay) had only one bracket and the position of the case stand-offs meant there was no way of attaching a drive directly to the chassis. This meant I needed to fashion another bracket for the second drive. This was a trivial task and I was able to use the left-over aluminium from the PSU brackets.

So, onto the build. I will let the pictures do the talking from here on in.
  • The bare chassis (with backplane)
    1580329632053.png


  • Fans
    1580329643375.png

    The Arctic fans install very easily, with self-tapping screws through the back plate of the chassis. One cable tie keeps the power leads tidy.

  • Backplane power connectors.
    1580329663850.png

    The eagle eyed amongst you will notice here we have 4 molex connectors on the backplane, into 2 Y splitters into a further single Y splitter into single molex plug on the PSU. In total all 8 bay drives from a single molex. This was due to the fact the PSU only had a single molex connector. This concerned me, but I ran the power sums again and it is OK. The drives draw a max of 40W split between the 12V and 5V rails. You can safely assume most of this is the motor and arm actuator which is on the 12V rail, so 3.5A – which in this PSU has 10A of capacity. Additionally, the smallest wire-gauge in the chain was 20AWG which can safely support 4A of current at 12V.

  • Backplane SAS-SATA Breakout Connectors
    1580329675739.png

    Nothing special here, just a few zip-ties to keep everything neat and in place.

  • Internal SSD No. 1
    1580329688885.png

    The first SSD mounts on the side of the case, on its special adaptor plate. SATA and power tail also attached.

  • Internal SSD No. 2
    1580329700859.png

    This one mounts on the top of the chassis, also on its adaptor plate. The SATA cable from the first drive routes neatly under this.

  • Motherboard
    1580329824779.png

    Apologies for the lack of detailed photos of this step, its complexity required two hands and stopped me picking up the camera! By this stage the RAM was installed, the USB3 front panel connector attached, fan power attached and the 20cm ATX power extender tail, all at the very bottom of the board. Then with a small degree of difficulty, the motherboard slides vertically into the case and is secured by the 4 mounting screws, which due to the interesting design of this case, enter from two different directions.

    1580329838986.png

    The case includes an insulating shield, which is required as the top metal bracket which holds the board in place is on the underside of the board with only couple of millimetres clearance.

  • Motherboard Part 2
    1580329853785.png

    Now the internal SATA SSD cables are attached and the front panel switches/LEDs. A quick cable tie tidies up the slack cable loops of breakout cable.
There is a 10 attachement limit per post... so this is continued in the next reply!
 
Last edited:

seb101

Contributor
Joined
Jun 29, 2019
Messages
142
  • Case back plate
    1580330101722.png

    The case back plate goes on, with a full 12 M3 screws. The motherboard IO shield also goes in.

    1580330114945.png

    Checking that the wiring has cleared the fans and has space for good airflow.

  • PCIE Riser and HBA Adaptor
    1580330126625.png

    The PCIE ribbon riser screws to special mounts on the case, then the HBA slides in like usual. It was easier to attach the Mini-SAS connectors prior to inserting the card as they can be hard to insert on an angle. The clearance between the top of the SSD and the underside of the HBA is very tight but thankfully there are no components on that part of the HBA board. If there were, some insulating tape on the top of the drive would be in order. It is worth noting that the Kingston drives are very thin and a thicker SSD or an HDD would likely cause fitment problems here.

  • PSU
    1580330141645.png

    The power supply goes on top and three quick connections to the SATA power (internal SSDs), molex power (bay drives) and ATX tail already attached to the motherboard. Copious zip-ties keep everything firmly attached and as neat as possible.

  • Finished job
    1580330155103.png

    Back of the case – you can just see the two pieces of aluminium plate that I had to cut and drill to secure the slightly smaller PSU - a rectangle on the left and a reverse L shape on the right. Inside there is a small bracket I also made to hold the PSU in place at the right height with about 1cm air-flow gap above the drive cage.

    1580330168378.png

    Front of the case – a big gaping hole for drives!
Post build
  • Smoke Test
    This one is pretty easy thanks to SuperMicro’s excellent BMC. Powering on with no boot drives still allows me to log in to the IPMI interface and check the system temps and voltages.
    1580330190732.png

    1580330201304.png

    The only thing of note is that the supposedly ‘matched’ constant speed silent fans are running at different speeds (1000rpm and 1100rpm). The fan is supposed to run at 1050 RPM so I assume a that a tiny variation in speed, probably due to static pressure, is causing one to round up and one to round down.
    A quick check of the BIOS shows the two internal SSD boot drives have been correctly registered.

  • MemTest
    Passed with no errors.

  • Stress Test
    Honestly, I didn’t do one. This is a home NAS, the most ‘stress’ it’s going to get is if 4 people decide to copy a 4K video at the same time. I am confident enough in the build, thermal design and the choice of components that I can skip this step.

  • Install and Restore
    An entirely pain-free process thanks to the great design of FreeNAS.
    • Starting with an empty drive cage (to avoid any accidents) I booted from USB and installed a fresh install of 11.2-U7 to both internal SSDs.
    • Then booted the fresh install to make sure everything looked ok. No obvious errors in the logs.
    • Uploaded the backup.
    • Waited for restore to complete.
    • Fixed the network parameters. The old board had Realtek and e1000 NICs, so the interfaces were named reX, emX etc. New interfaces are Intel igbX type interfaces.
    • Shutdown and insert the drives.
    • Boot.
Simple as that. The only thing I missed, but was easy to fix, was that my VMs did not boot after the restore. This turned out to be because the virtual NIC interfaces retained the old (now non-existent) NIC ID ‘re0’ from the previous build. This was simple to fix in the GUI by simple editing the device entry and applying the correct NIC.

Finally, here it is in its new roof-space home, along with the router, switches and power-conditioning UPS.

1580330251906.png


Thanks for taking the time to read! I hope it shows that with a bit of perseverance on eBay you can make a rock solid NAS system for a very reasonable price. I would caution however that the amount of Intel C2000 pre-owned products are on the rise and I’m certain that at some point even SuperMicro will call time on RMA repairs – so be very cautious about buying these boards, especially as a lot of these are coming up to the 36 month failure ‘danger zone’.

Thanks to the whole FreeNAS team for making this possible and continuing to provide rock-solid software.

Cheers!
 
Last edited:

volothamp

Explorer
Joined
Jul 28, 2019
Messages
72
Congratulations for your build.

I saw the U-Nas case listing in GPB from the UK and it was probably the same you bought, it had the same disclaimer. I'm still regretting not getting that case as it's really hard to find here in Europe.

Very good job I'm planning to do something similar, would you share how you set up the alerts in ebay? Do you search for the exact component or more general "supemicro denverton"?
 

seb101

Contributor
Joined
Jun 29, 2019
Messages
142
Congratulations for your build.

I saw the U-Nas case listing in GPB from the UK and it was probably the same you bought, it had the same disclaimer. I'm still regretting not getting that case as it's really hard to find here in Europe.

Very good job I'm planning to do something similar, would you share how you set up the alerts in ebay? Do you search for the exact component or more general "supemicro denverton"?

So its a bit of luck and a bit of perseverance, you can however use a few tools to help. Firstly eBay will allow boolean OR searching using the (a,b,c) syntax. So you can create a short-list of parts and search for them all at once by putting them in brackets separated by commas. Always check the 'include description' box as this will more likely capture a listing for something that has this component inside it (as with my lucky find). You should also include any common/possible mis-spellings of the component (like aisri, a1sr1 etc) as this is a good way of grabbing a bargain.

1580401669711.png


Typically the best deals come from 'Auction' listings rather than 'Buy It Now' so you can filter on this too.

eBay also allows you to save this search and receive emails when anything new matches it:

1580401338647.png


Good luck!
 
Top