What is the freebsd-swap partition.

[SweetAndLow]

Someone in irc had a similar problem as you. It came down to the inefficient layout of 8disks and raid z2. Here is some info

https://web.archive.org/web/2014040...s.org/ritk/zfs-4k-aligned-space-overhead.html

https://i.stack.imgur.com/N7ihZ.png

 

[Joe Goldthwaite]

I just wanted to give you guys an update. After reading the links SweetAndLow posted, I decided to add one more drive to my NAS. It wasn't easy. with 12 drives I was out of drive bays and sata ports. I added this adapter and ended up bolting the 13th drive under the motherboard. It's a full tower case and the Asrock C2750D4i motherboard is tiny so there was room to bolt the drive below it.

Anyway, here's the size now from zfs list

Code:

NAME  USED  AVAIL  REFER  MOUNTPOINT
freenas-boot  643M  13.2G  31K  none
freenas-boot/ROOT  629M  13.2G  25K  none
freenas-boot/ROOT/9.10-STABLE-201605240427  620M  13.2G  492M  /
freenas-boot/ROOT/Initial-Install  1K  13.2G  482M  legacy
freenas-boot/ROOT/Pre-9.10-STABLE-201605021851-195856  1K  13.2G  489M  legacy
freenas-boot/ROOT/default  8.43M  13.2G  490M  legacy
freenas-boot/grub  12.7M  13.2G  6.33M  legacy
mediapool  137G  27.9T  137G  /mnt/mediapool
mediapool/.system  2.15M  27.9T  256K  legacy
mediapool/.system/configs-f6da24756e2f4dee86c3a9c9fb75829f  236K  27.9T  236K  legacy
mediapool/.system/cores  236K  27.9T  236K  legacy
mediapool/.system/rrd-f6da24756e2f4dee86c3a9c9fb75829f  236K  27.9T  236K  legacy
mediapool/.system/samba4  807K  27.9T  807K  legacy
mediapool/.system/syslog-f6da24756e2f4dee86c3a9c9fb75829f  433K  27.9T  433K  legacy

So, adding one more 3tb drive took me from 22T to 27.9T. I had to add an extra drive but now I've got all the space I was expecting.

Thanks everyone for your help. It's appreciated!

 

[Mirfster]

Does anyone have a suggestion for a PCI controller with 4 SATA ports.

Might want to have a look at @Robert Trevellyan 's "HighPoint Rocket 640L 4 Port HBA" thread. He is testing that controller and things seem to be going good for him.

 

[Mirfster]

After reading the links SweetAndLow posted, I decided to add one more drive to my NAS

So, adding one more 3tb drive took me from 22T to 27.9T. I had to add an extra drive but now I've got all the space I was expecting.

Whoa... Can you let us know how you added this drive? Did you simply make a vDev from one drive and add it to your pool?

Please post the output of the command (in CODE tags): zpool status

 

[Joe Goldthwaite]

Whoa... Can you let us know how you added this drive? Did you simply make a vDev from one drive and add it to your pool?

Please post the output of the command (in CODE tags): zpool status

Since this is a new system and I'm copying all the data from my old one, I just killed the existing pool and created a new one that included the existing drive. I thought about trying to extend the existing pool but I didn't know how and wasn't even sure if I could or what the potential issues would be. I had only copied bout 3.2tb of the 17tb from my old system so I just started from scratch.

Code:

  pool: freenas-boot
 state: ONLINE
  scan: none requested
config:

   NAME  STATE  READ WRITE CKSUM
   freenas-boot  ONLINE  0  0  0
    da0p2  ONLINE  0  0  0

errors: No known data errors

  pool: mediapool
 state: ONLINE
  scan: none requested
config:

   NAME  STATE  READ WRITE CKSUM
   mediapool  ONLINE  0  0  0
    raidz2-0  ONLINE  0  0  0
    gptid/baa5b1e5-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/bb933277-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/bcfa581f-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/be5b0e4b-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/bfbbfd81-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/c1157de1-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/c279d194-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/c3dc64d3-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/c544a7d8-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/c6acad6c-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/c80e2f9c-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/c973f3e4-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0
    gptid/cadcd300-2477-11e6-bcd4-d05099c0e0e3  ONLINE  0  0  0

errors: No known data errors

 

[Mirfster]

Muuuch better. They way you had it before (just adding a single drive vDev to your pool) basically would negate any redundancy for your RaidZ2. Guess you figured that out and made the right modifications. +1 for you. :)

Edit: BTW, I personally would have made it two RaidZ2 vDevs or one large RaidZ3 vdev.

 

[Joe Goldthwaite]

Well...I didn't really figure anything out. I just went with what I knew. Thanks for the comment though. I did some research to understand vDevs better.

My main NAS is used for media and backups of the family's various computers. I have a second older "archive" system that I sync to every couple of weeks. All the really critical stuff, family pictures and movies and such, is backed up to dropbox. The dropbox folder is synced to my notebook, my desktop at work and the NAS device. Since I don't do real time syncing between the production and archive NAS devices I've got some time to recover any dropbox files that are accidentally deleted.

The new system is going to end up at work. Once I get all my data copied over to it, I'm going add more drives to my old system so that it matches the new one. After that, I'm going to add more capacity to the archive NAS. I've got a bunch of older 2tb drives. When I'm done I should have three copies of everything. One at work, a production one at home and a backup archive system also at home.

Having two RaidZ2 vDevs or or a large RaidZ3 vDev would have increased reliability but all in all, I think I've got things backed up pretty well. I figured I could trade some safety for extra space.

 

[Robert Trevellyan]

Having two RaidZ2 vDevs or or a large RaidZ3 vDev would have increased reliability but all in all, I think I've got things backed up pretty well. I figured I could trade some safety for extra space.

It does sound like you have plenty of backups. There is one other advantage of having more vdevs, which is higher IOPS, but that may not matter to you.

Another possible layout would be two 6-disk RAIDZ2 vdevs and one hot spare.

 

[cyberjock]

Wow... using very wide vdevs and recommending Highpoint hardware. I see what happens when I take a vacation from the forums. Wow this place has gone downhill.

 

[Robert Trevellyan]

I don't think "recommending Highpoint" is accurate.