How to build one big volume and dataset?

[vitaly_il]

I have a Supermicro box with 12 * 2TB drives, with Freenas9.3.
My goal is to build one big dataset; using RAIDZ2 it should be about 18TB usable space.
I tried to build it using FreeNAS GUI, with the same result - I received dataset about 12TB.

I was able to build volume manually (zpool create -f newpool raidz2 /dev/da0 /dev/da1 /dev/da2 /dev/da3 /dev/da4 /dev/da5 /dev/da6 /dev/da7 /dev/da8 /dev/da9 /dev/da10 /dev/da11), in this case I received fs with expected size, but cannot manage it via FreeNAS.

Did I miss something basic?

TIA,
Vitaly

 

[depasseg]

Don't build it manually. Use the GUI.

 

[vitaly_il]

depasseg, thank you.

I have no problem with using GUI as far as I understand what is doing and I'm able to reach my goal. Can you recommend some way for building a dataset with max capacity?

 

[depasseg]

Max capacity (i.e. striped w/o protection) or RAID Z2?
Use the storage wizard in the GUI to add all your drives and apply whatever choice you want- RAIDZ2, Stripes, Mirrors

 

[vitaly_il]

I want to use RAIDZ2.
In fact, it seems that I'm receiving a volume 19TB, but for some reason I cannot create a dataset bigger than 11-12TB.

 

[depasseg]

Are you sure all 12 drives are in a RAIDZ2 pool? When you drag the slider across, is there 1 row or 2? Can you post a screenshot of the wizard when you are creating the pool?

The dataset isn't limited in size. It will be the size of the pool that it is in.

 

[SweetAndLow]

If your pool is 19TB then that is your space. You probably aren't calculating your dataset size correctly for some reason. Dataset storage capacity gets confusing for people, how are you measuring it?

I would also like to point out that creating a single rapidZ2 with 12 drives isn't suggests. Most people would do 2 raidZ2 vdevs of 6 drives each. You get better performance and better protection.

 

[vitaly_il]

I'm attaching FreeNAS screenshot.

>Dataset storage capacity gets confusing for people, how are you measuring it?
it's that I see into FreeNAS GUI and "df" command.

 

[pirateghost]

I don't understand the issue here.

You have 12 drives. You want raidz2. Each drive is only around 1.8 tib, x 10 = 18-19 tib

Seems correct to me.

 

[vitaly_il]

thanks, pirateghost for your answer.
I have no problem with 19TB volume, but I want 19TB filesystem too. As far as I understand, in zfs world dataset it's filesystem...

 

[pirateghost]

What are your settings for your new dataset?

 

[vitaly_il]

compression : off
deduplication : off
reserved space: 0

 

[pirateghost]

Do you have snapshots enabled?

 

[vitaly_il]

no, I just created this volume, no snapshots.

 

[SweetAndLow]

What is pool in your screenshot and why is it all messed up? Could you delete everything and start from scratch so there are less variable and we might be able to give better feedback. Are you using quotas?

 

[vitaly_il]

pool is the default volume created during installation by wizard.
When I saw that my "pool" dataset is too small, I deleted pool volume and dataset using command line and tried to re-create volume and dataset.
As I wrote, I'm able to create 19TB filesystem when I'm using command-line, but not GUI.

Not, I'm not using quota.

 

[SweetAndLow]

You need to make the pool using the GUI, the cli doesn't do it the way freenas wants. When you created it using the GUI did you select raidz2? After you have created your pool please post the output of zpool status and zpool list in code tags.

 

[vitaly_il]

Yes, filer02 volume and dataset are created via GUI.
Please see output below:

Code:

zpool status

  pool: filer02

state: ONLINE

  scan: none requested

config:

   NAME  STATE  READ WRITE CKSUM

   filer02  ONLINE  0  0  0

    raidz2-0  ONLINE  0  0  0

    gptid/06e24af5-846e-11e4-abed-002590caf644  ONLINE  0  0  0

    gptid/07ffdb7b-846e-11e4-abed-002590caf644  ONLINE  0  0  0

    gptid/0919c9fd-846e-11e4-abed-002590caf644  ONLINE  0  0  0

    gptid/0a2f9344-846e-11e4-abed-002590caf644  ONLINE  0  0  0

    gptid/0b4b13f2-846e-11e4-abed-002590caf644  ONLINE  0  0  0

    raidz2-1  ONLINE  0  0  0

    gptid/0c633f87-846e-11e4-abed-002590caf644  ONLINE  0  0  0

    gptid/0d7d73a8-846e-11e4-abed-002590caf644  ONLINE  0  0  0

    gptid/0e967d9b-846e-11e4-abed-002590caf644  ONLINE  0  0  0

    gptid/0fa9d5ae-846e-11e4-abed-002590caf644  ONLINE  0  0  0

    gptid/10c8bcb6-846e-11e4-abed-002590caf644  ONLINE  0  0  0

    mirror-2  ONLINE  0  0  0

    gptid/11e36d35-846e-11e4-abed-002590caf644  ONLINE  0  0  0

    gptid/13033b07-846e-11e4-abed-002590caf644  ONLINE  0  0  0

errors: No known data errors

  pool: freenas-boot

state: ONLINE

  scan: none requested

config:

   NAME  STATE  READ WRITE CKSUM

   freenas-boot  ONLINE  0  0  0

    ada0p2  ONLINE  0  0  0

errors: No known data errors

Code:

 zpool list
NAME  SIZE  ALLOC  FREE  EXPANDSZ  FRAG  CAP  DEDUP  HEALTH  ALTROOT
filer02  19.9T  884K  19.9T  -  0%  0%  1.00x  ONLINE  /mnt
freenas-boot  29.8G  942M  28.8G  -  -  3%  1.00x  ONLINE  -

 

[SweetAndLow]

I'm not sure why you created 3 vdevs for your pool but what ever that is your decision. I have a theory as to why you are seeing the size difference and it involves the fact that you have been messing around with the drives and aren't really sure what you are doing. You need to wipe the drives and start over with a fresh install of freenas and created the pool with 2 vdevs of raidz2 with 6 drives each. Come back after you have a normal non messed with pool.

 

[vitaly_il]

Thank you all for your patience!

>I'm not sure why you created 3 vdevs for your pool
I just used "create pool" menu w/o any special settings.

>You need to wipe the drives and start over with a fresh install of freenas
I understand your point, but IMHO it's a little weird method in *nix world...
And BTW, just after fresh install I had the same issue.
I think I'll either find a way to extend my filesystem w/o reinstall or go to some linux NAS.