Upgraded my share to 75TB-NFS mounts readonly

[philhu]

Trying to NFS mount the share like this in fstab:
freenas.home:/mnt/volume1 /NFS-FN nfs rw,_netdev,defaults,user,auto,noatime,nfsvers=3,intr 0 0

# mount -a
#df
freenas.home:/mnt/volume1 75550691328 22799385984 52751305344 31% /NFS-FN

But it is readonly:
# cd /NFS-FN
# ls
data home jails VMWare-datastore
# cd data
# touch aa.aa
touch: cannot touch `aa.aa': Read-only file system

Worked fine before the expansion. Tried rebooting the Centos 6.4 box, no luck

Rebooted and still cannot open it rw

Why???

 

[Nick2253]

How is the NFS share configured in FreeNAS?

 

[philhu]

It worked fine before I expanded it. It is 11x4tb as vdev0, raidZ3 and I expanded and added 11x6tb as vdev1
I can write to it in the freenas shell.
From centos, it mounts readonly

[root@freenas] /mnt/volume1# zpool list
NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
freenas-boot 111G 619M 110G - - 0% 1.00x ONLINE -
volume1 100T 29.3T 70.7T - 16% 29% 1.00x ONLINE /mnt
[root@freenas] /mnt/volume1#

[root@freenas] /mnt/volume1# zpool status
pool: freenas-boot
state: ONLINE
scan: resilvered 608M in 0h0m with 0 errors on Mon Jun 13 12:43:10 2016
config:

NAME STATE READ WRITE CKSUM
freenas-boot ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
gptid/7cbdc60f-9f88-11e0-902e-0019b92bb372 ONLINE 0 0 0
ada3p2 ONLINE 0 0 0

errors: No known data errors

pool: volume1
state: ONLINE
scan: scrub repaired 0 in 3h31m with 0 errors on Mon Jun 6 17:11:03 2016
config:

NAME STATE READ WRITE CKSUM
volume1 ONLINE 0 0 0
raidz3-0 ONLINE 0 0 0
gptid/c998b63d-290d-11e6-b18e-0025902ae8aa ONLINE 0 0 0
gptid/cabe3c7b-290d-11e6-b18e-0025902ae8aa ONLINE 0 0 0
gptid/cb560878-290d-11e6-b18e-0025902ae8aa ONLINE 0 0 0
gptid/cbef8b60-290d-11e6-b18e-0025902ae8aa ONLINE 0 0 0
gptid/cc7ea314-290d-11e6-b18e-0025902ae8aa ONLINE 0 0 0
gptid/cd0f5146-290d-11e6-b18e-0025902ae8aa ONLINE 0 0 0
gptid/cd9eac0e-290d-11e6-b18e-0025902ae8aa ONLINE 0 0 0
gptid/ce2a118e-290d-11e6-b18e-0025902ae8aa ONLINE 0 0 0
gptid/cebb4f95-290d-11e6-b18e-0025902ae8aa ONLINE 0 0 0
gptid/cf4ba2ec-290d-11e6-b18e-0025902ae8aa ONLINE 0 0 0
gptid/cfdd85b3-290d-11e6-b18e-0025902ae8aa ONLINE 0 0 0
raidz3-2 ONLINE 0 0 0
gptid/4979d7f2-38c4-11e6-b3f6-0025902ae8aa ONLINE 0 0 0
gptid/4a4c80cc-38c4-11e6-b3f6-0025902ae8aa ONLINE 0 0 0
gptid/4b12e2e9-38c4-11e6-b3f6-0025902ae8aa ONLINE 0 0 0
gptid/4bd76874-38c4-11e6-b3f6-0025902ae8aa ONLINE 0 0 0
gptid/4c972f39-38c4-11e6-b3f6-0025902ae8aa ONLINE 0 0 0
gptid/4d535eb0-38c4-11e6-b3f6-0025902ae8aa ONLINE 0 0 0
gptid/4e7c520d-38c4-11e6-b3f6-0025902ae8aa ONLINE 0 0 0
gptid/4fa6ccf1-38c4-11e6-b3f6-0025902ae8aa ONLINE 0 0 0
gptid/50c3d025-38c4-11e6-b3f6-0025902ae8aa ONLINE 0 0 0
gptid/51e73130-38c4-11e6-b3f6-0025902ae8aa ONLINE 0 0 0
gptid/52a39fee-38c4-11e6-b3f6-0025902ae8aa ONLINE 0 0 0
logs
gptid/e3ff287f-3189-11e6-b68d-0025902ae8aa ONLINE 0 0 0
cache
gptid/d53c311a-3189-11e6-b68d-0025902ae8aa ONLINE 0 0 0

errors: No known data errors

 

[Nick2253]

Again, how is the NFS share set up in FreeNAS?

 

[SweetAndLow]

Again, how is the NFS share set up in FreeNAS?

This^

Who owns the dataset, who is mounting the export and how is that export configured.

 

[philhu]

It was setup using volume manager. The second vdev was added today

I am sharing /mnt/volume1

What else are u looking for?

Dataset owned by philhu. Group users
I added the user and group in the gui

Logged in on centos as philhu same password.

 

[Spearfoot]

It was setup using volume manager. The second vdev was added today

I am sharing /mnt/volume1

What else are u looking for?

Dataset owned by philhu. Group users
I added the user and group in the gui

Logged in on centos as philhu same password.

They want to know how the share was configured: GUI->Sharing->UNIX(NFS)

 

[SweetAndLow]

It was setup using volume manager. The second vdev was added today

I am sharing /mnt/volume1

What else are u looking for?

Dataset owned by philhu. Group users
I added the user and group in the gui

Logged in on centos as philhu same password.

Usernames don't matter the uid is what matters. What is the uid on the client and freenas system.

 

[philhu]

ok, here is the sharing stuff:

 

[Nick2253]

You have the "read only" checkbox checked. That is your problem right there.

 

[philhu]

I didnt change it, it worked before. I will just chalk it up to embarrassment

I tested and working finew

Thank you

 

[philhu]

For completeness. The uid and gid are matched for added users between freenas and centos systems

User 1029. Gid 501

 

[SweetAndLow]

I didnt change it, it worked before. I will just chalk it up to embarrassment

I tested and working finew

Thank you

It likely did work until you changed it then never remounted until you rebooted your box. You also need to create a dataset and export that not the root of your pool. Exporting the root will break stuff eventually.

 

[philhu]

No. Somehow 'all directories' was off and 'readonly' was on. This morning it worked. After adding disks, it seems the chkbox on 'alldir' moved to 'ro box'

Also. Why cant you share the root?

 

[SweetAndLow]

You will end up changing permissions of any jails you have if you use them. And it's just bad practice.

 

[philhu]

Is there docs on this somewhere? I am interested in this

 

[SweetAndLow]

Huh? Not really that is just the way it works. You have a jail dataset under your main dataset and if you change the permissions of the root recursively you break all your jails. Another reason to create multiple datasets is so you can possible share your data using different protocols.

If you use the wizard it does all this dataset creation for you.