SOLVED Volume not expanding after HD upgrade

[Noxx]

I've followed the guides from http://doc.freenas.org/9.3/freenas_storage.html#replacing-drives-to-grow-a-zfs-pool and the replacement and resilvering of the drives went fine.

• I replaced 5 4TB drives with 5 8TB drives.
• When I View Disks, all drives show up as online with 8TB Disk Size
  
• I verified that autoexpand was on for my volume before I replaced the disks.
• I've tried running the online -e command for all disks.
• I've rebooted the system multiple times.

No matter what I've tried, every time I go into Storage, the size of my volume has not changed.

Please Halp

 

[danb35]

Output of zpool status and zpool list?

 

[Noxx]

Output of zpool status and zpool list?

Code:

pool: vol1
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
		still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
		the pool may no longer be accessible by software that does not support
		the features. See zpool-features(7) for details.
  scan: resilvered 2.78T in 13h5m with 0 errors on Tue Aug 14 21:44:16 2018config:

		NAME											STATE	 READ WRITE CKSUM
		vol1											ONLINE	   0	 0	 0
		  raidz1-0									  ONLINE	   0	 0	 0
			gptid/230baa7d-9fd8-11e8-859b-60a44cb0bf8d  ONLINE	   0	 0	 0
			gptid/14853008-9f59-11e8-859b-60a44cb0bf8d  ONLINE	   0	 0	 0
			gptid/92b2c136-9ebf-11e8-859b-60a44cb0bf8d  ONLINE	   0	 0	 0
			gptid/dd6120ca-9e3f-11e8-859b-60a44cb0bf8d  ONLINE	   0	 0	 0
			gptid/199dd74c-9db7-11e8-859b-60a44cb0bf8d  ONLINE	   0	 0	 0

errors: No known data errors

Code:

NAME		   SIZE  ALLOC   FREE  EXPANDSZ   FRAG	CAP  DEDUP  HEALTH  ALTROOT
freenas-boot  29.8G  1.57G  28.2G		 -	  -	 5%  1.00x  ONLINE  -
vol1		  18.1T  13.9T  4.26T		 -	11%	76%  1.00x  ONLINE  /mnt

 

[Noxx]

I may have figured out why it's not expanding. I ran gpart list and this was the output.

Code:

=>	  34  62530557  da0  GPT  (29G)
		34	  1024	1  bios-boot  (512k)
	  1058		 6	   - free -  (3.0k)
	  1064  62529520	2  freebsd-zfs  (29G)
  62530584		 7	   - free -  (3.5k)

=>		 34  15628053101  ada0  GPT  (7.3T)
		   34		   94		- free -  (47k)
		  128	  4194304	 1  freebsd-swap  (2.0G)
	  4194432  15623858696	 2  freebsd-zfs  (7.3T)
  15628053128			7		- free -  (3.5k)

=>		 34  15628053101  ada1  GPT  (7.3T)
		   34		   94		- free -  (47k)
		  128	  4194304	 1  freebsd-swap  (2.0G)
	  4194432  15623858696	 2  freebsd-zfs  (7.3T)
  15628053128			7		- free -  (3.5k)

=>		 34  15628053101  ada2  GPT  (7.3T)
		   34		   94		- free -  (47k)
		  128	  4194304	 1  freebsd-swap  (2.0G)
	  4194432  15623858696	 2  freebsd-zfs  (7.3T)
  15628053128			7		- free -  (3.5k)

=>		 34  15628053101  ada3  GPT  (7.3T)
		   34		   94		- free -  (47k)
		  128	  4194304	 1  freebsd-swap  (2.0G)
	  4194432  15623858696	 2  freebsd-zfs  (7.3T)
  15628053128			7		- free -  (3.5k)

=>		 34  15628053101  ada4  GPT  (7.3T)
		   34		   94		- free -  (47k)
		  128	  4194304	 1  freebsd-swap  (2.0G)
	  4194432   7809842696	 2  freebsd-zfs  (3.7T)
   7814037128   7814016007		- free -  (3.7T)

Notice ada4 is only reporting 3.7T where all the others are 7.3T.

Is there something I can do to remedy that, or am I going to have to rebuild that drive and cross my fingers?

 

[Jailer]

I would try off lining that drive and bring it back on line again from the GUI.

 

[Noxx]

Ok, not sure what was going on with the drive - short story, it's fixed.

Long story (for conciseness):

• I offlined the drive, then tried to online it and got an Unavailable disk
• I ran a drive test via smartctl -t short /dev/ada4 to validate the drive and everything checked out
• A restart resolved the Unavailable issue, and left me with a checksum of 1 which was resolved with zpool clear vol1
• gpart show told me ada4 was reporting the same info as the other ada's :)
  
• I checked the size of the pool and it was still at the size before the upgrade
• In the terminal I ran
  
  Code:

  zpool online -e vol1 gptid/230baa7d-9fd8-11e8-859b-60a44cb0bf8d gptid/14853008-9f59-11e8-859b-60a44cb0bf8d 
  gptid/92b2c136-9ebf-11e8-859b-60a44cb0bf8d gptid/dd6120ca-9e3f-11e8-859b-60a44cb0bf8d gptid/a17f9e4a-a157-11e8-954b-60a44cb0bf8d
  

  (the gptid's were obtained from zpool status)
• Checked the size again via zpool list and finally, I'm now seeing the extended space
  
  Code:

  NAME		   SIZE  ALLOC   FREE  EXPANDSZ   FRAG	CAP  DEDUP  HEALTH  ALTROOT		  
  freenas-boot  29.8G  1.57G  28.2G		 -	  -	 5%  1.00x  ONLINE  -				
  vol1		  36.4T  13.9T  22.5T		 -	 5%	38%  1.00x  ONLINE  /mnt