After Replacing a HDD in Zpool, Data usage skyrockets to 91%.

[mike360x1]

Hi,

So I've recently just replaced the last old harddrive in my system and have ZFS auto expand to accommodate the new size of the array. (The array had 1 500GB HDD with a array of 3TB Drives + 1 1TB Drive. Don't ask me why).

And so, after a day or so, I get a message from the server. It says,

Code:

Critical Alerts: 
The capacity for the volume 'Default' is currently at 91%, while the recommended value is below 80%.

For context, this is a image of my pool.
[refer to attachment]

Notice how the size of each individual data set does not add up to the total space used by the pool? So, I am guessing the unknown data must be from somewhere else.

First thing I do is, I check my snapshots because recently, I've been changing the permissions of the data sets around. (I'm not sure if that affects snapshot size)
I notice that there are a few files that refer to around 1TB of space. I have deleted them and see no change yet.

That's all I can think of.

If there are any suggestions, I would greatly appreciate the support :).

Thanks in advance,
Michael

 

[danb35]

Notice how the size of each individual data set does not add up to the total space used by the pool?

Yes, actually, it does. The top line is the "raw" space of your pool; the second accounts for parity. See http://doc.freenas.org/9.10/storage.html#view-volumes for a bit more detail.

I notice that there are a few files that refer to around 1TB of space. I have deleted them and see no change yet

Snapshots.

 

[mike360x1]

Yes, actually, it does. The top line is the "raw" space of your pool; the second accounts for parity. See http://doc.freenas.org/9.10/storage.html#view-volumes for a bit more detail.

Snapshots.

Okay, I see what you mean.

and yes, snapshots. I meant to say that ;)

Okay, I realize my error now. The dataset Default/Personal/Michael isn't actually 1.3TB. It only contains about 186GB of files.
And somehow, my Media Dataset made itself a copy and pasted it into my Default/Personal/Michael Dataset. I'm not sure why.

not 100% certain if its actually files or if its just a pointer to the media directory. But it does say that it takes up 1.3TB of space. So I'm assuming its actually a copy?

Is there anyway to find out what copied those files over?

 

[SweetAndLow]

hmmm you copied those files over, files just don't magically get up and move. you can look at zpool history and history to track down everyting you have done on the CLI.

 

[mike360x1]

I've tried history, (Via SSH) but that only pulls up the commands executed within that one session. Do I need to execute that command within server console?

I've also included a log of Zpool history in the attachments. I see alot of snapshot creation and removal. But nothing about copying a large file(s). Is there some specific keyword I can filter for?

Also, This problem came to my attention at around sep 19 12:00am when I got an email from freenas. So I'm guessing it happened around that time. I searched those times too. and nothing out of the ordinary came up.

 

[mike360x1]

Update:

I have gone ahead and just deleted the additional 1.3TB copy of my media files. I will see where it takes me and If it happens again.

This is quite a strange anomaly that I have not yet solved.

One possibility could be that the Amazon S3cmd plugin may have somehow made a copy of the files in my /Default/Personal/Michael Dataset. I don't know how I can find out if that was the cause.

Either way, I will report back if this happens again.