This is the second time this has happened, now I’m trying to figure out why.
I transferred approximately 65GB of Design Assets from one of my workstations, to my main FreeNAS server.
I then began to work on a project with some of these assets (video clips, photos) I transferred to the server. All was fine, initially, working with the transferred assets. Then, I came to a stopping point, stopped to eat dinner, then after dinner, I began to work on the aforementioned projects again.
Upon beginning to work again, I discovered all of the data I had just transferred, was gone. A few items I recently deleted were back in place. A few files I recently had moved, were also back in place. It was as if every file that had been changed, created, deleted in a period of about an hour were suddenly negated/reversed.
This happened once before, and at the time i chalked it up to my own error, ie maybe I transferred to another FreeNAS server by accident and didn’t realize it. I probably should have analyzed and took a deeper look the first time, but mistakes happen.
—> server/FreeNAS specs
The server in question, is on 11.3; At the time, it was in the process of a scrub, which completed without error. The dataset was sharing via SMB to a Mac Pro Server running MacOS Catalina. Dataset has sync writes disabled. (This is my only hypothesis as to the issue. But why???)
Hardware: Supemicro Superserver, Dual Xeon-W, 1TB RAM. Pool A is 24 16tb Seagate Exos HDD’s in an 8 VDEV 3-way mirror, Optane 900P SLOG. Pool B is 5 8tb Micron NvME. Pool B replicates hourly to Pool A. (Between the replication that was in process and a time machine backup to another FreeNAS server that was nearly complete, I was able to recover all lost data).
I want to make sure this doesn’t happen again.
I’m turning sync writes back on. This is the likely reason, but I still want to know why.
There was no power failure, no network failure, no disk failure. I assume if it was a RAM error, I would have been notified?
how can I further investigate?
I transferred approximately 65GB of Design Assets from one of my workstations, to my main FreeNAS server.
I then began to work on a project with some of these assets (video clips, photos) I transferred to the server. All was fine, initially, working with the transferred assets. Then, I came to a stopping point, stopped to eat dinner, then after dinner, I began to work on the aforementioned projects again.
Upon beginning to work again, I discovered all of the data I had just transferred, was gone. A few items I recently deleted were back in place. A few files I recently had moved, were also back in place. It was as if every file that had been changed, created, deleted in a period of about an hour were suddenly negated/reversed.
This happened once before, and at the time i chalked it up to my own error, ie maybe I transferred to another FreeNAS server by accident and didn’t realize it. I probably should have analyzed and took a deeper look the first time, but mistakes happen.
—> server/FreeNAS specs
The server in question, is on 11.3; At the time, it was in the process of a scrub, which completed without error. The dataset was sharing via SMB to a Mac Pro Server running MacOS Catalina. Dataset has sync writes disabled. (This is my only hypothesis as to the issue. But why???)
Hardware: Supemicro Superserver, Dual Xeon-W, 1TB RAM. Pool A is 24 16tb Seagate Exos HDD’s in an 8 VDEV 3-way mirror, Optane 900P SLOG. Pool B is 5 8tb Micron NvME. Pool B replicates hourly to Pool A. (Between the replication that was in process and a time machine backup to another FreeNAS server that was nearly complete, I was able to recover all lost data).
I want to make sure this doesn’t happen again.
I’m turning sync writes back on. This is the likely reason, but I still want to know why.
There was no power failure, no network failure, no disk failure. I assume if it was a RAM error, I would have been notified?
how can I further investigate?
