TrueNAS 13 - Cloud backup to SFTP

[osalj]

Hi,

I am having a problem while backing up my data from the TrueNAS server.

I want to back up the /mnt/HDD2TB folder
This folder is 181GB in size.

When I run the file copy script in the "Cloud Sync Tasks" section, the size of this copy is currently 396GB (and still growing).

How is this possible since this folder is 181GB in size?

If you more info please let me know

 

[Samuel Tai]

Snapshots? Compression enabled on the folder?

 

[sretalla]

None of those... at least I don't think so. This isn't ZFS replication, so no snapshots to consider here. File sizes are calculated in full, so compression shouldn't be involved either.

I have noticed that the way it works is multi-threaded, but also sensitive to failures.

So what will happen is with several connections to the target open simultaneously, one or more of the transfers will fail, but that isn't detected until the file is checked after completion, meaning it starts again after completing (and just adds back to the queue, hence increasing beyond the total size to transfer that you thought would be possible).

My replica set isn't nearly that large, so I haven't bothered to figure it out yet, but I expect what I'd be looking for is a way to force it to copy only one file at a time to reduce the failures.

 

[osalj]

Config for Cloud Sync Task

 

[osalj]

This TrueNAS is a VM on my ESXI 7.0.3 server.
This VM is assigned two disks in RAID5. 1x 6TB and 1x 2TB
These disks are created on the RAID controller. RAID5 with 4x 4TB

On this 2TB I have important data, on the 6TB there are movies and music

 

[osalj]

And error on the end :(