Confused about Replication Tasks, snapshots sent

[sfatula]

So, I have a replication task that I thought would only send snapshots matching the snapshot name format. But it's sending other manual snapshots as well (another offsite copy stored in bank vault). Can I avoid sending those manual snapshots? So, here's the replication task definition and the snapshots that exist on both machines. Why is the snapshot with Rotation2 in the name on the destination machine? How can I not use that and only put snapshots matching the format of the automatic snapshot names?

And here is what is on the destination machine:

Code:

zfs list -t snapshot | grep Data
Backup/Replicate/Data@Rotation2-Current         8.03G      -     19.7G  -
Backup/Replicate/Data@auto-2022-10-09_05-30      441M      -     43.4G  -
Backup/Replicate/Data@auto-2022-10-10_05-30      374M      -     43.3G  -
Backup/Replicate/Data@auto-2022-10-11_05-30      447M      -     43.3G  -
Backup/Replicate/Data@auto-2022-10-12_05-30      449M      -     30.4G  -
Backup/Replicate/Data@auto-2022-10-13_05-30      450M      -     30.4G  -
Backup/Replicate/Data@auto-2022-10-14_05-30      694M      -     51.1G  -
Backup/Replicate/Data@auto-2022-10-15_05-30        0B      -     61.6G  -

And the source machine:

Code:

zfs list -t snapshot | grep Data | column -t
tank/Data@Rotation2-Current      8.08G  -  19.9G  -
tank/Data@auto-2022-10-09_05-30  458M   -  43.7G  -
tank/Data@auto-2022-10-10_05-30  387M   -  43.6G  -
tank/Data@auto-2022-10-11_05-30  461M   -  43.6G  -
tank/Data@auto-2022-10-12_05-30  463M   -  30.7G  -
tank/Data@auto-2022-10-13_05-30  464M   -  30.8G  -
tank/Data@auto-2022-10-14_05-30  716M   -  51.9G  -
tank/Data@auto-2022-10-15_05-30  5.70M  -  62.8G  -

 

[winnielinnie]

But it's sending other manual snapshots as well

From my understanding, when using "Full Filesystem Replication" the first pass is going to send everything, including intermediary snapshots that don't match the expression.

 

[sfatula]

But if I had created the manual snapshot after the first full replication, it would not be sent right?

How else would you get the first full replication without the full option? and have it include child datasets, properties, etc?

What I actually want (and may not be possible) is everything to be sent on the full except manual snapshots (that don't match the naming scheme). Not possible?

 

[winnielinnie]

I had the opposite frustration with how zettarepl (the underlying software) handles replications. I want subsequent incremental replications to also include intermediary/manual snapshots for a true backup:

[NAS-109476] - iXsystems TrueNAS Jira

ixsystems.atlassian.net

As it stands now, this is how it behaves:

First time running the replication as a "Full Filesystem Replication"? It sends everything over. (Because of "-R").

Subsequent runs? It only uses snapshots created by the selected snapshot tasks as well as any additional snapshots in the "parsing" rules that match the expression you provide; while it will exclude everything else. (Because of "-i").

Honestly, I find the Replication Tasks in TrueNAS lack the flexibility or granularity needed to satisfy different use-cases.

Wish I had a better answer for you.

It might be different for SCALE,. and there may be an option to "toggle" or override this behavior?

 

[sfatula]

I agree. Thanks for the detailed info.

The screenshot is in the original post of all the options, don't see anything there but don't know what core looks like for differences.

I've been having trouble as twice a week or so, it decides to send everything again and starts over. Not sure why yet. I tweaked a few options so will pursue if it remains an issue.