Replication sending more data than necessary.

[Jedi940]

Current version is 11.2 U3. If I can get these snapshots replicated, I will be updating to 11.2 U8 and then begin testing the upgrade to 11.3

I have replication set up between 2 freenas boxes and it seems to be sending way more data than necessary. The current snapshot being replicated has already sent around 715GB of data over the last 24 hours and is only 20% done. I feel like I might have something mis-configured. I have found many different threads talking about speed of replication of incremental vs full but none that address the size. I don't know if this is a ZFS thing that I haven't learned yet or if there is something I did wrong while setting it up.

Here is the current snapshot that is being replicated:

Code:

root@ppuprfreenas[/mnt/Veeam1]# zfs list -t all -r -o space,refer Veeam1/Bkup_CP_Fileserver@auto-20200206.1200-30d
NAME                                              AVAIL   USED  USEDSNAP  USEDDS  USEDREFRESERV  USEDCHILD  REFER
Veeam1/Bkup_CP_Fileserver@auto-20200206.1200-30d      -  12.8G         -       -              -          -  28.9T

It is only taking up 12.8 GB of space. Why is is sending so much data? It can't be replicating everything as 715GB is not 20% of 28.9T.

Here is the snapshot setup:

Here is the replication setup:

Please let me know if there is any other data that would be helpful.

 

[Jedi940]

Could anyone point me in the direction of some resources on this? I am currently in the middle of replicating a 14.5GB snapshot that appears it is going to take 5 days over a 100Mbps link. That just seems excessive.

 

[GEOptic]

Good day Jedi940

I do have the same situation ...
Well, SnapShots is about 33 MB ...
The replication task is sending 95GB.
It almost always fail, because is goes thru VPN on 50Mbps link...

Did you find an explanation, solution, work around ?

Show : Systems Config

Main storage System : (IXR2212)
FreeNAS-11.2-U6
Intel(R) Xeon(R) CPU E5-2603 v4 @ 1.70GHz (6 cores)
64 GiB
Vol1:
raidz2-0 : 6 x 4TB
raidz2-1 : 6 x 4TB

Second storage for replication (Mini-XL)
FreeNAS-11.2-U6
Intel(R) Atom(TM) CPU C2750 @ 2.40GHz (8 cores)
32 GiB
RepVol1:
raidz2-0 : 8 x 6TB