speeding up rsync task

William Bravin

Contributor
Joined
Mar 16, 2016
Messages
194
Replication uses zfs send|recv (which is behind the zettarepl command used as a front-end for it).

See the commentary in this thread about that.
thank you this i understand however i still need an opinion on replication. will i see the same folders and subfolders in the target system of will all the information be compressed?

with regards tyo the speed i will educate myself on the solution provided by @Constantin using a 10gb direct connecttion and i will need to bone up on l2arc (i do even know what this does.

Thank you
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,700
will i see the same folders and subfolders in the target system of will all the information be compressed?
Replication is a block-level thing, so every block you have on the sending side will be there on the replica side too.

The complication is in how things like snapshots are mounted (and everything on the replica side will typically be read-only... if you want your replication to continue working, that's essential).

Replication can be incremental, so only changed blocks will be sent (which can help with large files where only parts of them are changing).
 

William Bravin

Contributor
Joined
Mar 16, 2016
Messages
194
Replication is a block-level thing, so every block you have on the sending side will be there on the replica side too.

The complication is in how things like snapshots are mounted (and everything on the replica side will typically be read-only... if you want your replication to continue working, that's essential).

Replication can be incremental, so only changed blocks will be sent (which can help with large files where only parts of them are changing).
thank you very much for this explanation this is what i needed to know. In my case i do want to have on bothe server the ability to RWC. therefore as i interpret this i will stick to using rsync. To improve my sittuation in will be purchassing an additional sunmicro server and install a 10GB NIC and incr3easing the size of ram to 64 on each server. as @Constantin suggested (thank you)

I hope this will substantially reduce the time needed to duplicate my data from 1 server to an other.

Again many thanks for yopur help and patience
 
Top