Help with two-way remote mirror solution with TrueNAS Scale

[marcelsan]

Hello all,

We currently have 2 servers and are planning to implement a two-way mirror solution to host our music collection, which currently have 18TB of data.

• The Server 1 (S1) is up and running FreeNAS 11.2-U6 booted in a single SSD Disk, and has a RAID Z1. It has a total of 4 x 10 TB disks = 40.0 TB with 27.93 TB available space. We currently have only one jail active with Airsonic running on it and we have SMB service configured and in use.

• The Server 2 (S2) is about to be assembled, and will have a total of 3 x 16 TB disks = 48.0 TB / with 30.88 TB planned available space in a RAID Z1 config. It will be placed at a remote location.

We have some questions, and would appreciate your advice on the following:

1. We plan to use TrueNAS Scale 22.12.3.3 on S1 and S2, and we plan to implement a two-way remote mirror of data between the servers. Our main goal is to be able to upload data on S1 and on S2, and to be able to mirror the files so that they will be accessible on both servers and serve as a redundancy to one another.
We thought of setting up daily Replication Tasks with SSH to do the mirroring. Telling S1 to PUSH data to S2, and telling S2 to PUSH data to S1 each night. Will this configuration work to make the all files accessible on both servers?
Will this cause any sort of conflict?
Should we configure the scheduling of each Replication Task in a different time on each server? Eg. S1 at 1 AM, S2 at 4 AM.
Or should we use a different method, such as RSYNC?

2. As stated above we plan to use TrueNAS Scale 22.12.3.3 on S1. Should we update the FreeNAS 11.2-U6 to TrueNAS Scale, to retaing the configs and other settings, or should we do a fresh install (After having moved all the files to S2.)

3. Lastly, to transfer the 18TB of data for the first time from S1 to S2, considering we only have 1GB NICs on each server, and a 10GBE router, which method would be the most recommended, and which one is faster? Should we use WGET command? Or Rsync? Or a one-time replication task?
(Note that to do this first transfer we are going to place the servers on the same location and LAN network for a few days.)

Thanks in advance. Best regards, Marcel!

 

[morganL]

Hello all,

We currently have 2 servers and are planning to implement a two-way mirror solution to host our music collection, which currently have 18TB of data.

• The Server 1 (S1) is up and running FreeNAS 11.2-U6 booted in a single SSD Disk, and has a RAID Z1. It has a total of 4 x 10 TB disks = 40.0 TB with 27.93 TB available space. We currently have only one jail active with Airsonic running on it and we have SMB service configured and in use.

• The Server 2 (S2) is about to be assembled, and will have a total of 3 x 16 TB disks = 48.0 TB / with 30.88 TB planned available space in a RAID Z1 config. It will be placed at a remote location.

We have some questions, and would appreciate your advice on the following:

1. We plan to use TrueNAS Scale 22.12.3.3 on S1 and S2, and we plan to implement a two-way remote mirror of data between the servers. Our main goal is to be able to upload data on S1 and on S2, and to be able to mirror the files so that they will be accessible on both servers and serve as a redundancy to one another.
We thought of setting up daily Replication Tasks with SSH to do the mirroring. Telling S1 to PUSH data to S2, and telling S2 to PUSH data to S1 each night. Will this configuration work to make the all files accessible on both servers?
Will this cause any sort of conflict?
Should we configure the scheduling of each Replication Task in a different time on each server? Eg. S1 at 1 AM, S2 at 4 AM.
Or should we use a different method, such as RSYNC?

2. As stated above we plan to use TrueNAS Scale 22.12.3.3 on S1. Should we update the FreeNAS 11.2-U6 to TrueNAS Scale, to retaing the configs and other settings, or should we do a fresh install (After having moved all the files to S2.)

3. Lastly, to transfer the 18TB of data for the first time from S1 to S2, considering we only have 1GB NICs on each server, and a 10GBE router, which method would be the most recommended, and which one is faster? Should we use WGET command? Or Rsync? Or a one-time replication task?
(Note that to do this first transfer we are going to place the servers on the same location and LAN network for a few days.)

Thanks in advance. Best regards, Marcel!

Syncthing App on SCALE is the best tool for this type of job.... two-way sync with read/write access on each system.

 

[NugentS]

I'll second that. You will break replication changing both sides of the network link. You can use snapshots on both sides to keep recovery points in case the sync gets fubar'd but do not try to replicate them

 

[sretalla]

Syncthing App on SCALE is the best tool for this type of job.... two-way sync with read/write access on each system.

Recently published how-to:

Introducing Syncthing Enterprise With TrueNAS

In the ~30 years since networked storage emerged, organizations have complained about -- and surrendered to -- the limits and complexities associated with mo...

www.youtube.com

 

[marcelsan]

Thank you all for the answers. @sretalla Very informative video!

Any advices on questions 2 and 3? We've just finished installing Truenas on server 2 and are about to move the data.