help, my (replication) pipe is clogged

[Rich B]

...but seriously, does anyone know if cifs .recycle hidden directory (which I've enabled via the CIFS Shares configuration page with the "Export Recycle Bin" checkbox) is included in snapshots?

I ask because I recently generated a large volume of recycle files (1.4T) on my local freenas box (freenas01, the PUSH side) and now the 5 Mbps pipe to my off site replication box (freenas02, the PULL side) is all clogged up, presumably because it's replicating the .recycle changes.

This all makes sense in terms of overall concepts (bandwidth, snapshotting changes, etc.), but the problem I'm struggling with is that I can't figure out a GUI path or terminal command that will validate what's actually being replicated.

What is the command or GUI location that tells me what's in the replication pipe/queue and how much remains in the queue including CIFS .recycle contents?

The command below is the best way I currently know to list snapshots for the dataset under consideration. As you can see, the giant .recycle folder is unaccounted for within this listing.

=======================================================================


[freenas01]~# zfs list -r -t snapshot zfs01 | zfs get -H used,freenas:state | grep Departments

zfs01/Data/Departmentsused2.17T-
zfs01/Data/Departmentsfreenas:state--
zfs01/Data/Departments@auto-20140305.0100-1mused24.2M-
zfs01/Data/Departments@auto-20140305.0100-1mfreenas:state--
zfs01/Data/Departments@auto-20140306.0100-1mused7.50M-
zfs01/Data/Departments@auto-20140306.0100-1mfreenas:state--
zfs01/Data/Departments@auto-20140307.0100-1mused5.77M-
zfs01/Data/Departments@auto-20140307.0100-1mfreenas:state--
zfs01/Data/Departments@auto-20140308.0100-1mused3.59M-
zfs01/Data/Departments@auto-20140308.0100-1mfreenas:state--
zfs01/Data/Departments@auto-20140309.0100-1mused744K-
zfs01/Data/Departments@auto-20140309.0100-1mfreenas:state--
zfs01/Data/Departments@auto-20140310.0100-1mused0-
zfs01/Data/Departments@auto-20140310.0100-1mfreenas:state--
zfs01/Data/Departments@auto-20140310.1112-1mused0-
zfs01/Data/Departments@auto-20140310.1112-1mfreenas:state--
zfs01/Data/Departments@auto-20140310.1117-1mused0-
zfs01/Data/Departments@auto-20140310.1117-1mfreenas:state--
zfs01/Data/Departments@auto-20140310.1122-1mused0-
zfs01/Data/Departments@auto-20140310.1122-1mfreenas:state--
zfs01/Data/Departments@auto-20140310.1127-1mused0-
zfs01/Data/Departments@auto-20140310.1127-1mfreenas:state--
zfs01/Data/Departments@auto-20140310.1132-1mused0-
zfs01/Data/Departments@auto-20140310.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140311.1132-1mused4.93M-
zfs01/Data/Departments@auto-20140311.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140312.1132-1mused5.11M-
zfs01/Data/Departments@auto-20140312.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140313.1132-1mused5.49M-
zfs01/Data/Departments@auto-20140313.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140314.1132-1mused6.57M-
zfs01/Data/Departments@auto-20140314.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140315.1132-1mused1.81M-
zfs01/Data/Departments@auto-20140315.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140316.0000-3mused564K-
zfs01/Data/Departments@auto-20140316.0000-3mfreenas:state--
zfs01/Data/Departments@auto-20140316.1132-1mused878K-
zfs01/Data/Departments@auto-20140316.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140317.1132-1mused6.14M-
zfs01/Data/Departments@auto-20140317.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140318.1132-1mused9.13M-
zfs01/Data/Departments@auto-20140318.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140319.1132-1mused5.23M-
zfs01/Data/Departments@auto-20140319.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140320.1132-1mused26.7M-
zfs01/Data/Departments@auto-20140320.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140321.1132-1mused67.8M-
zfs01/Data/Departments@auto-20140321.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140322.1132-1mused1.60M-
zfs01/Data/Departments@auto-20140322.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140323.0000-3mused651K-
zfs01/Data/Departments@auto-20140323.0000-3mfreenas:state--
zfs01/Data/Departments@auto-20140323.1132-1mused976K-
zfs01/Data/Departments@auto-20140323.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140324.1132-1mused3.95M-
zfs01/Data/Departments@auto-20140324.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140325.1132-1mused284M-
zfs01/Data/Departments@auto-20140325.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140326.1030-1dused2.78M-
zfs01/Data/Departments@auto-20140326.1030-1dfreenas:stateLATESTlocal
zfs01/Data/Departments@auto-20140326.1132-1mused3.31M-
zfs01/Data/Departments@auto-20140326.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140327.1132-1mused8.72M-
zfs01/Data/Departments@auto-20140327.1132-1mfreenas:state--
zfs01/Data/Departments@auto-20140331.1405-1mused5.89M-
zfs01/Data/Departments@auto-20140331.1405-1mfreenas:state--
zfs01/Data/Departments@auto-20140331.1505-1dused2.57M-
zfs01/Data/Departments@auto-20140331.1505-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.1535-1dused2.35M-
zfs01/Data/Departments@auto-20140331.1535-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.1605-1dused2.54M-
zfs01/Data/Departments@auto-20140331.1605-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.1635-1dused2.19M-
zfs01/Data/Departments@auto-20140331.1635-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.1705-1dused1.74M-
zfs01/Data/Departments@auto-20140331.1705-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.1735-1dused1.77M-
zfs01/Data/Departments@auto-20140331.1735-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.1805-1dused116K-
zfs01/Data/Departments@auto-20140331.1805-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.1835-1dused227K-
zfs01/Data/Departments@auto-20140331.1835-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.1905-1dused0-
zfs01/Data/Departments@auto-20140331.1905-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.1935-1dused0-
zfs01/Data/Departments@auto-20140331.1935-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.2005-1dused0-
zfs01/Data/Departments@auto-20140331.2005-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.2035-1dused0-
zfs01/Data/Departments@auto-20140331.2035-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.2105-1dused0-
zfs01/Data/Departments@auto-20140331.2105-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.2135-1dused0-
zfs01/Data/Departments@auto-20140331.2135-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.2205-1dused0-
zfs01/Data/Departments@auto-20140331.2205-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.2235-1dused0-
zfs01/Data/Departments@auto-20140331.2235-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.2305-1dused0-
zfs01/Data/Departments@auto-20140331.2305-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140331.2335-1dused0-
zfs01/Data/Departments@auto-20140331.2335-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.0600-1dused116K-
zfs01/Data/Departments@auto-20140401.0600-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.0630-1dused273K-
zfs01/Data/Departments@auto-20140401.0630-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.0700-1dused128K-
zfs01/Data/Departments@auto-20140401.0700-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.0730-1dused238K-
zfs01/Data/Departments@auto-20140401.0730-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.0800-1dused140K-
zfs01/Data/Departments@auto-20140401.0800-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.0830-1dused140K-
zfs01/Data/Departments@auto-20140401.0830-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.0900-1dused3.10M-
zfs01/Data/Departments@auto-20140401.0900-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.0930-1dused3.22M-
zfs01/Data/Departments@auto-20140401.0930-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1000-1dused1.31M-
zfs01/Data/Departments@auto-20140401.1000-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1030-1dused1.58M-
zfs01/Data/Departments@auto-20140401.1030-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1100-1dused2.53M-
zfs01/Data/Departments@auto-20140401.1100-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1130-1dused1.79M-
zfs01/Data/Departments@auto-20140401.1130-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1200-1dused2.03M-
zfs01/Data/Departments@auto-20140401.1200-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1230-1dused2.20M-
zfs01/Data/Departments@auto-20140401.1230-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1300-1dused2.46M-
zfs01/Data/Departments@auto-20140401.1300-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1330-1dused2.47M-
zfs01/Data/Departments@auto-20140401.1330-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1400-1dused2.53M-
zfs01/Data/Departments@auto-20140401.1400-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1430-1dused2.94M-
zfs01/Data/Departments@auto-20140401.1430-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1500-1dused1.95M-
zfs01/Data/Departments@auto-20140401.1500-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1530-1dused1.82M-
zfs01/Data/Departments@auto-20140401.1530-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1600-1dused2.13M-
zfs01/Data/Departments@auto-20140401.1600-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1630-1dused947K-
zfs01/Data/Departments@auto-20140401.1630-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1700-1dused738K-
zfs01/Data/Departments@auto-20140401.1700-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1730-1dused2.22M-
zfs01/Data/Departments@auto-20140401.1730-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1800-1dused2.25M-
zfs01/Data/Departments@auto-20140401.1800-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1830-1dused1.96M-
zfs01/Data/Departments@auto-20140401.1830-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1900-1dused0-
zfs01/Data/Departments@auto-20140401.1900-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.1930-1dused0-
zfs01/Data/Departments@auto-20140401.1930-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.2000-1dused0-
zfs01/Data/Departments@auto-20140401.2000-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.2030-1mused0-
zfs01/Data/Departments@auto-20140401.2030-1mfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.2030-1dused0-
zfs01/Data/Departments@auto-20140401.2030-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.2100-1dused0-
zfs01/Data/Departments@auto-20140401.2100-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.2130-1dused0-
zfs01/Data/Departments@auto-20140401.2130-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.2200-1dused0-
zfs01/Data/Departments@auto-20140401.2200-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.2230-1dused0-
zfs01/Data/Departments@auto-20140401.2230-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.2300-1dused0-
zfs01/Data/Departments@auto-20140401.2300-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140401.2330-1dused0-
zfs01/Data/Departments@auto-20140401.2330-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.0600-1dused128K-
zfs01/Data/Departments@auto-20140402.0600-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.0630-1dused0-
zfs01/Data/Departments@auto-20140402.0630-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.0700-1dused0-
zfs01/Data/Departments@auto-20140402.0700-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.0730-1dused389K-
zfs01/Data/Departments@auto-20140402.0730-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.0800-1dused343K-
zfs01/Data/Departments@auto-20140402.0800-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.0830-1dused418K-
zfs01/Data/Departments@auto-20140402.0830-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.0900-1dused285K-
zfs01/Data/Departments@auto-20140402.0900-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.0930-1dused622K-
zfs01/Data/Departments@auto-20140402.0930-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1000-1dused796K-
zfs01/Data/Departments@auto-20140402.1000-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1030-1dused3.22M-
zfs01/Data/Departments@auto-20140402.1030-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1100-1dused1.88M-
zfs01/Data/Departments@auto-20140402.1100-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1130-1dused1.60M-
zfs01/Data/Departments@auto-20140402.1130-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1200-1dused1.81M-
zfs01/Data/Departments@auto-20140402.1200-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1230-1dused1.99M-
zfs01/Data/Departments@auto-20140402.1230-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1300-1dused2.34M-
zfs01/Data/Departments@auto-20140402.1300-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1330-1dused2.02M-
zfs01/Data/Departments@auto-20140402.1330-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1400-1dused2.16M-
zfs01/Data/Departments@auto-20140402.1400-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1430-1dused2.32M-
zfs01/Data/Departments@auto-20140402.1430-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1500-1dused2.37M-
zfs01/Data/Departments@auto-20140402.1500-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1530-1dused2.17M-
zfs01/Data/Departments@auto-20140402.1530-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1600-1dused1.98M-
zfs01/Data/Departments@auto-20140402.1600-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1630-1dused343K-
zfs01/Data/Departments@auto-20140402.1630-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1700-1dused831K-
zfs01/Data/Departments@auto-20140402.1700-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1730-1dused2.88M-
zfs01/Data/Departments@auto-20140402.1730-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1800-1dused686K-
zfs01/Data/Departments@auto-20140402.1800-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1830-1dused418K-
zfs01/Data/Departments@auto-20140402.1830-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1900-1dused0-
zfs01/Data/Departments@auto-20140402.1900-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.1930-1dused0-
zfs01/Data/Departments@auto-20140402.1930-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.2000-1dused0-
zfs01/Data/Departments@auto-20140402.2000-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.2030-1mused0-
zfs01/Data/Departments@auto-20140402.2030-1mfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.2030-1dused0-
zfs01/Data/Departments@auto-20140402.2030-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.2100-1dused0-
zfs01/Data/Departments@auto-20140402.2100-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.2130-1dused0-
zfs01/Data/Departments@auto-20140402.2130-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.2200-1dused0-
zfs01/Data/Departments@auto-20140402.2200-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.2230-1dused0-
zfs01/Data/Departments@auto-20140402.2230-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.2300-1dused0-
zfs01/Data/Departments@auto-20140402.2300-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140402.2330-1dused0-
zfs01/Data/Departments@auto-20140402.2330-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.0600-1dused163K-
zfs01/Data/Departments@auto-20140403.0600-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.0630-1dused273K-
zfs01/Data/Departments@auto-20140403.0630-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.0700-1dused186K-
zfs01/Data/Departments@auto-20140403.0700-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.0730-1dused401K-
zfs01/Data/Departments@auto-20140403.0730-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.0800-1dused389K-
zfs01/Data/Departments@auto-20140403.0800-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.0830-1dused541K-
zfs01/Data/Departments@auto-20140403.0830-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.0900-1dused453K-
zfs01/Data/Departments@auto-20140403.0900-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.0930-1dused715K-
zfs01/Data/Departments@auto-20140403.0930-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.1000-1dused506K-
zfs01/Data/Departments@auto-20140403.1000-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.1030-1dused3.04M-
zfs01/Data/Departments@auto-20140403.1030-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.1100-1dused907K-
zfs01/Data/Departments@auto-20140403.1100-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.1130-1dused808K-
zfs01/Data/Departments@auto-20140403.1130-1dfreenas:stateNEWlocal
zfs01/Data/Departments@auto-20140403.1200-1dused2.76M-
zfs01/Data/Departments@auto-20140403.1200-1dfreenas:stateNEWlocal

 

[cyberjock]

Your recycle bin will be in the snapshots if your snapshots are snapshotting the folder. Your question doesn't really have an answer because it depends on what you are snapshotting and where your recycle bin is. ;)

You need to read up on snapshots and replication to understand what they are doing behind the scenes. It's completely possible to create TBs of data and delete it without a snapshot actually protecting it.

 

[Rich B]

Thanks cyberjock.

In this case, the recycle bin is being snapshotted, so I expect to see its contents accounted for in at least one of my snapshots. After your suggestion to read up further, I went back to the zfs documentation and now using:

~# zfs list -r -t snapshot zfs01 | zfs get -H refer | grep Departments

I do see values that look like they include the recycle bin.

Is it fair to say that the difference between sequential snapshots' "REFER" property values is a good approximation of the amount of data that will need to travel over the pipe during replication?

 

[cyberjock]

Well, REFER is the difference between one snapshot and either "real time" or the next one. Assuming the snapshot before it exists on the destination and there is another snapshot afterward, yes.