So I have installed Freenas now several times read many guides and watched instruction videos etc for hours.
I have a very persisting problem which happens on different hardware and is the exact same problem.
I initiated a file copy of some big files (40 GB size or even 70 GB size) and the file copy stays around 1 GB per second (using 100g NIC gives almost same speed as using the 10 gig NIC) after a point (seems to match the RAM size of the systems so either 64 GB or 128 GB) the copy speed falls off a cliff and goes down to around 80 MB per sec ! and stays that way until i reboot the Freenas servers at which point it again copys at around 1 GB per sec until again i copied total files worth the RAM size of the server and it falls down to around 72-80 MB again and stayts there for all consecutive file copys until another restart of the Freenas server.
Tried with ZFS encryption on pool or without and it makes no difference, problem is the same.
Tried to move system dataset (syslog and/or Reporting Database to either the OS boot drive (an SSD) or to the pools itself, again makes no difference.
Hardware config 1: E3-1275v6 Xeon, tried pools with 8 x HGST 1TB Enteprise drives or 8 x 1.9 TB Samsung Enterprise all SSD pool. 64 GB RAM
Hardware config 2 tested: Dell R640 Xeon (tested both E5 2699 v4 and Xeon E5-1680 v3) 128 GB ram
PC/workstation to filecopy to (both Xeon E5 1680 v3 and E2175G (E3 Xeon)
NIC's tested: Intel X550 T-2 and Mellanox ConnectX4 100 Gig dual port (tested both direct connection between Freenas and workstation as well as via a 10 gig and a 100 gig Enterprise class switces)
I am my wits end and would highly appreciate some advice and help !
Thank You
I have a very persisting problem which happens on different hardware and is the exact same problem.
I initiated a file copy of some big files (40 GB size or even 70 GB size) and the file copy stays around 1 GB per second (using 100g NIC gives almost same speed as using the 10 gig NIC) after a point (seems to match the RAM size of the systems so either 64 GB or 128 GB) the copy speed falls off a cliff and goes down to around 80 MB per sec ! and stays that way until i reboot the Freenas servers at which point it again copys at around 1 GB per sec until again i copied total files worth the RAM size of the server and it falls down to around 72-80 MB again and stayts there for all consecutive file copys until another restart of the Freenas server.
Tried with ZFS encryption on pool or without and it makes no difference, problem is the same.
Tried to move system dataset (syslog and/or Reporting Database to either the OS boot drive (an SSD) or to the pools itself, again makes no difference.
Hardware config 1: E3-1275v6 Xeon, tried pools with 8 x HGST 1TB Enteprise drives or 8 x 1.9 TB Samsung Enterprise all SSD pool. 64 GB RAM
Hardware config 2 tested: Dell R640 Xeon (tested both E5 2699 v4 and Xeon E5-1680 v3) 128 GB ram
PC/workstation to filecopy to (both Xeon E5 1680 v3 and E2175G (E3 Xeon)
NIC's tested: Intel X550 T-2 and Mellanox ConnectX4 100 Gig dual port (tested both direct connection between Freenas and workstation as well as via a 10 gig and a 100 gig Enterprise class switces)
I am my wits end and would highly appreciate some advice and help !
Thank You