psychickitten
Cadet
- Joined
- Dec 1, 2016
- Messages
- 9
I've been using 2 Mellanox Connect X-2 10gb cards through a direct connection so that I have a 10gb link between my desktop and NAS. It was working just dandy before I updated from 9.10.2-U2 (around 880MB/s read and write both ways). After upgrading to 9.10.2-U3, I noticed two issues.
1) The mellanox card on the Freenas server doesn't seem to initialize properly on boot anymore, I have to go to the nic interface and restart it before my desktop can connect to it.
2) I'm only getting 500-600 MB/s Writes, but reads have increased up to 1.1GB/s, but it seems to depend on the mood of the adapter. Sometimes I'll get a constant 700MB/s, sometimes a constant 810MB/s, etc. Before, reads and writes were very consistent.
The odd thing is, reverting to 9.10.2U2 didn't solve the issues, it behaves exactly the same. Both 10gb nics have a fan close by, so they aren't throttling. Jumbo frames is on (9614 Bytes), and it's a direct connection between my Desktop and NAS. Using SMB3 for the network share.
Specs:
FreeNAS server: 9.10.2-U3
Intel Xeon E3-1245 V5 (4core with HT)
64GB Kingston ddr4 ecc
Asus P10sWS
LSI 9300-8i (IT mode, p14 firmware), reverting to P12 firmware and 9.10.2-U2 doesn't solve the write speed issue.
Mellanox Connect x-2
Pool 1 (HDD Pool), Mirror Vdevs
4 x 4TB HGST Deskstar 7200RPM
2 x 4TB WD Red 5400 RPM
4 x 8TB WD Red 5400 RPM
(around 60% space used)
I used to get around the high 500s writing to the pool, now speeds seem to be between 450-550MB/s, but this could be within margin of error. Reads seem to have improved a bit though.
Pool 2 (SSD Pool), Striped
2x 1TB 850 EVO
(1% space used)
I'd really appreciate some help troubleshooting this issue.
1) The mellanox card on the Freenas server doesn't seem to initialize properly on boot anymore, I have to go to the nic interface and restart it before my desktop can connect to it.
2) I'm only getting 500-600 MB/s Writes, but reads have increased up to 1.1GB/s, but it seems to depend on the mood of the adapter. Sometimes I'll get a constant 700MB/s, sometimes a constant 810MB/s, etc. Before, reads and writes were very consistent.
The odd thing is, reverting to 9.10.2U2 didn't solve the issues, it behaves exactly the same. Both 10gb nics have a fan close by, so they aren't throttling. Jumbo frames is on (9614 Bytes), and it's a direct connection between my Desktop and NAS. Using SMB3 for the network share.
Specs:
FreeNAS server: 9.10.2-U3
Intel Xeon E3-1245 V5 (4core with HT)
64GB Kingston ddr4 ecc
Asus P10sWS
LSI 9300-8i (IT mode, p14 firmware), reverting to P12 firmware and 9.10.2-U2 doesn't solve the write speed issue.
Mellanox Connect x-2
Pool 1 (HDD Pool), Mirror Vdevs
4 x 4TB HGST Deskstar 7200RPM
2 x 4TB WD Red 5400 RPM
4 x 8TB WD Red 5400 RPM
(around 60% space used)
I used to get around the high 500s writing to the pool, now speeds seem to be between 450-550MB/s, but this could be within margin of error. Reads seem to have improved a bit though.
Pool 2 (SSD Pool), Striped
2x 1TB 850 EVO
(1% space used)
I'd really appreciate some help troubleshooting this issue.
Last edited:
