Don't take this as me telling arguing with you. But a few things I noticed from your post:
1. You spent BIG money on a small pool. Unfortunately, most of us want high speed without the 5+ digit costs.
2. You striped your ZILs. If your ZIL fails and have an unclean shutdown of the system, ZFS is going to have a cow. You will be able to recover, but the extent of recovery is up for a heated debate. As such, this is not a recommended configuration.
3. You disabled ZFS prefetch. For most people, that causes a major performance penalty. You could have likely gotten by with less hardware if you had left that enabled.
4. You are at the upper limit for the amount of L2ARC you should have for RAM. Performance might improve if you decrease that ratio(that is, more RAM or less L2ARC, or both).
5. You also disabled the L2ARC prefetch. For most people wanting to maximize performance with an L2ARC, disabling the prefetch is usually a performance killer. Again, you could have probably gotten by with less hardware if you had left that enabled.
This kind of shows that if you have no budget restraints you can definitely get a high performing system and that newbies will likely never get ZFS tuning correct. The second one is no surprise at all, and not meant as a criticism.
Glad you did get it working for you though. ZFS is pretty awesome. :)
1. You spent BIG money on a small pool. Unfortunately, most of us want high speed without the 5+ digit costs.
2. You striped your ZILs. If your ZIL fails and have an unclean shutdown of the system, ZFS is going to have a cow. You will be able to recover, but the extent of recovery is up for a heated debate. As such, this is not a recommended configuration.
3. You disabled ZFS prefetch. For most people, that causes a major performance penalty. You could have likely gotten by with less hardware if you had left that enabled.
4. You are at the upper limit for the amount of L2ARC you should have for RAM. Performance might improve if you decrease that ratio(that is, more RAM or less L2ARC, or both).
5. You also disabled the L2ARC prefetch. For most people wanting to maximize performance with an L2ARC, disabling the prefetch is usually a performance killer. Again, you could have probably gotten by with less hardware if you had left that enabled.
This kind of shows that if you have no budget restraints you can definitely get a high performing system and that newbies will likely never get ZFS tuning correct. The second one is no surprise at all, and not meant as a criticism.
Glad you did get it working for you though. ZFS is pretty awesome. :)