Slow reads, normal writes with CIFS

Status
Not open for further replies.

mooseracing

Cadet
Joined
Oct 22, 2012
Messages
5
Instead of filling someone else's thread here is my mess:

I've tried a Core2Duo 3Ghz, 4GB RAM, 6 - 1TB Samsung drives in ZFS RAID Z1. I also did this same setup in a older P4 but with 3GB RAM with the same results. Right now I get from 60-100MB/s write speeds and about 3MB/s read. Slightly backwards if I was expecting these results.

dd shows ~165 MB/s Writes - P4 3GB
~200 MB/s Reads - P4
~190MB/s Writes - C2D 4GB
~270 Reads

My writes went up using these settings from another thread:
Code:
vfs.zfs.arc_max	1073741824	Generated by autotune	
vm.kmem_size_max	1719738496	Generated by autotune	
vm.kmem_size	1375790796	Generated by autotune	
kern.ipc.nmbclusters	15000	Generated by autotune	
kern.ipc.maxsockbuf	67108864		
kern.ipc.somaxconn	16384		
net.inet.tcp.inflight.enable	0		
net.inet.tcp.recvbuf_auto	1		
net.inet.tcp.recvbuf_inc	524288		
net.inet.tcp.recvspace	131072		
net.inet.tcp.rfc1323	1		
net.inet.tcp.sendbuf_auto	1		
net.inet.tcp.sendbuf_inc	65536		
net.inet.tcp.sendspace	131072		
net.inet.udp.recvspace	65536		
net.inet.udp.maxdgram	57344		 
net.local.stream.recvspace	65536		 
net.local.stream.sendspace	65536		
net.inet.tcp.recvbuf_max	16777216		
net.inet.tcp.sendbuf_max	16777216		


And in CIFS
Code:
socket options = TCP_NODELAY IPTOS_LOWDELAY SO_KEEPALIVE SO_RCVBUF=131072 SO_SNDBUF=131072 IPTOS_THROUGHPUT
read raw = yes
write raw = yes
oplocks = yes
max xmit = 131072
write cache size = 131072


Sendfiles and AIO is disabled currently.



The other thing that seems odd, when doing transfers writes use about 30% of the CPU - samba, with reads, its tenths of a %. The machine also has about 2.5GB's free of RAM during transfers.
 

mooseracing

Cadet
Joined
Oct 22, 2012
Messages
5
I setup an iSCSI target as I thought maybe I could work around the issue, but the same problem happens. Great write speeds, horrible reads.
 

noee

Dabbler
Joined
May 21, 2012
Messages
13
Look here for potential help. Using just UFS with Samsung 1TB drives, I can saturate the GbE with these settings (8.3.1Alpha).
 

mooseracing

Cadet
Joined
Oct 22, 2012
Messages
5
I already had most of those, I changed my values to match and added to sysctls, still a whopping 2.5MB/s reads. Samba is showing no utilization.

I also tried creating it via UFS, same issue.
 

mooseracing

Cadet
Joined
Oct 22, 2012
Messages
5
I also just added the variable to specify smb2, it's working good on my other servers but one is still reading slow. Wondering if I need to restart it to flush any information it is storing about the Freenas box.
 
Status
Not open for further replies.
Top