CIFS writing 2 x faster than reading

[Greg161]

I have FreeNAS 9.10
transfers from FreeNAS to Ubuntu CIFS/SMB client is 5MB
transfers from Ubuntu CIFS/SMB to FreeNAS is 10MB

when I send data both ways using sftp is about 9,5 MB

when I use windows clients also I have transmissions 10 MB both ways

I can not figure out why reading from FreeNAS on Ubutnu client is so slow and other bug is that it freezes for a short time so playing movies from FreeNAS is choky - only Freenas -> Ubuntu

 

[Robert Trevellyan]

We'll need much more information about your whole setup to have any chance of helping you.

 

[Greg161]

OK. Tell me what you need.

 

[Robert Trevellyan]

The forum rules are a good starting point.

Full details of your network too...

 

[Greg161]

Information in attachments.

 

[depasseg]

Most people paste the text in between code tags, to make it easier for folks to read.

 

[Greg161]

You are right , sorry for that mess. Now as a .pdf . It is a lot of text so I hope it will be easier to read it from attachments than scrolling on web site.

 

[depasseg]

An unknown PDF? Attack vector #2. Umm, thanks but no thanks. Sorry

 

[Ericloewe]

An unknown PDF? Attack vector #2. Umm, thanks but no thanks. Sorry

Posting them as PDF sounds like a joke at our expense, which doesn't help the chances for help.

 

[Robert Trevellyan]

re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0xd000-0xd0ff mem 0xff900000-0xff900fff,0xd0800000-0xd0803fff irq 32 at device 0.0 on pci3

Do you have an Intel NIC you can test with?

 

[Greg161]

I do not have Intel NIC, but it seems not to be a problem with NIC because I have good transfer using sftp.

 

[Greg161]

So, all stuff again directly to web page:

"3 x Western Digital Red 2TB 3.5 SATA 6GB/s 64MB
RAIDZ1-0
Build
FreeNAS-9.10-STABLE-201603252134 (412fb1c)
Platform
AMD A4-5000 APU with Radeon(TM) HD Graphics
Memory
15777MB
System Time
Sun Apr 10 21:53:57 CEST 2016
Uptime
9:53PM up 11:20, 1 user
Load Average
0.27, 0.33, 0.29"


"[root@freenas] ~# ifconfig
re0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu
1500
options=82099<RXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
ether d0:50:99:77:3c:96
inet 192.168.1.20 netmask 0xffffff00 broadcast 192.168.1.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
inet 127.0.0.1 netmask 0xff000000
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
ether 02:57:63:73:d7:00
nd6 options=1<PERFORMNUD>
id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
member: epair0a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 4 priority 128 path cost 2000
member: re0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 1 priority 128 path cost 20000
epair0a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu
1500
options=8<VLAN_MTU>
ether 02:ff:20:00:04:0a
nd6 options=1<PERFORMNUD>
media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
status: active"


"[root@freenas] ~# dmidecode
# dmidecode 3.0
Scanning /dev/mem for entry point.
SMBIOS 2.8 present.
18 structures occupying 1062 bytes.
Table at 0x000EBE60.
Handle 0x0000, DMI type 0, 24 bytes
BIOS Information
Vendor: American Megatrends Inc.
Version: P1.00
Release Date: 10/27/2014
Address: 0xF0000
Runtime Size: 64 kB
ROM Size: 4096 kB
Characteristics:
PCI is supported
BIOS is upgradeable
BIOS shadowing is allowed
Boot from CD is supported
Selectable boot is supported
BIOS ROM is socketed
EDD is supported
5.25"/1.2 MB floppy services are supported (int 13h)
3.5"/720 kB floppy services are supported (int 13h)
3.5"/2.88 MB floppy services are supported (int 13h)
Print screen service is supported (int 5h)
8042 keyboard services are supported (int 9h)
Serial services are supported (int 14h)
Printer services are supported (int 17h)
ACPI is supported
USB legacy is supported
BIOS boot specification is supported
Targeted content distribution is supported
UEFI is supported
BIOS Revision: 4.6
Handle 0x0001, DMI type 1, 27 bytes
System Information
Manufacturer: To Be Filled By O.E.M.
Product Name: To Be Filled By O.E.M.
Version: To Be Filled By O.E.M.
Serial Number: To Be Filled By O.E.M.
UUID: 03000200-0400-0500-0006-000700080009
Wake-up Type: Power Switch
SKU Number: To Be Filled By O.E.M.
Family: To Be Filled By O.E.M.
Handle 0x0002, DMI type 2, 15 bytes
Base Board Information
Manufacturer: ASRock
Product Name: QC5000-ITX/PH
Version:
Serial Number: M80-55016400917
Asset Tag:
Features:
Board is a hosting board
Board is replaceable
Location In Chassis:
Chassis Handle: 0x0003
Type: Motherboard
Contained Object Handles: 0
Handle 0x0003, DMI type 3, 25 bytesChassis Information
Manufacturer: To Be Filled By O.E.M.
Type: Desktop
Lock: Not Present
Version: To Be Filled By O.E.M.
Serial Number: To Be Filled By O.E.M.
Asset Tag: To Be Filled By O.E.M.
Boot-up State: Safe
Power Supply State: Safe
Thermal State: Safe
Security Status: None
OEM Information: 0x00000000
Height: Unspecified
Number Of Power Cords: 1
Contained Elements: 1
<OUT OF SPEC> (0)
SKU Number: To be filled by O.E.M.
Handle 0x0004, DMI type 9, 17 bytes
System Slot Information
Designation: PCIE1
Type: x4 PCI Express
Current Usage: Available
Length: Long
ID: 17
Characteristics:
3.3 V is provided
Opening is shared
PME signal is supported
Bus Address: ffff:01:1f.7
Handle 0x0005, DMI type 9, 17 bytes
System Slot Information
Designation: PCIE2
Type: x1 PCI Express
Current Usage: Available
Length: Long
ID: 18
Characteristics:
3.3 V is provided
Opening is shared
PME signal is supported
Bus Address: ffff:05:1f.7
Handle 0x0006, DMI type 11, 5 bytes
OEM Strings
String 1: To Be Filled By O.E.M.
Handle 0x000D, DMI type 32, 20 bytes
System Boot Information
Status: No errors detected
Handle 0x000F, DMI type 16, 23 bytes
Physical Memory Array
Location: System Board Or Motherboard
Use: System Memory
Error Correction Type: None
Maximum Capacity: 16 GB
Error Information Handle: Not Provided
Number Of Devices: 2
Handle 0x0010, DMI type 19, 31 bytes
Memory Array Mapped Address
Starting Address: 0x00000000000Ending Address: 0x003FFFFFFFF
Range Size: 16 GB
Physical Array Handle: 0x000F
Partition Width: 255
Handle 0x0011, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x000F
Error Information Handle: Not Provided
Total Width: 64 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: DIMM 0
Bank Locator: CHANNEL A
Type: DDR3
Type Detail: Synchronous Unbuffered (Unregistered)
Speed: 667 MHz
Manufacturer: <BAD INDEX>
Serial Number: 00000000
Asset Tag: <BAD INDEX>
Part Number: GR1333D364L9/8G
Rank: 2
Configured Clock Speed: 667 MHz
Minimum Voltage: 1.5 V
Maximum Voltage: 1.5 V
Configured Voltage: 1.5 V
Handle 0x0012, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x000F
Error Information Handle: Not Provided
Total Width: 64 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: DIMM 1
Bank Locator: CHANNEL A
Type: DDR3
Type Detail: Synchronous Unbuffered (Unregistered)
Speed: 667 MHz
Manufacturer: <BAD INDEX>
Serial Number: 00000000
Asset Tag: <BAD INDEX>
Part Number: GR1333D364L9/8G
Rank: 2
Configured Clock Speed: 667 MHz
Minimum Voltage: 1.5 V
Maximum Voltage: 1.5 V
Configured Voltage: 1.5 V
Handle 0x0013, DMI type 20, 35 bytes
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x001FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0011
Memory Array Mapped Address Handle: 0x0010
Partition Row Position: 1
Handle 0x0014, DMI type 20, 35 bytes
Memory Device Mapped AddressStarting Address: 0x00200000000
Ending Address: 0x003FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0012
Memory Array Mapped Address Handle: 0x0010
Partition Row Position: 1
Handle 0x0015, DMI type 7, 19 bytes
Cache Information
Socket Designation: L1 CACHE
Configuration: Enabled, Not Socketed, Level 1
Operational Mode: Write Back
Location: Internal
Installed Size: 256 kB
Maximum Size: 256 kB
Supported SRAM Types:
Pipeline Burst
Installed SRAM Type: Pipeline Burst
Speed: 1 ns
Error Correction Type: Multi-bit ECC
System Type: Unified
Associativity: 2-way Set-associative
Handle 0x0016, DMI type 7, 19 bytes
Cache Information
Socket Designation: L2 CACHE
Configuration: Enabled, Not Socketed, Level 2
Operational Mode: Write Back
Location: Internal
Installed Size: 2048 kB
Maximum Size: 2048 kB
Supported SRAM Types:
Pipeline Burst
Installed SRAM Type: Pipeline Burst
Speed: 1 ns
Error Correction Type: Multi-bit ECC
System Type: Unified
Associativity: 16-way Set-associative
Handle 0x0017, DMI type 4, 42 bytes
Processor Information
Socket Designation: CPUSocket
Type: Central Processor
Family: A-Series
Manufacturer: AMD
ID: 01 0F 70 00 FF FB 8B 17
Signature: Family 22, Model 0, Stepping 1
Flags:
FPU (Floating-point unit on-chip)
VME (Virtual mode extension)
DE (Debugging extension)
PSE (Page size extension)
TSC (Time stamp counter)
MSR (Model specific registers)
PAE (Physical address extension)
MCE (Machine check exception)
CX8 (CMPXCHG8 instruction supported)
APIC (On-chip APIC hardware supported)
SEP (Fast system call)
MTRR (Memory type range registers)
PGE (Page global enable)
MCA (Machine check architecture)
CMOV (Conditional move instruction supported)
PAT (Page attribute table)PSE-36 (36-bit page size extension)
CLFSH (CLFLUSH instruction supported)
MMX (MMX technology supported)
FXSR (FXSAVE and FXSTOR instructions supported)
SSE (Streaming SIMD extensions)
SSE2 (Streaming SIMD extensions 2)
HTT (Multi-threading)
Version: AMD A4-5000 APU with Radeon(TM) HD Graphics
Voltage: 1.0 V
External Clock: 100 MHz
Max Speed: 1500 MHz
Current Speed: 1500 MHz
Status: Populated, Enabled
Upgrade: None
L1 Cache Handle: 0x0015
L2 Cache Handle: 0x0016
L3 Cache Handle: Not Provided
Serial Number: Not Specified
Asset Tag: Not Specified
Part Number: Not Specified
Core Count: 4
Core Enabled: 4
Thread Count: 4
Characteristics:
64-bit capable
Handle 0x0018, DMI type 127, 4 bytes
End Of Table"

 

[Greg161]

it was not possible to paste dmesg, too many characters, so if you need any specific part from it I can paste it
I am trying to guess what could be the problem and I think it is something with efficiency of CIFS, maybe it is necessary to tune up , setting some buffers for this service ? The other services like sftp or ftp are fine.

 

[Robert Trevellyan]

it seems not to be a problem with NIC because I have good transfer using sftp.

Seems logical, however, different protocols may be affected differently. Try searching the forums for "Realtek".

I think it is something with efficiency of CIFS

Could be, unfortunately not something I can help with.

 

[anodos]

An unknown PDF? Attack vector #2. Umm, thanks but no thanks. Sorry

If you want me to, I can read them and post as an excel file. You will have to enable macros to read it.

 

[SweetAndLow]

Why are you only seeing 100mb/s bandwidth. You should fix that first, then get Intel nic and then use iperf to test your bandwidth.

 

[Greg161]

I ordered Intel nic and I am going to test it, I will write about the tests.

 

[Greg161]

I installed Intel nic and I see big difference. Now I have transfers 70-80 Mb under windows clients. It is great. The only problem is that I can not get the same under the Ubuntu 15.10 client, it is only 6-7 Mb . So if you have any experience I will appreciate any advice about Ubuntu client and FreeNAS server.

 

[SweetAndLow]

I installed Intel nic and I see big difference. Now I have transfers 70-80 Mb under windows clients. It is great. The only problem is that I can not get the same under the Ubuntu 15.10 client, it is only 6-7 Mb . So if you have any experience I will appreciate any advice about Ubuntu client and FreeNAS server.

great example of just using recommended hardware and all your problems go away. As for the linux client are you using 'mount/fstab' to access your server over smb or are you using the smbclient that is built into your file browser? I suggest using an actual mount point for example 'mount -t cifs -o username=foo,uid=<useruid>,gid=<groupuid> \\\\freenasserver.local/sharename'

 

[Robert Trevellyan]

transfers from FreeNAS to Ubuntu CIFS/SMB client is 5MB
transfers from Ubuntu CIFS/SMB to FreeNAS is 10MB
when I send data both ways using sftp is about 9,5 MB
when I use windows clients also I have transmissions 10 MB both ways

Now I have transfers 70-80 Mb under windows clients.

We're not going to get very far here until you make sure you're using consistent units.
10MB/s is not that different from 80Mb/s.
The difference between 'b' and 'B' is approximately a factor of 10.
Please make sure you understand the units before proceeding.