Jail restart triggers whole FreeNAS network restart?

[tuxedo42]

I'm a bit confused so I decided to first open a thread here, before open a bug in the trac. I can't really estimate if it's an bug in FreeNAS, a general FreeBSD bug or a bug at all...

How to reproduce:

• install plain stable FreeNAS 9.3
• install plain native BSD jail
• start ping the FreeNAS from another netwok client
• restart jail
• see ping stucks and loosing 12 - 18 pings
• dmesg showing all FreeNAS interfaces going up and down

I tested the same with restarting the jail with warden on FreeNAS shell with same result.

So my question is: Is this the expected result? Is this behavior known? Is ist a bug?

With this behavior FreeNAS is pretty useless, if we can't put different services in jails and loosing network connections wile restarting any jail. I can imagine mounted nfs shares on clients don't like such packet loss...

Regards
tuxedo42

 

[dlavigne]

To clarify, what is the build (from System -> Info)?

 

[cyberjock]

Posting your hardware would also be important here...

 

[tuxedo42]

System Information
Hostname freenas.local Edit
Build FreeNAS-9.3-STABLE-201506292130
Platform AMD Opteron(tm) Processor 6128
Memory 131044MB
System Time Wed Jul 08 06:42:44 PDT 2015
Uptime 6:42AM up 22:28, 0 users
Load Average 0.39, 0.32, 0.31

Show : hardware information

### dmidecode ###
# dmidecode 2.12
SMBIOS 2.6 present.
62 structures occupying 3383 bytes.
Table at 0x0009AC00.

Handle 0x0000, DMI type 0, 24 bytes
BIOS Information
Vendor: American Megatrends Inc.
Version: 3.0
Release Date: 09/10/2012
Address: 0xF0000
Runtime Size: 64 kB
ROM Size: 2048 kB
Characteristics:
ISA is supported
PCI is supported
PNP is supported
BIOS is upgradeable
BIOS shadowing is allowed
ESCD support is available
Boot from CD is supported
Selectable boot is supported
BIOS ROM is socketed
EDD is supported
5.25"/1.2 MB floppy services are supported (int 13h)
3.5"/720 kB floppy services are supported (int 13h)
3.5"/2.88 MB floppy services are supported (int 13h)
Print screen service is supported (int 5h)
8042 keyboard services are supported (int 9h)
Serial services are supported (int 14h)
Printer services are supported (int 17h)
CGA/mono video services are supported (int 10h)
ACPI is supported
USB legacy is supported
LS-120 boot is supported
ATAPI Zip drive boot is supported
BIOS boot specification is supported
Targeted content distribution is supported
BIOS Revision: 8.16

Handle 0x0001, DMI type 1, 27 bytes
System Information
Manufacturer: Supermicro
Product Name: H8DG6/H8DGi
Version: 1234567890
Serial Number: 1234567890
UUID: 49434D53-0200-907F-2500-7F902500B8BB
Wake-up Type: Power Switch
SKU Number: To Be Filled By O.E.M.
Family: To Be Filled By O.E.M.

Handle 0x0002, DMI type 2, 15 bytes
Base Board Information
Manufacturer: Supermicro
Product Name: H8DG6/H8DGi
Version: 1.0
Serial Number: ZM29S70384
Asset Tag: To Be Filled By O.E.M.
Features:
Board is a hosting board
Board is replaceable
Location In Chassis: To Be Filled By O.E.M.
Chassis Handle: 0x0003
Type: Motherboard
Contained Object Handles: 0

Handle 0x0003, DMI type 3, 21 bytes
Chassis Information
Manufacturer: Supermicro
Type: Main Server Chassis
Lock: Not Present
Version: 1234567890
Serial Number: 1234567890
Asset Tag: To Be Filled By O.E.M.
Boot-up State: Safe
Power Supply State: Safe
Thermal State: Safe
Security Status: None
OEM Information: 0x00000000
Height: Unspecified
Number Of Power Cords: 1
Contained Elements: 0

Handle 0x0004, DMI type 4, 42 bytes
Processor Information
Socket Designation: CPU 1
Type: Central Processor
Family: Opteron
Manufacturer: AMD
ID: 91 0F 10 00 FF FB 8B 17
Signature: Family 16, Model 9, Stepping 1
Flags:
FPU (Floating-point unit on-chip)
VME (Virtual mode extension)
DE (Debugging extension)
PSE (Page size extension)
TSC (Time stamp counter)
MSR (Model specific registers)
PAE (Physical address extension)
MCE (Machine check exception)
CX8 (CMPXCHG8 instruction supported)
APIC (On-chip APIC hardware supported)
SEP (Fast system call)
MTRR (Memory type range registers)
PGE (Page global enable)
MCA (Machine check architecture)
CMOV (Conditional move instruction supported)
PAT (Page attribute table)
PSE-36 (36-bit page size extension)
CLFSH (CLFLUSH instruction supported)
MMX (MMX technology supported)
FXSR (FXSAVE and FXSTOR instructions supported)
SSE (Streaming SIMD extensions)
SSE2 (Streaming SIMD extensions 2)
HTT (Multi-threading)
Version: AMD Opteron(tm) Processor 6128
Voltage: 1.2 V
External Clock: 200 MHz
Max Speed: 2000 MHz
Current Speed: 2000 MHz
Status: Populated, Enabled
Upgrade: Socket G34
L1 Cache Handle: 0x0005
L2 Cache Handle: 0x0006
L3 Cache Handle: 0x0007
Serial Number: To Be Filled By O.E.M.
Asset Tag: To Be Filled By O.E.M.
Part Number: To Be Filled By O.E.M.
Core Count: 8
Core Enabled: 8
Thread Count: 8
Characteristics:
64-bit capable

Handle 0x0005, DMI type 7, 19 bytes
Cache Information
Socket Designation: L1-Cache
Configuration: Enabled, Not Socketed, Level 1
Operational Mode: Write Back
Location: Internal
Installed Size: 1024 kB
Maximum Size: 1024 kB
Supported SRAM Types:
Pipeline Burst
Installed SRAM Type: Pipeline Burst
Speed: 1 ns
Error Correction Type: Multi-bit ECC
System Type: Unified
Associativity: 2-way Set-associative

Handle 0x0006, DMI type 7, 19 bytes
Cache Information
Socket Designation: L2-Cache
Configuration: Enabled, Not Socketed, Level 2
Operational Mode: Write Back
Location: Internal
Installed Size: 4096 kB
Maximum Size: 4096 kB
Supported SRAM Types:
Pipeline Burst
Installed SRAM Type: Pipeline Burst
Speed: 1 ns
Error Correction Type: Multi-bit ECC
System Type: Unified
Associativity: 16-way Set-associative

Handle 0x0007, DMI type 7, 19 bytes
Cache Information
Socket Designation: L3-Cache
Configuration: Enabled, Not Socketed, Level 3
Operational Mode: Write Back
Location: Internal
Installed Size: 10240 kB
Maximum Size: 10240 kB
Supported SRAM Types:
Pipeline Burst
Installed SRAM Type: Pipeline Burst
Speed: 1 ns
Error Correction Type: Multi-bit ECC
System Type: Unified
Associativity: Other

Handle 0x0008, DMI type 4, 42 bytes
Processor Information
Socket Designation: CPU 2
Type: Central Processor
Family: Opteron
Manufacturer: AMD
ID: 91 0F 10 00 FF FB 8B 17
Signature: Family 16, Model 9, Stepping 1
Flags:
FPU (Floating-point unit on-chip)
VME (Virtual mode extension)
DE (Debugging extension)
PSE (Page size extension)
TSC (Time stamp counter)
MSR (Model specific registers)
PAE (Physical address extension)
MCE (Machine check exception)
CX8 (CMPXCHG8 instruction supported)
APIC (On-chip APIC hardware supported)
SEP (Fast system call)
MTRR (Memory type range registers)
PGE (Page global enable)
MCA (Machine check architecture)
CMOV (Conditional move instruction supported)
PAT (Page attribute table)
PSE-36 (36-bit page size extension)
CLFSH (CLFLUSH instruction supported)
MMX (MMX technology supported)
FXSR (FXSAVE and FXSTOR instructions supported)
SSE (Streaming SIMD extensions)
SSE2 (Streaming SIMD extensions 2)
HTT (Multi-threading)
Version: AMD Opteron(tm) Processor 6128
Voltage: 1.2 V
External Clock: 200 MHz
Max Speed: 2000 MHz
Current Speed: 2000 MHz
Status: Populated, Enabled
Upgrade: Socket G34
L1 Cache Handle: 0x0009
L2 Cache Handle: 0x000A
L3 Cache Handle: 0x000B
Serial Number: To Be Filled By O.E.M.
Asset Tag: To Be Filled By O.E.M.
Part Number: To Be Filled By O.E.M.
Core Count: 8
Core Enabled: 8
Thread Count: 8
Characteristics:
64-bit capable

Handle 0x0009, DMI type 7, 19 bytes
Cache Information
Socket Designation: L1-Cache
Configuration: Enabled, Not Socketed, Level 1
Operational Mode: Write Back
Location: Internal
Installed Size: 1024 kB
Maximum Size: 1024 kB
Supported SRAM Types:
Pipeline Burst
Installed SRAM Type: Pipeline Burst
Speed: 1 ns
Error Correction Type: Multi-bit ECC
System Type: Unified
Associativity: 2-way Set-associative

Handle 0x000A, DMI type 7, 19 bytes
Cache Information
Socket Designation: L2-Cache
Configuration: Enabled, Not Socketed, Level 2
Operational Mode: Write Back
Location: Internal
Installed Size: 4096 kB
Maximum Size: 4096 kB
Supported SRAM Types:
Pipeline Burst
Installed SRAM Type: Pipeline Burst
Speed: 1 ns
Error Correction Type: Multi-bit ECC
System Type: Unified
Associativity: 16-way Set-associative

Handle 0x000B, DMI type 7, 19 bytes
Cache Information
Socket Designation: L3-Cache
Configuration: Enabled, Not Socketed, Level 3
Operational Mode: Write Back
Location: Internal
Installed Size: 10240 kB
Maximum Size: 10240 kB
Supported SRAM Types:
Pipeline Burst
Installed SRAM Type: Pipeline Burst
Speed: 1 ns
Error Correction Type: Multi-bit ECC
System Type: Unified
Associativity: Other

Handle 0x000C, DMI type 9, 17 bytes
System Slot Information
Designation: PCIE1
Type: x4 PCI Express x8
Current Usage: Available
Length: Short
ID: 1
Characteristics:
3.3 V is provided
Opening is shared
PME signal is supported

Handle 0x000D, DMI type 9, 17 bytes
System Slot Information
Designation: PCIE2
Type: x16 PCI Express x16
Current Usage: Available
Length: Short
ID: 2
Characteristics:
3.3 V is provided
Opening is shared
PME signal is supported

Handle 0x000E, DMI type 9, 17 bytes
System Slot Information
Designation: PCIE3
Type: x8 PCI Express x8
Current Usage: Available
Length: Short
ID: 3
Characteristics:
3.3 V is provided
Opening is shared
PME signal is supported

Handle 0x000F, DMI type 9, 17 bytes
System Slot Information
Designation: PCIE4
Type: x16 PCI Express x16
Current Usage: Available
Length: Short
ID: 4
Characteristics:
3.3 V is provided
Opening is shared
PME signal is supported

Handle 0x0010, DMI type 9, 17 bytes
System Slot Information
Designation: PCIE5
Type: x4 PCI Express x8
Current Usage: Available
Length: Short
ID: 5
Characteristics:
3.3 V is provided
Opening is shared
PME signal is supported

Handle 0x0011, DMI type 9, 17 bytes
System Slot Information
Designation: PCIE6
Type: x16 PCI Express x16
Current Usage: Available
Length: Short
ID: 6
Characteristics:
3.3 V is provided
Opening is shared
PME signal is supported

Handle 0x0012, DMI type 11, 5 bytes
OEM Strings
String 1: AMD G34/SR5690/SP5100
String 2: Supermicro motherboard-H8DG6/i-F

Handle 0x0013, DMI type 13, 22 bytes
BIOS Language Information
Language Description Format: Long
Installable Languages: 1
en|US|iso8859-1
Currently Installed Language: en|US|iso8859-1

Handle 0x0014, DMI type 15, 55 bytes
System Event Log
Area Length: 1008 bytes
Header Start Offset: 0x0810
Header Length: 16 bytes
Data Start Offset: 0x0820
Access Method: General-purpose non-volatile data functions
Access Address: 0x0001
Status: Valid, Not Full
Change Token: 0x00000000
Header Format: Type 1
Supported Log Type Descriptors: 11
Descriptor 1: Single-bit ECC memory error
Data Format 1: Multiple-event handle
Descriptor 2: Multi-bit ECC memory error
Data Format 2: Multiple-event handle
Descriptor 3: Parity memory error
Data Format 3: Multiple-event
Descriptor 4: I/O channel block
Data Format 4: Multiple-event
Descriptor 5: POST error
Data Format 5: POST results bitmap
Descriptor 6: PCI parity error
Data Format 6: Multiple-event handle
Descriptor 7: PCI system error
Data Format 7: Multiple-event handle
Descriptor 8: CPU failure
Data Format 8: Multiple-event handle
Descriptor 9: System limit exceeded
Data Format 9: Multiple-event system management
Descriptor 10: OEM-specific
Data Format 10: POST results bitmap
Descriptor 11: OEM-specific
Data Format 11: Multiple-event handle

Handle 0x0015, DMI type 16, 15 bytes
Physical Memory Array
Location: System Board Or Motherboard
Use: System Memory
Error Correction Type: Multi-bit ECC
Maximum Capacity: 128 GB
Error Information Handle: Not Provided
Number Of Devices: 8

Handle 0x0016, DMI type 19, 15 bytes
Memory Array Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x00FFFFFFFFF
Range Size: 64 GB
Physical Array Handle: 0x0015
Partition Width: 255

Handle 0x0017, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0015
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMM1B
Bank Locator: BANK0
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 13895AE3
Asset Tag: AssetTagNum0
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x0018, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x001FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0017
Memory Array Mapped Address Handle: 0x0016
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x0019, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0015
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMM1A
Bank Locator: BANK1
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138C8A3E
Asset Tag: AssetTagNum1
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x001A, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00200000000
Ending Address: 0x003FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0019
Memory Array Mapped Address Handle: 0x0016
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x001B, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0015
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMM2B
Bank Locator: BANK2
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138C8ABC
Asset Tag: AssetTagNum2
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x001C, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00400000000
Ending Address: 0x005FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x001B
Memory Array Mapped Address Handle: 0x0016
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x001D, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0015
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMM2A
Bank Locator: BANK3
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138C8AA3
Asset Tag: AssetTagNum3
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x001E, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00600000000
Ending Address: 0x007FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x001D
Memory Array Mapped Address Handle: 0x0016
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x001F, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0015
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMM3B
Bank Locator: BANK4
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 348DBDA0
Asset Tag: AssetTagNum4
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x0020, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00800000000
Ending Address: 0x009FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x001F
Memory Array Mapped Address Handle: 0x0016
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x0021, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0015
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMM3A
Bank Locator: BANK5
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138C8ABB
Asset Tag: AssetTagNum5
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x0022, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00A00000000
Ending Address: 0x00BFFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0021
Memory Array Mapped Address Handle: 0x0016
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x0023, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0015
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMM4B
Bank Locator: BANK6
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 348DBCE6
Asset Tag: AssetTagNum6
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x0024, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00C00000000
Ending Address: 0x00DFFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0023
Memory Array Mapped Address Handle: 0x0016
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x0025, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0015
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMM4A
Bank Locator: BANK7
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138C8AC4
Asset Tag: AssetTagNum7
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x0026, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x00E00000000
Ending Address: 0x00FFFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0025
Memory Array Mapped Address Handle: 0x0016
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x0027, DMI type 16, 15 bytes
Physical Memory Array
Location: System Board Or Motherboard
Use: System Memory
Error Correction Type: Multi-bit ECC
Maximum Capacity: 128 GB
Error Information Handle: Not Provided
Number Of Devices: 8

Handle 0x0028, DMI type 19, 15 bytes
Memory Array Mapped Address
Starting Address: 0x01000000000
Ending Address: 0x01FFFFFFFFF
Range Size: 64 GB
Physical Array Handle: 0x0027
Partition Width: 255

Handle 0x0029, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0027
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMM1B
Bank Locator: BANK8
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 348DBE42
Asset Tag: AssetTagNum8
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x002A, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x01000000000
Ending Address: 0x011FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0029
Memory Array Mapped Address Handle: 0x0028
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x002B, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0027
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMM1A
Bank Locator: BANK9
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138C8AA6
Asset Tag: AssetTagNum9
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x002C, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x01200000000
Ending Address: 0x013FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x002B
Memory Array Mapped Address Handle: 0x0028
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x002D, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0027
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMM2B
Bank Locator: BANK10
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138053BF
Asset Tag: AssetTagNum10
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x002E, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x01400000000
Ending Address: 0x015FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x002D
Memory Array Mapped Address Handle: 0x0028
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x002F, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0027
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMM2A
Bank Locator: BANK11
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138C8AC2
Asset Tag: AssetTagNum11
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x0030, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x01600000000
Ending Address: 0x017FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x002F
Memory Array Mapped Address Handle: 0x0028
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x0031, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0027
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMM3B
Bank Locator: BANK12
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138053C5
Asset Tag: AssetTagNum12
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x0032, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x01800000000
Ending Address: 0x019FFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0031
Memory Array Mapped Address Handle: 0x0028
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x0033, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0027
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMM3A
Bank Locator: BANK13
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138C8ACA
Asset Tag: AssetTagNum13
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x0034, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x01A00000000
Ending Address: 0x01BFFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0033
Memory Array Mapped Address Handle: 0x0028
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x0035, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0027
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMM4B
Bank Locator: BANK14
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138C8AB8
Asset Tag: AssetTagNum14
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x0036, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x01C00000000
Ending Address: 0x01DFFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0035
Memory Array Mapped Address Handle: 0x0028
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x0037, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0027
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMM4A
Bank Locator: BANK15
Type: DDR3
Type Detail: Synchronous
Speed: 1333 MHz
Manufacturer: Samsung
Serial Number: 138C8AC3
Asset Tag: AssetTagNum15
Part Number: M393B1K70DH0-CK0
Rank: 2

Handle 0x0038, DMI type 20, 19 bytes
Memory Device Mapped Address
Starting Address: 0x01E00000000
Ending Address: 0x01FFFFFFFFF
Range Size: 8 GB
Physical Device Handle: 0x0037
Memory Array Mapped Address Handle: 0x0028
Partition Row Position: <OUT OF SPEC>
Interleave Position: Unknown
Interleaved Data Depth: Unknown

Handle 0x0039, DMI type 32, 20 bytes
System Boot Information
Status: No errors detected

Handle 0x003A, DMI type 38, 18 bytes
IPMI Device Information
Interface Type: KCS (Keyboard Control Style)
Specification Version: 2.0
I2C Slave Address: 0x00
NV Storage Device: Not Present
Base Address: 0x0000000000000CA2 (I/O)
Register Spacing: Successive Byte Boundaries

Handle 0x003B, DMI type 41, 11 bytes
Onboard Device
Reference Designation: To Be Filled By O.E.M.
Type: Video
Status: Enabled
Type Instance: 0

Handle 0x003C, DMI type 41, 11 bytes
Onboard Device
Reference Designation: To Be Filled By O.E.M.
Type: SCSI Controller
Status: Disabled
Type Instance: 0

Handle 0x003D, DMI type 127, 4 bytes
End Of Table


######
######
### lspci ###
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 Northbridge only dual slot (2x16) PCI-e GFX Hydra part (rev 02)
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD/ATI] RD990 I/O Memory Management Unit (IOMMU)
00:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (PCI express gpp port D)
[...]
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor HyperTransport Configuration
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor Address Map
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor DRAM Controller
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor Miscellaneous Control
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor Link Control
[...]
01:04.0 VGA compatible controller: Matrox Electronics Systems Ltd. MGA G200eW WPCM450 (rev 0a)
02:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
02:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
03:00.0 RAID bus controller: LSI Logic / Symbios Logic MegaRAID SAS 2108 [Liberator] (rev 05)
04:00.0 Ethernet controller: Intel Corporation 82572EI Gigabit Ethernet Controller (Copper) (rev 06)

######
######

 

[SweetAndLow]

What nic and motherboard

 

[tuxedo42]

I've edited my answer and added hardware information

 

[cyberjock]

I'm kind of expecting broadcom or realtek now, which we all know aren't good choices for reliable networking.

I tested my machine right after I saw this thread and I pinged my FreeNAS host and one of my jails and started and stopped 3 different jails and never had any packet loss. That's why I asked about the hardware because I was pretty much expecting to see that it's not recommended hardware. :P

 

[tuxedo42]

No, it's a supermicro board with intel NICs, see exhausting spoiler above

 

[pirateghost]

I start, stop, restart, create, destroy jails all the time and don't lose network connectivity....

 

[tuxedo42]

Ok, now it gets complicated...
Perhaps I may mention

• that we use LACP over 5 NICs
• that we use VLANs

 

[pirateghost]

And LACP strikes again....

 

[tuxedo42]

We used LACP a long time before and never had any problems with it - and of course our switches are LACP capable.
I read https://forums.freenas.org/index.php?threads/lacp-friend-or-foe.30541/ and I see no problem which could cause my problem. Of course I don't want to rule out LACP 100%, but 99%... :)

I will unconfigure LACP and test with plain single interface, to be sure.

 

[pirateghost]

It tends to be a common theme that people having issues with jails and networking are generally always running LACP.

Something doesn't work right....

 

[tuxedo42]

i tested around a bit and one thing seems clear now: the LACP seems to be involved in this problem.

Some facts:

• The LACP seems to be working properly, if I stress the lagg with many clients I get expected performance, no packet loss, no performance drops, all fine.
• If I connect a jail to this lagg prior desribed behavior occurs - the whole network stack seems to go down while restarting jail
• If the jail ist connected to single NIC everything is fine

 

[tuxedo42]

How can we proceed further?
We feel safe in the linux area, but we are a little bit helpless if we get in the BSD area.

May it be helpful to increase debug level? May it be helpful to reproduce the issue in plain FreeBSD?

 

[pirateghost]

Maybe try reporting a bug?

 

[tuxedo42]

thats what I see in /var/log/messages during jail restart (LACP):

Show

Jul 9 06:30:27 test1234 dhclient[16778]: connection closed
Jul 9 06:30:27 test1234 dhclient[16778]: exiting.
Jul 9 06:30:27 freenas kernel: epair0a: link state changed to DOWN
Jul 9 06:30:27 freenas kernel: epair0a: link state changed to DOWN
Jul 9 06:30:27 freenas kernel: epair0b: link state changed to DOWN
Jul 9 06:30:27 freenas kernel: epair0b: link state changed to DOWN
Jul 9 06:30:27 freenas kernel: em2: promiscuous mode disabled
Jul 9 06:30:27 freenas kernel: em1: promiscuous mode disabled
Jul 9 06:30:27 freenas kernel: igb1: promiscuous mode disabled
Jul 9 06:30:27 freenas kernel: bridge0: link state changed to DOWN
Jul 9 06:30:27 freenas kernel: bridge0: link state changed to DOWN
Jul 9 06:30:27 freenas kernel: em0: promiscuous mode disabled
Jul 9 06:30:27 freenas kernel: lagg0: promiscuous mode disabled
Jul 9 06:30:27 freenas kernel: vlan7: promiscuous mode disabled
Jul 9 06:30:28 test1234 syslogd: exiting on signal 15
Freed UMA keg (udp_inpcb) was not empty (140 items). Lost 14 pages of memory.
Freed UMA keg (udpcb) was not empty (1848 items). Lost 11 pages of memory.
Freed UMA keg (ripcb) was not empty (10 items). Lost 1 pages of memory.
hhook_vnet_uninit: hhook_head type=1, id=1 cleanup required
hhook_vnet_uninit: hhook_head type=1, id=0 cleanup required
Jul 9 06:30:31 freenas kernel: ifa_del_loopback_route: deletion failed
Jul 9 06:30:31 freenas Freed UMA keg (udp_inpcb) was not empty (140 items). Lost 14 pages of memory.
Jul 9 06:30:31 freenas Freed UMA keg (udpcb) was not empty (1848 items). Lost 11 pages of memory.
Jul 9 06:30:31 freenas Freed UMA keg (ripcb) was not empty (10 items). Lost 1 pages of memory.
Jul 9 06:30:31 freenas hhook_vnet_uninit: hhook_head type=1, id=1 cleanup required
Jul 9 06:30:31 freenas hhook_vnet_uninit: hhook_head type=1, id=0 cleanup required
Jul 9 06:30:31 freenas mountd[2106]: can't get address info for host *
Jul 9 06:30:31 freenas mountd[2106]: bad host *, skipping
Jul 9 06:30:31 freenas mountd[2106]: can't get address info for host *
Jul 9 06:30:31 freenas mountd[2106]: bad exports list line /mnt/sas/jaildata -alldirs -maproot
Jul 9 06:30:31 freenas mountd[2106]: bad host *, skipping
Jul 9 06:30:31 freenas mountd[2106]: bad exports list line /mnt/sas/jaildata -alldirs -maproot
bridge0: Ethernet address: 02:aa:52:17:34:00
epair0a: Ethernet address: 02:31:87:00:11:0a
epair0b: Ethernet address: 02:31:87:00:13:0b
Jul 9 06:30:31 freenas bridge0: Ethernet address: 02:aa:52:17:34:00
Jul 9 06:30:31 freenas kernel: em2: promiscuous mode enabled
Jul 9 06:30:31 freenas kernel: bridge0: link state changed to UP
Jul 9 06:30:31 freenas kernel: bridge0: link state changed to UP
Jul 9 06:30:31 freenas kernel: em1: promiscuous mode enabled
Jul 9 06:30:31 freenas kernel: igb1: promiscuous mode enabled
Jul 9 06:30:31 freenas kernel: em0: promiscuous mode enabled
Jul 9 06:30:31 freenas kernel: lagg0: promiscuous mode enabled
Jul 9 06:30:31 freenas kernel: vlan7: promiscuous mode enabled
Jul 9 06:30:31 freenas epair0a: Ethernet address: 02:31:87:00:11:0a
Jul 9 06:30:31 freenas epair0b: Ethernet address: 02:31:87:00:13:0b
Jul 9 06:30:31 freenas kernel: epair0a: link state changed to UP
Jul 9 06:30:31 freenas kernel: epair0a: link state changed to UP
Jul 9 06:30:31 freenas kernel: epair0b: link state changed to UP
Jul 9 06:30:31 freenas kernel: epair0b: link state changed to UP
Jul 9 06:30:32 freenas kernel: epair0a: promiscuous mode enabled
Jul 9 06:30:32 freenas kernel: em2: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: em2: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: em1: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: em1: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: igb1: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: igb1: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: em0: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: em0: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: ng_ether_ifnet_arrival_event: can't re-name node epair0b
Jul 9 06:30:32 freenas kernel: lagg0: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: lagg0: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: vlan7: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: vlan7: link state changed to DOWN
Jul 9 06:30:32 freenas kernel: ng_ether_ifnet_arrival_event: can't re-name node epair0b
Jul 9 06:30:32 freenas kernel: ng_ether_ifnet_arrival_event: can't re-name node epair0b
Jul 9 06:30:35 freenas kernel: em2: link state changed to UP
Jul 9 06:30:35 freenas kernel: em2: link state changed to UP
Jul 9 06:30:35 freenas kernel: lagg0: link state changed to UP
Jul 9 06:30:35 freenas kernel: lagg0: link state changed to UP
Jul 9 06:30:35 freenas kernel: vlan7: link state changed to UP
Jul 9 06:30:35 freenas kernel: vlan7: link state changed to UP
Jul 9 06:30:35 freenas kernel: em1: link state changed to UP
Jul 9 06:30:35 freenas kernel: em1: link state changed to UP
Jul 9 06:30:35 freenas kernel: igb1: link state changed to UP
Jul 9 06:30:35 freenas kernel: igb1: link state changed to UP
Jul 9 06:30:35 freenas kernel: em0: link state changed to UP
Jul 9 06:30:35 freenas kernel: em0: link state changed to UP

edit:
further testing (on cli) shows:

• warden stop $JAIL --> everything is fine
• warden start $JAIL --> Interfaces are going down (and up again)

Is there any special on FreeNAS warden or does this mean it's not a FreeNAS issue rather than a FreeBSD/warden issue?

google dont show me any related...

 

[pirateghost]

This would get better exposure on the bug tracker. Devs don't frequent the forums

 

[tuxedo42]

traced it down to the jail command itself (which is called within warden).

I will test FreeNAS 10 to gather more information and file a bug - but i'm pessimistic that this will get fixed in 9.x because it seems to be BSD related, not FreeNAS.

Thank you all for help and comments.

edit:
I'd better checked the current state of development of 10 Release before posting above (and upgrade to it ) - but anyway it was a new installation of 9.3 necessary