FreeNAS 11.0-RC3 Freezing

Status
Not open for further replies.

Dwibs

Dabbler
Joined
May 22, 2017
Messages
15
Hi all.

I originally was using 9.10.2 and was working flawlessly, upgrading through the GUI to 11.0.2 and recently upgraded to 11.0.3.

Router.
Pfsense Latest Version
i3, 8Gb DDR3, 500Gb.

System:
Dell T3500
Intel Xeon X5675 6 cores @ 3.07Ghz
12Gb DDR3 ECC (6x2Gb sticks)
550W Original Dell PSU

Storage:
Boot USB 16Gb Sandisk Cruiser x 2
Main storage 3x4Tb Western Digital Green (with the hard drive hack applied)
Jails on 2x500Gb in Mirror, 1 is Western Digital Blue, the other I forget, it may actually be 2xWD Blue.

It's frozen twice now in approx 1 week, rebooted router thinking it might be a network issue but nothing, the router shows FreeNAS and Plex as being offline.

IP for everything I use is assigned within Pfsense, also inside of FreeNAS. As I always have.
It's only started since I moved over to FreeNAS 11.0.

I have to force the system to shut down, single power button press does nothing.

I only have 1 jail running which I rebuilt in FreeNAS 11.0 to ensure all worked as well as possible. This is stored on the 2x500Gb Mirror.

Space is running a little tight, 83% in use but that message has been with me for a long time and had no issues, I generally convert over time x264 to x265 to save space.

Any ideas?
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,175
I should point out that RC3 is Release Candidate 3, not an actual 11.0.3 stable version.

In any case, we really need something more specific to work with, so logs and descriptions of what you were doing would help.
 

Dwibs

Dabbler
Joined
May 22, 2017
Messages
15
I'll have a look at the logs, never looked in there before. I'll check once I get home tonight.

Yes I am aware it's RC3, it's in the thread title!!

Woke up and tried to access shares, nothing working, router showed not available on network.
System had to be forced down, frozen.

Only jail I have running is Plex but wasn't in use at the time.
 

Dwibs

Dabbler
Joined
May 22, 2017
Messages
15
Hi I copied most of which looked like issues, plenty more of these file writing errors before this.
But looked like it crashed after 3am this morning. I forced it to shut down this morning at 6:30am when I tried to access freenas and wasn't available.

I'm an experienced FreeNAS user but saying that i've not really had much issues, this is way above me.

Does this make sense to the wizards?
Code:
May 31 02:52:39 freenas syslog-ng[1505]: Error opening file for writing; filena$													
May 31 02:53:27 freenas syslog-ng[1505]: Error opening file for writing; filena$													
May 31 02:53:27 freenas collectd[3156]: aggregation plugin: Unable to read the $													
May 31 02:53:27 freenas collectd[3156]: utils_vl_lookup: The user object callba$													
May 31 02:54:27 freenas syslog-ng[1505]: Error opening file for writing; filena$													
May 31 02:55:27 freenas syslog-ng[1505]: Error opening file for writing; filena$													
May 31 02:56:27 freenas syslog-ng[1505]: Error opening file for writing; filena$													
May 31 02:57:27 freenas syslog-ng[1505]: Error opening file for writing; filena$													
May 31 02:58:27 freenas syslog-ng[1505]: Error opening file for writing; filena$													
May 31 02:59:27 freenas syslog-ng[1505]: Error opening file for writing; filena$													
May 31 03:00:27 freenas syslog-ng[1505]: Error opening file for writing; filena$													
May 31 03:01:27 freenas syslog-ng[1505]: Error opening file for writing; filena$
May 31 03:02:17 freenas /find_alias_for_smtplib.py: [common.system:293] Failed $													
Traceback (most recent call last):																								
  File "/usr/local/www/freenasUI/common/system.py", line 274, in send_mail														
	server = _get_smtp_server(timeout, local_hostname=local_hostname)															  
  File "/usr/local/www/freenasUI/common/system.py", line 197, in _get_smtp_serv$													
	local_hostname=local_hostname)																								
  File "/usr/local/lib/python3.6/smtplib.py", line 1029, in __init__																
	source_address)																												
  File "/usr/local/lib/python3.6/smtplib.py", line 251, in __init__																
	(code, msg) = self.connect(host, port)																						
  File "/usr/local/lib/python3.6/smtplib.py", line 335, in connect																
	self.sock = self._get_socket(host, port, self.timeout)																		
  File "/usr/local/lib/python3.6/smtplib.py", line 1035, in _get_socket															
	self.source_address)																											
  File "/usr/local/lib/python3.6/socket.py", line 722, in create_connection														
	raise err																													  
  File "/usr/local/lib/python3.6/socket.py", line 713, in create_co
May 31 03:02:17 freenas /find_alias_for_smtplib.py: nnection																		
	sock.connect(sa)																												
TimeoutError: [Errno 60] Operation timed out																						
May 31 03:02:25 freenas /find_alias_for_smtplib.py: [common.system:293] Failed $													
Traceback (most recent call last):																								
  File "/usr/local/www/freenasUI/common/system.py", line 274, in send_mail														
	server = _get_smtp_server(timeout, local_hostname=local_hostname)															  
  File "/usr/local/www/freenasUI/common/system.py", line 197, in _get_smtp_serv$													
	local_hostname=local_hostname)																								
  File "/usr/local/lib/python3.6/smtplib.py", line 1029, in __init__

   source_address)																												
  File "/usr/local/lib/python3.6/smtplib.py", line 251, in __init__																
	(code, msg) = self.connect(host, port)																						
  File "/usr/local/lib/python3.6/smtplib.py", line 335, in connect																
	self.sock = self._get_socket(host, port, self.timeout)																		
  File "/usr/local/lib/python3.6/smtplib.py", line 1035, in _get_socket															
	self.source_address)																											
  File "/usr/local/lib/python3.6/socket.py", line 722, in create_connection														
	raise err																													  
  File "/usr/local/lib/python3.6/socket.py", line 713, in create_co		  
May 31 03:02:25 freenas /find_alias_for_smtplib.py: nnection																		
	sock.connect(sa)																												
TimeoutError: [Errno 60] Operation timed out																						
May 31 03:02:27 freenas syslog-ng[1505]: Error opening file for writing; filena$
 
Last edited by a moderator:

Dwibs

Dabbler
Joined
May 22, 2017
Messages
15
I should point out that RC3 is Release Candidate 3, not an actual 11.0.3 stable version.

In any case, we really need something more specific to work with, so logs and descriptions of what you were doing would help.
Does this mean anything to you? Python related??
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,175
The traceback should be useful for the devs. Please file a bug report, include the traceback, and post the issue number here.
 

Dwibs

Dabbler
Joined
May 22, 2017
Messages
15
Turned off all SMART tests and Scrubs. Still crashes.
Jun 5 00:00:00 freenas newsyslog[87507]: logfile turned over due to size>200K
Jun 5 00:00:00 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 00:00:00 freenas syslog-ng[1505]: Configuration reload request received, reloading configuration;
Jun 5 00:01:00 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'

Jun 5 02:51:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
****LOTS OF THESE***
Jun 5 01:17:16 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 01:17:16 freenas collectd[3143]: aggregation plugin: Unable to read the current rate of "freenas.local/cpu-5/cpu-user".
Jun 5 01:17:16 freenas collectd[3143]: aggregation plugin: Unable to read the current rate of "freenas.local/cpu-4/cpu-user".
Jun 5 01:17:16 freenas collectd[3143]: utils_vl_lookup: The user object callback failed with status 2.
Jun 5 01:17:16 freenas collectd[3143]: utils_vl_lookup: The user object callback failed with status 2.
Jun 5 01:18:16 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
***AGAIN ALOT OF THESE FILE WRITING ERRORS***
Jun 5 02:52:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 02:53:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 02:54:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 02:55:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 02:56:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 02:57:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 02:58:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 02:59:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 03:00:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 03:01:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 03:02:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 03:02:21 freenas /find_alias_for_smtplib.py: [common.system:293] Failed to send email: [Errno 60] Operation timed out
Traceback (most recent call last):
File "/usr/local/www/freenasUI/common/system.py", line 274, in send_mail
server = _get_smtp_server(timeout, local_hostname=local_hostname)
File "/usr/local/www/freenasUI/common/system.py", line 197, in _get_smtp_server
local_hostname=local_hostname)
File "/usr/local/lib/python3.6/smtplib.py", line 1029, in __init__
source_address)
File "/usr/local/lib/python3.6/smtplib.py", line 251, in __init__
(code, msg) = self.connect(host, port)
File "/usr/local/lib/python3.6/smtplib.py", line 335, in connect
self.sock = self._get_socket(host, port, self.timeout)
File "/usr/local/lib/python3.6/smtplib.py", line 1035, in _get_socket
self.source_address)
File "/usr/local/lib/python3.6/socket.py", line 722, in create_connection
raise err
File "/usr/local/lib/python3.6/socket.py", line 713, in create_co
Jun 5 03:02:21 freenas /find_alias_for_smtplib.py: nnection
sock.connect(sa)
TimeoutError: [Errno 60] Operation timed out
Jun 5 03:03:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
Jun 5 03:04:20 freenas syslog-ng[1505]: Error opening file for writing; filename='/dev/console', error='Device not configured (6)'
***AT THIS POINT FROZEN I BELIEVE***
***REBOOTED AND RUNNING FINE***
 

Dwibs

Dabbler
Joined
May 22, 2017
Messages
15
They are looking in to it and given a few more details, hopefully help and find what is causing this.
 

Dwibs

Dabbler
Joined
May 22, 2017
Messages
15
Hasn't frozen in some time. I personally think it was VPN connection the Freenas ran through the cause the email system on FreeNAS to have an issue and crash.
Nothing else makes sense.

As soon as I took off VPN internet, the emails started coming through and no crashes.

Odd how emails would crash a FreeNAS server.

I've updated to the latest version since then. Readded all my scrubs and SMART test. Running great. Fingers crossed.
 
Status
Not open for further replies.
Top