netdata critical alert RAM in use

[Wolfeman0101]

I just upgraded to 11.2-Beta1 and I'm getting alerts in my email about RAM usage.

system.ramCHART
ram in use = 98.5%
system RAM usageALARM
ramFAMILY
Escalated to CRITICALSEVERITY
Mon Jul 9 22:51:51 PDT 2018

Is this a false alert?

 

[Chris Moore]

I just upgraded to 11.2-Beta1 and I'm getting alerts in my email about RAM usage.

system.ramCHART
ram in use = 98.5%
system RAM usageALARM
ramFAMILY
Escalated to CRITICALSEVERITY
Mon Jul 9 22:51:51 PDT 2018

Is this a false alert?

Did you configure the system to send you alerts for this?
It'sa BETA version, if it is doing something wrong, file a bug report.


Sent from my SAMSUNG-SGH-I537 using Tapatalk

 

[Wolfeman0101]

I didn't change anything in the netdata configs or alerts so it has to be a default one. I'm not sure if it's something I should be worried about or it's a false positive and the alert needs to be turned off or fixed.

 

[anodos]

This is a bug in netdata 1.10. Try the fix in post 16 here: https://redmine.ixsystems.com/issues/38105 Hopefully we'll get it into the next beta.

Code:

root@catherder:/usr/local/etc/netdata/health.d # diff -u ram.conf.orig ram.conf
--- ram.conf.orig	2018-07-19 16:30:05.469086542 -0400
+++ ram.conf	2018-07-19 16:27:21.613835425 -0400
@@ -3,7 +3,7 @@

   alarm: used_ram_to_ignore
	  on: system.ram
-	  os: linux
+	  os: linux freebsd
   hosts: *
	calc: ($zfs.arc_size.arcsz = nan)?(0):($zfs.arc_size.arcsz)
   every: 10s

Version 1.10 added extra logging for FreeBSD.

 

[bodriye]

Any progress on this @anodos I am constantly spammed with RAM usage warnings in RC2.

 

[Dariusz1989]

Any progress on this @anodos I am constantly spammed with RAM usage warnings in RC2.

Well thats a bummer, I was hoping that in RC2 it would be fixed :- (

 

[bodriye]

@Dariusz1989 @anodos @Wolfeman0101 this work around worked for me:

edit /conf/base/etc/local/netdata/health.d/ram.conf
change line 51:

Code:

   to: silent

edit /conf/base/etc/local/netdata/health.d/swap.conf
change line 17:

Code:

   to: silent

and reboot

 

[Dariusz1989]

@Dariusz1989 @anodos @Wolfeman0101 this work around worked for me:

edit /conf/base/etc/local/netdata/health.d/ram.conf
change line 51:

Code:

   to: silent

edit /conf/base/etc/local/netdata/health.d/swap.conf
change line 17:

Code:

   to: silent

and reboot

Hey

Sorry for this again, but where on earth do I find the /conf/base/etc ? Im on window & I can use ssh if I need to.

 

[bodriye]

Hey

Sorry for this again, but where on earth do I find the /conf/base/etc ? Im on window & I can use ssh if I need to.

If you prefer gui then you need to enable ssh on freenas (under services). Then download WinSCP program, use sftp and root credentials to login to freenas using winscp.
On right side of the screen you will see freenas files and left side will be your local windows files.
Next steps will be done on right side of the screen.
1) Click on the first item in list of folders (2 dots ..) until you reach root of the file system (with folders like conf, etc, usr, home etc)
2) double click on conf, then base, then etc, then local, then netdata, then health.d
3) when in health.d folder double click on ram.conf and it will open text editor and then you can make changes to lines I listed above
4) save and close
5) repeat steps 3 and 4 for swap.conf file.
6) you can close winscp now and disable ssh in services if you want to
7) reboot freenas.

 

[Wolfeman0101]

Silencing the alarms isn't fixing the issue. 11.2 is not managing RAM correctly.

 

[Chris Moore]

Did you submit a bug report?

Sent from my SAMSUNG-SGH-I537 using Tapatalk

 

[anodos]

I believe this may help some with swap/memory usage: https://redmine.ixsystems.com/issues/54693

 

[FlangeMonkey]

Hi Guys,

I'm on 11.2 and getting these alarms. Was it resolved?

Thanks,

 

[Wolfeman0101]

Hi Guys,

I'm on 11.2 and getting these alarms. Was it resolved?

Thanks,

I had to manually set my zfs arc or it would non stop SWAP

 

[nojohnny101]

Has there been any movement on this? I get numerous amount of these every day.

 

[SweetAndLow]

Has there been any movement on this? I get numerous amount of these every day.

Supposed to be fixed in 11.2-U2. I'm not sure if it happened though.

 

[nojohnny101]

Supposed to be fixed in 11.2-U2. I'm not sure if it happened though.

Ok. I am not updating right now because of how it breaks jails. I guess I'll wait and check back in on it in a couple of months. I did modify the conf figure manually and it seems to stop them for now, now sure if it will survive a reboot though.

 

[Wolfeman0101]

Ok. I am not updating right now because of how it breaks jails. I guess I'll wait and check back in on it in a couple of months. I did modify the conf figure manually and it seems to stop them for now, now sure if it will survive a reboot though.

For what it's worth I upgraded and it seems to be better now but I haven't tested a ton.