hourly error-mail

[Davidaff]

hi,

i have the last days trouble with my freenas 8.3.1
Every Hour it sends a error mail with the following content:

tar: Failed to open '/data/rrd_dir.tar.bz2.1653'
or
tar: Failed to open '/data/rrd_dir.tar.bz2.931'
or
tar: Failed to open '/data/rrd_dir.tar.bz2.2782'

I have reboot the machine, then i restart collectd service, then remove the default rrd_dir.tar.bz file,
but allways the error exists :(

Can anyone help me to locate the problem?
i did'nt find a note in my logs.

kind regards

David

 

[gpsguy]

Your flash drive is probably starting to fail. Backup your config, reinstall FreeNAS on a new flash drive, and restore your configuration file.

Older versions of FreeNAS can be found here: http://download.freenas.org/

 

[Davidaff]

Sorry, but i don't use a flash drive.
Its a Hardware Raid 1 with 2 WD 250GB Discs on a LSI Logic Controller, where freenas is installed .
This raid is healthy without any errors.

I can't find the files in /data. This files are doesn't exists.
But the file rrd_dir.tar.bz2 exists.

Any other ideas?

 

[cyberjock]

Please read the forum rules and add the required information if you would like support.

Thanks.

 

[Whattteva]

Sorry, but i don't use a flash drive.
Its a Hardware Raid 1 with 2 WD 250GB Discs on a LSI Logic Controller, where freenas is installed .
This raid is healthy without any errors.

I can't find the files in /data. This files are doesn't exists.
But the file rrd_dir.tar.bz2 exists.

Any other ideas?

You need to post your detailed setup or you'll just keep getting answers that try to make random guesses at your setup. No one can read your mind (at least I haven't seen anyone claiming to be Ms. Cleo here).
If you want real informed answers that will actually help you, follow cyberjock's suggestion.

 

[Ericloewe]

You need to post your detailed setup or you'll just keep getting answers that try to make random guesses at your setup. No one can read your mind (at least I haven't seen anyone claiming to be Ms. Cleo here).
If you want real informed answers that will actually help you, follow cyberjock's suggestion.

I do tea leaf-reading, palm-reading, cast and remove curses and perform sacrifices of old mass storage devices to Cthulhu and most other deities. :D

 

[Whattteva]

How about exorcism? I hear some churches need that service also. May want to expand your services so you can get a piece of that pie, too! Lots of money at stake there.

 

[Ericloewe]

How about exorcism? I hear some churches need that service also. May want to expand your services so you can get a piece of that pie, too! Lots of money at stake there.

Nah, I used to do exorcisms. The part movies don't tell you is that these people typically need a psychiatrist, not an exorcist. :D

 

[Davidaff]

Hi,

i dont know exaktly, which information u need about this problem.
Here are any parts from the dmesg output:

[root@nas] ~# dmesg
Copyright (c) 1992-2012 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.3-RELEASE-p7 #1 r249203M: Sat Apr 6 09:28:27 PDT 2013
root@build.ixsystems.com:/tank/home/jpaetzel/fn8.3/freenas/os-base/amd64/tank/home/jpaetzel/fn8.3/freenas/FreeBSD/src/sys/FREENAS.amd64 amd64
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU E5405 @ 2.00GHz (2000.01-MHz K8-class CPU)
Origin = "GenuineIntel" Id = 0x1067a Family = 6 Model = 17 Stepping = 10
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x40ce33d<SSE3,DTES64,MON,DS_CPL,VMX,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE>
AMD Features=0x20100800<SYSCALL,NX,LM>
AMD Features2=0x1<LAHF>
TSC: P-state invariant
real memory = 8589934592 (8192 MB)
avail memory = 8242786304 (7860 MB)
ACPI APIC Table: <PTLTD APIC >
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 2 package(s) x 4 core(s)
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
cpu2 (AP): APIC ID: 2
cpu3 (AP): APIC ID: 3
cpu4 (AP): APIC ID: 4
cpu5 (AP): APIC ID: 5
cpu6 (AP): APIC ID: 6
cpu7 (AP): APIC ID: 7
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
kbd1 at kbdmux0
hpt27xx: RocketRAID 27xx controller driver v1.0 (Apr 6 2013 09:28:15)
cryptosoft0: <software crypto> on motherboard
aesni0: No AESNI support.
acpi0: <PTLTD RSDT> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
unknown: I/O range not supported
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 0.0 on pci3
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 0.2 on pci3
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> irq 18 at device 2.0 on pci2
pci6: <ACPI PCI bus> on pcib6
em0: <Intel(R) PRO/1000 Network Connection 7.3.2> port 0x2000-0x201f mem 0xd8220000-0xd823ffff,0xd8200000-0xd821ffff irq 18 at device 0.0 on pci6
em0: Using an MSI interrupt
em0: [FILTER]
em0: Ethernet address: 00:30:48:d3:72:80
em1: <Intel(R) PRO/1000 Network Connection 7.3.2> port 0x2020-0x203f mem 0xd8260000-0xd827ffff,0xd8240000-0xd825ffff irq 19 at device 0.1 on pci6
em1: Using an MSI interrupt
em1: [FILTER]
em1: Ethernet address: 00:30:48:d3:72:81
pcib7: <ACPI PCI-PCI bridge> at device 0.3 on pci1
pci7: <ACPI PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci8: <ACPI PCI bus> on pcib8
aac0: <Adaptec RAID 52445> mem 0xd8000000-0xd81fffff irq 16 at device 0.0 on pci 8
aac0: Enabling 64-bit address support
aac0: Enable Raw I/O
aac0: Enable 64-bit array
aac0: New comm. interface enabled
aac0: [ITHREAD]
aac0: Adaptec 52445, aac driver 2.1.9-1
aacp0: <SCSI Passthrough Bus> on aac0
aacp1: <SCSI Passthrough Bus> on aac0
aacp2: <SCSI Passthrough Bus> on aac0
pcib9: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci9: <ACPI PCI bus> on pcib9
pci9: <serial bus, USB> at device 0.0 (no driver attached)
pci0: <base peripheral> at device 8.0 (no driver attached)
pcib10: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0
pci10: <ACPI PCI bus> on pcib10
em2: <Intel(R) PRO/1000 Network Connection 7.3.2> port 0x3000-0x301f mem 0xd8420000-0xd843ffff,0xd8400000-0xd841ffff irq 16 at device 0.0 on pci10
em2: Using an MSI interrupt
em2: [FILTER]
em2: Ethernet address: 00:1b:21:9a:c2:a0
em3: <Intel(R) PRO/1000 Network Connection 7.3.2> port 0x3020-0x303f mem 0xd8460000-0xd847ffff,0xd8440000-0xd845ffff irq 17 at device 0.1 on pci10
em3: Using an MSI interrupt
em3: [FILTER]
em3: Ethernet address: 00:1b:21:9a:c2:a1
uhci0: <Intel 631XESB/632XESB/3100 USB controller USB-1> port 0x1800-0x181f irq 17 at device 29.0 on pci0
uhci0: [ITHREAD]
usbus0: <Intel 631XESB/632XESB/3100 USB controller USB-1> on uhci0
uhci1: <Intel 631XESB/632XESB/3100 USB controller USB-2> port 0x1820-0x183f irq 19 at device 29.1 on pci0
uhci1: [ITHREAD]
usbus1: <Intel 631XESB/632XESB/3100 USB controller USB-2> on uhci1
uhci2: <Intel 631XESB/632XESB/3100 USB controller USB-3> port 0x1840-0x185f irq 18 at device 29.2 on pci0
uhci2: [ITHREAD]
usbus2: <Intel 631XESB/632XESB/3100 USB controller USB-3> on uhci2
ehci0: <Intel 63XXESB USB 2.0 controller> mem 0xd8900000-0xd89003ff irq 17 at device 29.7 on pci0
ehci0: [ITHREAD]
usbus3: EHCI version 1.0
usbus3: <Intel 63XXESB USB 2.0 controller> on ehci0
pcib11: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci11: <ACPI PCI bus> on pcib11
vgapci0: <VGA-compatible display> port 0x4000-0x40ff mem 0xd0000000-0xd7ffffff,0xd8600000-0xd860ffff irq 18 at device 1.0 on pci11
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 63XXESB2 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1860-0x186f at device 31.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
ata0: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
acpi_button0: <Power Button> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: [FILTER]
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart1: [FILTER]
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FILTER]
ppc0: <Parallel port> port 0x378-0x37f,0x778-0x77f irq 7 drq 3 on acpi0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/9 bytes threshold
ppc0: [ITHREAD]
ppbus0: <Parallel port bus> on ppc0
lpt0: <Printer> on ppbus0
lpt0: [ITHREAD]
lpt0: Interrupt-driven port
orm0: <ISA Option ROMs> at iomem 0xc0000-0xcafff,0xcb000-0xcbfff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
coretemp2: <CPU On-Die Thermal Sensors> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
coretemp3: <CPU On-Die Thermal Sensors> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
coretemp4: <CPU On-Die Thermal Sensors> on cpu4
p4tcc4: <CPU Frequency Thermal Control> on cpu4
coretemp5: <CPU On-Die Thermal Sensors> on cpu5
p4tcc5: <CPU Frequency Thermal Control> on cpu5
coretemp6: <CPU On-Die Thermal Sensors> on cpu6
p4tcc6: <CPU Frequency Thermal Control> on cpu6
coretemp7: <CPU On-Die Thermal Sensors> on cpu7
p4tcc7: <CPU Frequency Thermal Control> on cpu7
fuse4bsd: version 0.3.9-pre1, FUSE ABI 7.8
Timecounters tick every 1.000 msec
hpt27xx: no controller detected.
aacd0: <RAID 1 (Mirror)> on aac0
aacd0: 304118MB (622833664 sectors)
aacd1: <RAID 5> on aac0
aacd1: 12393462MB (25381810176 sectors)
GEOM_RAID5: Module loaded, version 1.1.20110927.40 (rev 00ce00e5abb4)
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen2.1: <Intel> at usbus2
uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen3.1: <Intel> at usbus3
uhub3: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
GEOM: aacd0s1: geometry does not match label (16h,63s != 255h,63s).
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub3: 6 ports with 6 removable, self powered
SMP: AP CPU #6 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #4 Launched!
Trying to mount root from ufs:/dev/ufs/FreeNASs1a
ZFS filesystem version 5
ZFS storage pool version 28
GEOM_ELI: Device aacd1p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI: Crypto: software
em0: link state changed to UP
em1: link state changed to UP
em2: link state changed to UP
lagg0: link state changed to UP
em3: link state changed to UP

and diskspaces are:

[root@nas] ~# df -h
Filesystem Size Used Avail Capacity Mounted on
/dev/ufs/FreeNASs1a 926M 467M 385M 55% /
devfs 1.0k 1.0k 0B 100% /dev
/dev/md0 4.6M 3.2M 969k 77% /etc
/dev/md1 823k 2.0k 756k 0% /mnt
/dev/md2 149M 42M 95M 31% /var
/dev/ufs/FreeNASs4 19M 810k 17M 4% /data
NAS 3.0T 10G 3T 0% /mnt/NAS
NAS/BACKUP 3T 59k 3T 0% /mnt/NAS/BACKUP
NAS/BACKUP/LINUX 5.2T 2.2T 3T 42% /mnt/NAS/BACKUP/LINUX

configured crons:

[root@nas] ~# cat /etc/crontab
# /etc/crontab - root's crontab for FreeBSD
#
# $FreeBSD: src/etc/crontab,v 1.33.2.1 2009/08/03 08:13:06 kensmith Exp $
#
SHELL=/bin/sh
PATH=/etc:/bin:/sbin:/usr/bin:/usr/sbin
#
#minute hour mday month wday who command
#
*/5 * * * * root /usr/libexec/atrun
#
# Save some entropy so that /dev/random can re-seed on boot.
*/11 * * * * operator /usr/libexec/save-entropy
#
# Rotate log files every hour, if necessary.
0 * * * * root newsyslog
#
# Perform daily/weekly/monthly maintenance.
1 3 * * * root periodic daily
15 4 * * 6 root periodic weekly
30 5 1 * * root periodic monthly
#
# Adjust the time zone if the CMOS clock keeps local time, as opposed to
# UTC time. See adjkerntz(8) for details.
1,31 0-5 * * * root adjkerntz -a

*/5 * * * * root /usr/local/bin/python /usr/local/bin/graph.py
0 * * * * root /bin/sh /root/save_rrds.sh

0 * * * * root /usr/local/bin/python /usr/local/bin/mfistatus.py > /dev/null 2>&1
*/5 * * * * root /usr/local/bin/python /usr/local/www/freenasUI/tools/alert.py > /dev/null 2>&1
* * * * * root /usr/local/bin/python /usr/local/www/freenasUI/tools/autosnap.py > /dev/null 2>&1

15 3 * * * root /usr/local/bin/python /usr/local/www/freenasUI/tools/cachetool.py expire >/dev/null 2>&1
30 3 * * * root /usr/local/bin/python /usr/local/www/freenasUI/tools/cachetool.py fill >/dev/null 2>&1
0 3 * * * root find /tmp/ -iname "sessionid*" -ctime +1d -delete
00 00 * 1,2,3,4,5,6,7,8,9,10,11,12 7 root PATH="/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/root/bin" /usr/local/sbin/scrub -t 35 NAS

All services ( NFS / CIFS (no more services needed )) works fine.

If u need more or other informations, please tell me.

best regards

 

[cyberjock]

Can you provide the debug file for your server? That post is still a tiny fraction of the info asked for in the forums.

 

[Davidaff]

so, here is the debug output. i cant find any errors.
I hope you see more than me :) I have no idea what it is triggered.

I changed the configured IP to xxx, also i change the encrypted passwords and domain name.