AD connection flapping after upgrade to U5

[deafen]

Things were working fine under 11.1-U4. I needed to change the boot device, so I saved the config, did a clean U5 install, and applied the saved config.

After the config was loaded, CIFS and AD were turned off. That's happened to me before on an upgrade, so I didn't concern myself much. I enabled AD and that's when the problems started.

The system can't seem to maintain a connection to AD, and various parts are stopping and starting every few seconds. (I apologize for how long these log files are. I left in a lot of redundant information because it seems weird how many similar things are happening simultaneously):

Show : Log excerpt

Code:

Jun 13 14:13:47 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:13:49 delta ActiveDirectory: /usr/sbin/service samba_server forcestop
Jun 13 14:13:49 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:13:53 delta ActiveDirectory: /usr/sbin/service ix-kinit forcestop
Jun 13 14:13:53 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 14:13:53 delta ActiveDirectory: /usr/sbin/service ix-kerberos restart
Jun 13 14:13:54 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstop
Jun 13 14:13:54 delta ActiveDirectory: /usr/sbin/service ix-pam quietstop
Jun 13 14:13:56 delta ActiveDirectory: /usr/sbin/service ix-cache quietstop &
Jun 13 14:14:23 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:14:25 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 14:14:26 delta ActiveDirectory: /usr/sbin/service ix-kerberos quietstart default [domain name redacted]
Jun 13 14:14:29 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstart
Jun 13 14:14:30 delta ActiveDirectory: /usr/sbin/service ix-ldap quietstart
Jun 13 14:14:30 delta ActiveDirectory: /usr/sbin/service ix-kinit quietstart
Jun 13 14:14:34 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:14:34 delta ActiveDirectory: /usr/sbin/service ix-kinit status
Jun 13 14:14:35 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:14:35 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 14:14:36 delta ActiveDirectory: /usr/sbin/service ix-kerberos quietstart default [domain name redacted]
Jun 13 14:14:41 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstart
Jun 13 14:14:41 delta ActiveDirectory: /usr/sbin/service ix-activedirectory quietstart
Jun 13 14:14:41 delta ActiveDirectory: /usr/sbin/service ix-ldap quietstart
Jun 13 14:14:41 delta ActiveDirectory: /usr/sbin/service ix-kinit quietstart
Jun 13 14:14:46 delta ActiveDirectory: /usr/sbin/service ix-kinit status
Jun 13 14:14:47 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:14:49 delta ActiveDirectory: /usr/sbin/service ix-activedirectory status
Jun 13 14:14:52 delta ActiveDirectory: /usr/sbin/service ix-activedirectory quietstart
Jun 13 14:14:53 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:14:54 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:14:58 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:15:00 delta ActiveDirectory: /usr/sbin/service ix-pam quietstart
Jun 13 14:15:01 delta ActiveDirectory: /usr/sbin/service ix-cache quietstart &
Jun 13 14:15:03 delta ActiveDirectory: /usr/sbin/service samba_server forcestop
Jun 13 14:15:05 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:15:06 delta /cachetool.py: [common.freenasusers:335] Directory Users could not be retrieved: __init__() got an unexpected keyword argument 'dir'
Traceback (most recent call last):
  File "/usr/local/www/freenasUI/common/freenasusers.py", line 332, in __init__
	self.__users = dir(**kwargs)
  File "/usr/local/www/freenasUI/common/freenasldap.py", line 2587, in __init__
	self.__ucache[n] = FreeNAS_UserCache(dir=n)
  File "/usr/local/www/freenasUI/common/freenascache.py", line 517, in __new__
	obj = FreeNAS_BaseCache(**kwargs)
TypeError: __init__() got an unexpected keyword argument 'dir'
Jun 13 14:15:07 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:15:09 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 14:15:10 delta ActiveDirectory: /usr/sbin/service ix-kerberos quietstart default [domain name redacted]
Jun 13 14:15:10 delta ActiveDirectory: /usr/sbin/service ix-kinit forcestop
Jun 13 14:15:10 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 14:15:10 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstart
Jun 13 14:15:11 delta ActiveDirectory: /usr/sbin/service ix-kerberos restart
Jun 13 14:15:11 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstop
Jun 13 14:15:11 delta ActiveDirectory: /usr/sbin/service ix-ldap quietstart
Jun 13 14:15:11 delta ActiveDirectory: /usr/sbin/service ix-kinit quietstart
Jun 13 14:15:11 delta ActiveDirectory: /usr/sbin/service ix-kinit status
Jun 13 14:15:12 delta ActiveDirectory: /usr/sbin/service ix-pam quietstop
Jun 13 14:15:12 delta uwsgi: [middleware.exceptions:36] [MiddlewareError: Active Directory failed to reload.]
Jun 13 14:15:14 delta ActiveDirectory: /usr/sbin/service ix-cache quietstop &
Jun 13 14:16:56 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:16:57 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 14:16:58 delta ActiveDirectory: /usr/sbin/service ix-kerberos quietstart default [domain name redacted]
Jun 13 14:17:01 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstart
Jun 13 14:17:01 delta ActiveDirectory: /usr/sbin/service ix-ldap quietstart
Jun 13 14:17:01 delta ActiveDirectory: /usr/sbin/service ix-kinit quietstart
Jun 13 14:17:06 delta ActiveDirectory: /usr/sbin/service ix-kinit status
Jun 13 14:17:06 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:17:12 delta ActiveDirectory: /usr/sbin/service ix-activedirectory quietstart
Jun 13 14:17:20 delta ActiveDirectory: /usr/sbin/service ix-activedirectory status
Jun 13 14:17:24 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:17:25 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:17:31 delta ActiveDirectory: /usr/sbin/service ix-pam quietstart
Jun 13 14:17:32 delta ActiveDirectory: /usr/sbin/service ix-cache quietstart &
Jun 13 14:27:35 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:27:37 delta ActiveDirectory: /usr/sbin/service samba_server forcestop
Jun 13 14:27:37 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:27:40 delta ActiveDirectory: /usr/sbin/service ix-kinit forcestop
Jun 13 14:27:41 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 14:27:41 delta ActiveDirectory: /usr/sbin/service ix-kerberos restart
Jun 13 14:27:42 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstop
Jun 13 14:27:42 delta ActiveDirectory: /usr/sbin/service ix-pam quietstop
Jun 13 14:27:43 delta ActiveDirectory: /usr/sbin/service ix-cache quietstop &
Jun 13 14:32:22 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:32:24 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 14:32:25 delta ActiveDirectory: /usr/sbin/service ix-kerberos quietstart default [domain name redacted]
Jun 13 14:32:28 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstart
Jun 13 14:32:28 delta ActiveDirectory: /usr/sbin/service ix-ldap quietstart
Jun 13 14:32:28 delta ActiveDirectory: /usr/sbin/service ix-kinit quietstart
Jun 13 14:32:33 delta ActiveDirectory: /usr/sbin/service ix-kinit status
Jun 13 14:32:33 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:32:39 delta ActiveDirectory: /usr/sbin/service ix-activedirectory quietstart
Jun 13 14:32:47 delta ActiveDirectory: /usr/sbin/service ix-activedirectory status
Jun 13 14:32:53 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:32:55 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:33:00 delta ActiveDirectory: /usr/sbin/service ix-pam quietstart
Jun 13 14:33:02 delta ActiveDirectory: /usr/sbin/service ix-cache quietstart &
Jun 13 14:42:41 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:42:43 delta ActiveDirectory: /usr/sbin/service samba_server forcestop
Jun 13 14:42:43 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:42:47 delta ActiveDirectory: /usr/sbin/service ix-kinit forcestop
Jun 13 14:42:47 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 14:42:48 delta ActiveDirectory: /usr/sbin/service ix-kerberos restart
Jun 13 14:42:48 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstop
Jun 13 14:42:49 delta ActiveDirectory: /usr/sbin/service ix-pam quietstop
Jun 13 14:42:50 delta ActiveDirectory: /usr/sbin/service ix-cache quietstop &
Jun 13 14:44:20 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:44:22 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 14:44:23 delta ActiveDirectory: /usr/sbin/service ix-kerberos quietstart default [domain name redacted]
Jun 13 14:44:26 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstart
Jun 13 14:44:26 delta ActiveDirectory: /usr/sbin/service ix-ldap quietstart
Jun 13 14:44:26 delta ActiveDirectory: /usr/sbin/service ix-kinit quietstart
Jun 13 14:44:31 delta ActiveDirectory: /usr/sbin/service ix-kinit status
Jun 13 14:44:31 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:44:37 delta ActiveDirectory: /usr/sbin/service ix-activedirectory quietstart
Jun 13 14:44:46 delta ActiveDirectory: /usr/sbin/service ix-activedirectory status
Jun 13 14:44:51 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:44:53 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:44:58 delta ActiveDirectory: /usr/sbin/service ix-pam quietstart
Jun 13 14:44:59 delta ActiveDirectory: /usr/sbin/service ix-cache quietstart &
Jun 13 14:47:03 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 14:47:05 delta ActiveDirectory: /usr/sbin/service samba_server forcestop
Jun 13 14:47:06 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 14:47:09 delta ActiveDirectory: /usr/sbin/service ix-kinit forcestop
Jun 13 14:47:09 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 14:47:10 delta ActiveDirectory: /usr/sbin/service ix-kerberos restart
Jun 13 14:47:10 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstop
Jun 13 14:47:11 delta ActiveDirectory: /usr/sbin/service ix-pam quietstop
Jun 13 14:47:12 delta ActiveDirectory: /usr/sbin/service ix-cache quietstop &

Here's the log with verbose logging enabled, starting when I click "Save" on the AD config page. I can't make sense of what it's doing; it looks like there are multiple processes trying to do the join simultaneously (15:09:25, 15:09:30), then it does the health check every couple seconds (15:10:12-15:10:42), then finally settles into the every-60-second health checks at 15:12:59.

However: at 15:17:18, it flaps again with log messages identical to the beginning of this log (notifier.stop, forcestop, etc.)

Show : Verbose log

Code:

Jun 13 15:08:52 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 15:08:53 delta ActiveDirectory: /usr/sbin/service samba_server forcestop
Jun 13 15:08:54 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 15:08:57 delta ActiveDirectory: /usr/sbin/service ix-kinit forcestop
Jun 13 15:08:57 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 15:08:58 delta ActiveDirectory: /usr/sbin/service ix-kerberos restart
Jun 13 15:08:58 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstop
Jun 13 15:08:59 delta ActiveDirectory: /usr/sbin/service ix-pam quietstop
Jun 13 15:09:00 delta ActiveDirectory: /usr/sbin/service ix-cache quietstop &
Jun 13 15:09:02 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 15:09:04 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 15:09:05 delta ActiveDirectory: /usr/sbin/service ix-kerberos quietstart default [domain redacted]
Jun 13 15:09:24 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstart
Jun 13 15:09:25 delta ActiveDirectory: /usr/sbin/service ix-ldap quietstart
Jun 13 15:09:25 delta ActiveDirectory: /usr/sbin/service ix-kinit quietstart
Jun 13 15:09:25 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 15:09:25 delta ActiveDirectory: kerberos_start: /usr/bin/kinit --renewable --password-file=/tmp/tmp.nc9YMPAP administrator@[domain redacted]
Jun 13 15:09:26 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 15:09:26 delta ActiveDirectory: /usr/sbin/service ix-kerberos quietstart default [domain redacted]
Jun 13 15:09:29 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstart
Jun 13 15:09:29 delta ActiveDirectory: kerberos_start: Successful
Jun 13 15:09:29 delta ActiveDirectory: /usr/sbin/service ix-kinit status
Jun 13 15:09:30 delta ActiveDirectory: /usr/sbin/service ix-ldap quietstart
Jun 13 15:09:30 delta ActiveDirectory: /usr/sbin/service ix-kinit quietstart
Jun 13 15:09:30 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:09:30 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:09:30 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 15:09:30 delta ActiveDirectory: kerberos_start: /usr/bin/kinit --renewable --password-file=/tmp/tmp.f415NBl9 administrator@[domain redacted]
Jun 13 15:09:34 delta ActiveDirectory: kerberos_start: Successful
Jun 13 15:09:35 delta ActiveDirectory: /usr/sbin/service ix-kinit status
Jun 13 15:09:35 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:09:35 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:09:35 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 15:09:35 delta ActiveDirectory: /usr/sbin/service ix-activedirectory quietstart
Jun 13 15:09:41 delta ActiveDirectory: /usr/sbin/service ix-activedirectory quietstart
Jun 13 15:09:41 delta ActiveDirectory: activedirectory_start: checking if we are joined already
Jun 13 15:09:41 delta ActiveDirectory: AD_testjoin_domain: net -k ads testjoin [domain redacted] -S sigma.[domain redacted] -p 389
Jun 13 15:09:42 delta ActiveDirectory: AD_testjoin_domain: Successful
Jun 13 15:09:42 delta ActiveDirectory: activedirectory_start: skipping join, already joined
Jun 13 15:09:42 delta ActiveDirectory: /usr/sbin/service ix-activedirectory status
Jun 13 15:09:43 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:09:43 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:09:44 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:09:44 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 15:09:44 delta ActiveDirectory: activedirectory_start: checking if we are joined already
Jun 13 15:09:44 delta ActiveDirectory: AD_testjoin_domain: net -k ads testjoin [domain redacted] -S sigma.[domain redacted] -p 389
Jun 13 15:09:45 delta ActiveDirectory: AD_testjoin_domain: Successful
Jun 13 15:09:45 delta ActiveDirectory: activedirectory_start: skipping join, already joined
Jun 13 15:09:45 delta ActiveDirectory: /usr/sbin/service ix-activedirectory status
Jun 13 15:09:45 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 15:09:46 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:09:46 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:09:47 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:09:47 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 15:09:48 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 15:09:51 delta ActiveDirectory: /usr/sbin/service ix-pam quietstart
Jun 13 15:09:53 delta ActiveDirectory: /usr/sbin/service ix-pam quietstart
Jun 13 15:09:54 delta ActiveDirectory: /usr/sbin/service ix-cache quietstart &
Jun 13 15:09:55 delta ActiveDirectory: /usr/sbin/service ix-cache quietstart &
Jun 13 15:10:12 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:10:12 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:10:12 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:10:12 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:10:13 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:10:13 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:10:13 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:10:13 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:10:13 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:10:14 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:10:17 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:10:17 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:10:17 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:10:17 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:10:18 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:10:20 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:10:20 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:10:21 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:10:21 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:10:22 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:10:23 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:10:23 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:10:24 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:10:24 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:10:25 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:10:37 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:10:37 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:10:38 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:10:38 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:10:39 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:10:40 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:10:40 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:10:41 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:10:41 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:10:42 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:11:15 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:11:15 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:11:15 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:11:15 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:11:19 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:11:19 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 15:11:21 delta ActiveDirectory: /usr/sbin/service samba_server forcestop
Jun 13 15:11:22 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 15:11:25 delta ActiveDirectory: /usr/sbin/service ix-kinit forcestop
Jun 13 15:11:25 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 15:11:26 delta ActiveDirectory: /usr/sbin/service ix-kerberos restart
Jun 13 15:11:26 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstop
Jun 13 15:11:27 delta ActiveDirectory: /usr/sbin/service ix-pam quietstop
Jun 13 15:11:28 delta ActiveDirectory: /usr/sbin/service ix-cache quietstop &
Jun 13 15:11:30 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 15:11:32 delta ActiveDirectory: /usr/sbin/service ix-hostname quietstart
Jun 13 15:11:32 delta ActiveDirectory: /usr/sbin/service ix-kerberos quietstart default [domain redacted]
Jun 13 15:11:52 delta ActiveDirectory: /usr/sbin/service ix-nsswitch quietstart
Jun 13 15:11:53 delta ActiveDirectory: /usr/sbin/service ix-ldap quietstart
Jun 13 15:11:53 delta ActiveDirectory: /usr/sbin/service ix-kinit quietstart
Jun 13 15:11:56 delta /adtool: [common.pipesubr:65] Popen()ing: /usr/bin/kinit --renewable --password-file=/tmp/tmphbd16s93 administrator@[domain redacted]
Jun 13 15:12:15 delta ActiveDirectory: kerberos_start: /usr/bin/kinit --renewable --password-file=/tmp/tmp.x6Ei5jJn administrator@[domain redacted]
Jun 13 15:12:20 delta ActiveDirectory: kerberos_start: Successful
Jun 13 15:12:20 delta ActiveDirectory: /usr/sbin/service ix-kinit status
Jun 13 15:12:20 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:12:20 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:12:20 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 15:12:26 delta ActiveDirectory: /usr/sbin/service ix-activedirectory quietstart
Jun 13 15:12:29 delta ActiveDirectory: activedirectory_start: checking if we are joined already
Jun 13 15:12:29 delta ActiveDirectory: AD_testjoin_domain: net -k ads testjoin [domain redacted] -S theta.[domain redacted] -p 389
Jun 13 15:12:31 delta ActiveDirectory: AD_testjoin_domain: Successful
Jun 13 15:12:31 delta ActiveDirectory: activedirectory_start: skipping join, already joined
Jun 13 15:12:31 delta ActiveDirectory: /usr/sbin/service ix-activedirectory status
Jun 13 15:12:32 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:12:32 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:12:33 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:12:33 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.stop cifs
Jun 13 15:12:34 delta ActiveDirectory: /usr/local/bin/python /usr/local/bin/midclt call notifier.start cifs
Jun 13 15:12:40 delta ActiveDirectory: /usr/sbin/service ix-pam quietstart
Jun 13 15:12:41 delta ActiveDirectory: /usr/sbin/service ix-cache quietstart &
Jun 13 15:12:59 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:12:59 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:13:00 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:13:00 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:13:01 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:14:03 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:14:03 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:14:03 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:14:03 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:14:11 delta ActiveDirectory: AD_status_domain: Okay
Jun 13 15:15:25 delta ActiveDirectory: kerberos_status: klist -t
Jun 13 15:15:25 delta ActiveDirectory: kerberos_status: Successful
Jun 13 15:15:25 delta ActiveDirectory: activedirectory_status: checking status
Jun 13 15:15:25 delta ActiveDirectory: AD_status_domain: net -k ads status [domain redacted]
Jun 13 15:15:33 delta ActiveDirectory: AD_status_domain: Okay

Any idea what's going on here, and how I might fix it? I have already cleared out all the AD configuration and reconfigured it from scratch, but no dice - same symptoms.

 

[deafen]

Wanted to follow up on this in case someone else goes searching for it later. I dug through the forum for a while, and came across another thread that mentioned that sometimes things go sideways when monitoring is enabled. I guess there might be a bug in the monitoring code that is throwing a false positive? In any case, I disabled monitoring, and the AD connection has been solid for 24 hours now. The reason it started after the upgrade is that I must have enabled monitoring when I went to turn the AD service back on, where monitoring hadn't been enabled before the upgrade.

Guess I'll go see if there's a bug on this already, and file one if not.