File delete issue (automatic)

[sukarechhe]

Hello experts,

We are facing some strange issues. We have a few servers with TrueNAS-12.0-U8.1.
There are many users who are working in NAS, majorly images using Photoshop.
If 1 member has an open file on his/her computer and another member opens the same file on his/her computer then sometimes files get deleted.
I guess this is a conflict issue. How to solve is out of my mind.
Can someone advise, please?

 

[anodos]

12.0-U8.1 is EOL. You can test to see if same issue occurs in 13.0-U5.1. If it occurs there, post output of "testparm -s".

 

[sukarechhe]

Actually, My hardware is with limited resources and 12.0-U8.1 works fine

# testparm -s
Load smb config files from /usr/local/etc/smb4.conf
lpcfg_do_global_parameter: WARNING: The "client ntlmv2 auth" option is deprecated
Loaded services file OK.
Weak crypto is allowed
Server role: ROLE_DOMAIN_MEMBER

# Global parameters
[global]
aio max threads = 2
allow trusted domains = No
bind interfaces only = Yes
client ldap sasl wrapping = seal
client NTLMv2 auth = No
disable spoolss = Yes
dns proxy = No
domain master = No
enable web service discovery = Yes
kerberos method = secrets and keytab
kernel change notify = No
load printers = No
local master = No
logging = file
max log size = 5120
nsupdate command = /usr/local/bin/samba-nsupdate -g
ntlm auth = ntlmv1-permitted
preferred master = No
realm = IIMA.LOCAL
registry shares = Yes
restrict anonymous = 2
security = ADS
server min protocol = NT1
server role = member server
server string = TrueNAS Server
template shell = /bin/sh
unix extensions = No
winbind cache time = 7200
winbind enum groups = Yes
winbind enum users = Yes
winbind max domain connections = 10
workgroup = IIMA
recycle:repository = .recycle/%U
recycle:preserveacl = yes
full_audit:priority = NOTICE
full_audit:facility = local5
full_audit:success = unlinkat
full_audit:failure = connect
full_audit:prefix = USER=%u|IP=%I|%m|SHARE=%S|%P
idmap config *: range = 90000001-100000000
idmap config iima: range = 100000001-200000000
idmap config iima: backend = rid
idmap config * : backend = tdb
directory name cache size = 0
dos filemode = Yes


[G1]
ea support = No
kernel share modes = No
path = /mnt/Pool1_Disk1/G1
posix locking = No
read only = No
vfs objects = full_audit zfsacl streams_xattr aio_pthread recycle
nfs4:chown = true


[G2]
ea support = No
kernel share modes = No
path = /mnt/Pool3_Disk3/G2
posix locking = No
read only = No
vfs objects = full_audit zfsacl streams_xattr aio_pthread recycle
nfs4:chown = true

 

[sukarechhe]

@anodos, sorry if bothering.

kernel oplocks = Yes
level2 oplocks = No

Will this help me?

 

[anodos]

@anodos, sorry if bothering.

kernel oplocks = Yes
level2 oplocks = No

Will this help me?

No. FreeBSD doesn't implement kernel oplocks. Your vfs objects or in an invalid order. streams_xattr must come before zfsacl. aio_pthread is invalid on FreeBSD.

 

[sukarechhe]

@anodos Thanks for the suggestion, I have reordered as per your instruction and removed aio_pthread. One question, will this help me in main issue of "File delete issue (automatic)"

 

[sukarechhe]

@anodos - I have already used unlinkat full log but while checking the log, the result seems to show that the member has deleted the file but the member is not on his desk and the system is in idle mode. I have validated that there is no virus as that computer seems recently provided with fresh OS installation. It seems weird issue.

 

[Davvo]

I would set up a test system with 13-U5.1 and see if the issue happens there as well.

 

[sukarechhe]

@Davvo - Would be a great help. Thanks!

 

[Davvo]

[If I were you] I would set up...

It was a suggestion about trying your current configuration on an updated version of CORE, which might have already fixed the issue (or has a chance to do so since it's not yet EOL).
Sorry for not being clear enough.

 

[sukarechhe]

@Davvo Sure, let me try upgrading one of them. Thanks!

 

[sukarechhe]

@Davvo @anodos I have upgraded OS to 13.0-U5.1

It seems still the same issue appearing. When someone opens a file it generates a few tmp and while saving any random file gets deleted. I suspect is it getting conflict with this .tmp file and generating issues.

Here is an example. Could you please suggest something on this ? I am clueless ....

 

[anodos]

@Davvo @anodos I have upgraded OS to 13.0-U5.1

It seems still the same issue appearing. When someone opens a file it generates a few tmp and while saving any random file gets deleted. I suspect is it getting conflict with this .tmp file and generating issues.
View attachment 67626
Here is an example. Could you please suggest something on this ? I am clueless ....

You'll have to narrow down the application generating the .tmp files.

 

[Davvo]

@Davvo @anodos
Here is an example. Could you please suggest something on this ? I am clueless ....

What you can do to help us help you is to patiently describe in detail your system and your workflow since it might shine some light on the issue.

You'll have to narrow down the application generating the .tmp files.

I would guess to be photoshop.

 

[sukarechhe]

Thanks for the reply. I have set up a few Truenas with 13.0-U5.1 version.
There are members who keep their data on these servers and work.
As per the above-given screenshot, as per project requirements. They keep images in a folder and work from that particular folder at the same time.
sometimes, random files get deleted. In log (unlink) it shows the user has deleted the file but at that moment in some cases, we found the user wasn't on the desk and the system was on lock mode (weird but we did check with the time stamp of the file delete / unlink log of server and CCTV footage - just checked whether human error or system). All the members are working on photoshop and working on certain types of images within the same folder. It came across that at the same place when people working on file it generates some .tmp files and I suspect it may be conflict with name and file getting deleted. Although, I have already enabled the .recycled folder, but the user has to find it in all the folders because it is usually found in a random folder of .recycled folder.

 

[Davvo]

Did you check the clients for malwares? Although it does feel like some kind of settings misconfigurtion/error.

 

[sukarechhe]

Yeah, I have already checked. All the system has the latest end-point security. Some of the systems are recently installed with fresh OS.

 

[Davvo]

Totally going blind: you could try setting the share auxiliary parameter to nfs4:mode=simple, but bear in mind that this might be a disruptive change so backup your config before doing so.

 

[joeschmuck]

Sorry but I'm confused here. Can you be extremely specific with some file names that are being deleted? All I've seen so far is you point out .tmp files which is normal to have the program (Adobe Photoshop) create and delete them, typically shortly after the program closes, but if the program is still active (left open even though the screen is locked), Photoshop could still be deleting those .tmp files. Are you using "Adobe Photoshop"? I don't want to assume anything but I'm pretty sure that is what you are saying, plus the .tmp file names starting with "ps", but assumptions get people into trouble.

TrueNAS will not delete your files. That would make for a very poor file server and everyone would have heard about that kind of problem.

A few questions:
1. You are using FreeNAS 12, for how long was this NAS working before the problems started, if it ever worked?
2. Are you using any NAS storage other than TrueNAS/FreeNAS that does not exhibit this problem?
3. If yes to question 2, are the Adobe Photoshop versions the same on the computers using this other NAS?

I'm fairly sure your issue is with Adobe Photoshop, have you searched their forums for similar issues?

 

[sukarechhe]

@joeschmuck Thanks for response.

1. You are using FreeNAS 12, for how long was this NAS working before the problems started, if it ever worked? - Earlier it was 12 and recently upgraded to latest one
2. Are you using any NAS storage other than TrueNAS/FreeNAS that does not exhibit this problem? - Earlier all server was Ubuntu Samba where I didn't get any issue, although some other issues were there like smb service was stopping anytime and I had to start it and so on bla bla bla and to over come that issue I had implemented Truenas (1-2 server was windows based shared server)
3. If yes to question 2, are the Adobe Photoshop versions the same on the computers using this other NAS? - Yes all are CC latest one.

I thought it might be issue of photoshop but then it never happened with smb as well as windows shared server so point come with Truenas and thought to post here if anyone has come across such an issue and maybe help me with my case.