importing images in lightroom on samba generates messages

[mactsk]

Hi, i have a share that i use as repository for lightroom, when importing images i get this "error" continuously, eventually Freeness an connection hangs, i can't ever ping it, but from via consolle i can reboot it.

Code:

Nov  3 19:17:20 freenas smbd[5553]: [2014/11/03 19:17:20.129331,  0] ../source3/modules/vfs_posixacl.c:171(smb_ace_to_internal)
Nov  3 19:17:20 freenas smbd[5553]:   unknown tag type 64

i think i get this line for every file imported, i never noticed it while doing other stuff on the FreeNas

what this alert means?

The hardware is intel i3 16GB ram, 6X seagate nas drives 3tb each (by the way i'm very happy with them, absolutely silent, no vibrations, and runs extremely cool)
FreeNAS-9.2.1.8-RELEASE-x64 (e625626)

Thank you!

 

[mactsk]

I am also getting a "re0: watchdog timeout"
last time i have not seen it, now it seems to have hanged in a different manner

 

[Ericloewe]

Hi, i have a share that i use as repository for lightroom, when importing images i get this "error" continuously, eventually Freeness an connection hangs, i can't ever ping it, but from via consolle i can reboot it.

Code:

Nov  3 19:17:20 freenas smbd[5553]: [2014/11/03 19:17:20.129331,  0] ../source3/modules/vfs_posixacl.c:171(smb_ace_to_internal)
Nov  3 19:17:20 freenas smbd[5553]:   unknown tag type 64

i think i get this line for every file imported, i never noticed it while doing other stuff on the FreeNas

what this alert means?

The hardware is intel i3 16GB ram, 6X seagate nas drives 3tb each (by the way i'm very happy with them, absolutely silent, no vibrations, and runs extremely cool)
FreeNAS-9.2.1.8-RELEASE-x64 (e625626)

Thank you!

No mysterious lost data or similar effects? A few people have complained about Adobe's applications in the past, which could delete files in unusual situations.

 

[Ericloewe]

I am also getting a "re0: watchdog timeout"
last time i have not seen it, now it seems to have hanged in a different manner

Well, there's your problem. You're using a Realtek NIC!

Get an Intel NIC and try again.

Sidenote: the fact that you have a Realtek NIC means you're not using server-grade hardware, particularly you don't have ECC. That's something you should look into fixing.

 

[anodos]

Post the following:

• Your smb4.conf file (located under /usr/local/etc/smb4.conf).
• Full hardware specs
• Type of ACLs being used

Gut reaction is that you are using POSIX ACLs when you should be using Windows ACLs. POSIX ACLs don't map exactly to Windows ones. Lightroom may be trying to set an invalid POSIX ACE.

 

[mactsk]

i really can't say if some file is missing, i am switching from iphoto to lightroom, 14 years of photos, 418 gb for (iphoto says) 46.362 photos, but sometimes iphoto have lost some files (in the catalog but not usually in the folders) so it's not easy to calculate if something gets deleted.

the share is using unix permissions, i access it with os x yosemite (homes share)

Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz
16GB ram
mother board http://www.asrock.com/mb/intel/b75 pro3/
it's connected to a gigabit Netgear Prosafe switch, on big files i can get full gigabit speeds without problems.

Code:

[global]
    server max protocol = SMB3
    encrypt passwords = yes
    dns proxy = no
    strict locking = no
    oplocks = yes
    deadtime = 15
    max log size = 51200
    max open files = 11070
    load printers = no
    printing = bsd
    printcap name = /dev/null
    disable spoolss = yes
    getwd cache = yes
    guest account = nobody
    map to guest = Bad User
    obey pam restrictions = Yes
    directory name cache size = 0
    kernel change notify = no
    panic action = /usr/local/libexec/samba/samba-backtrace
    server string = FreeNAS Server
    ea support = yes
    store dos attributes = yes
    time server = yes
    acl allow execute always = true
    local master = yes
    idmap config *:backend = tdb
    idmap config *:range = 90000000-100000000
    server role = standalone
    netbios name = FREENAS
    workgroup = WORKGROUP
    security = user
    pid directory = /var/run/samba
    smb passwd file = /var/etc/private/smbpasswd
    private dir = /var/etc/private
    create mask = 0666
    directory mask = 0777
    client ntlmv2 auth = yes
    dos charset = CP437
    unix charset = UTF-8
    log level = 2
   

[homes]
    comment = Home Directories
    valid users = %U
    writable = yes
    browseable = no
    path = /mnt/raid6/home/%U
   

[backup_win]
    path = /mnt/raid6/backup
    printable = no
    veto files = /.snap/.windows/.zfs/
    writeable = yes
    browseable = yes
    recycle:repository = .recycle/%U
    recycle:keeptree = yes
    recycle:versions = yes
    recycle:touch = yes
    recycle:directory_mode = 0777
    recycle:subdir_mode = 0700
    vfs objects = zfsacl streams_xattr aio_pthread
    hide dot files = yes
    guest ok = no
    nfs4:mode = special
    nfs4:acedup = merge
    nfs4:chown = yes
    zfsacl:acesort = dontcare
   

[installazioni-mac]
    path = /mnt/raid6/instmac
    printable = no
    veto files = /.snap/.windows/.zfs/
    writeable = yes
    browseable = yes
    recycle:repository = .recycle/%U
    recycle:keeptree = yes
    recycle:versions = yes
    recycle:touch = yes
    recycle:directory_mode = 0777
    recycle:subdir_mode = 0700
    shadow:snapdir = .zfs/snapshot
    shadow:sort = desc
    shadow:localtime = yes
    shadow:format = auto-%Y%m%d.%H%M-4w
    vfs objects = shadow_copy2 zfsacl streams_xattr aio_pthread
    hide dot files = yes
    guest ok = no
    nfs4:mode = special
    nfs4:acedup = merge
    nfs4:chown = yes
    zfsacl:acesort = dontcare
   

[installazioni-pc]
    path = /mnt/raid6/instpc
    printable = no
    veto files = /.snap/.windows/.zfs/
    writeable = yes
    browseable = yes
    recycle:repository = .recycle/%U
    recycle:keeptree = yes
    recycle:versions = yes
    recycle:touch = yes
    recycle:directory_mode = 0777
    recycle:subdir_mode = 0700
    shadow:snapdir = .zfs/snapshot
    shadow:sort = desc
    shadow:localtime = yes
    shadow:format = auto-%Y%m%d.%H%M-4w
    vfs objects = shadow_copy2 zfsacl streams_xattr aio_pthread
    hide dot files = yes
    guest ok = no
    nfs4:mode = special
    nfs4:acedup = merge
    nfs4:chown = yes
    zfsacl:acesort = dontcare
   

[macchine_virtuali]
    path = /mnt/raid6/macchine_virtuali
    printable = no
    veto files = /.snap/.windows/.zfs/
    writeable = yes
    browseable = yes
    recycle:repository = .recycle/%U
    recycle:keeptree = yes
    recycle:versions = yes
    recycle:touch = yes
    recycle:directory_mode = 0777
    recycle:subdir_mode = 0700
    shadow:snapdir = .zfs/snapshot
    shadow:sort = desc
    shadow:localtime = yes
    shadow:format = auto-%Y%m%d.%H%M-2d
    vfs objects = shadow_copy2 zfsacl streams_xattr aio_pthread
    hide dot files = yes
    guest ok = no
    nfs4:mode = special
    nfs4:acedup = merge
    nfs4:chown = yes
    zfsacl:acesort = dontcare
   

[scambio]
    path = /mnt/raid6/scambio
    printable = no
    veto files = /.snap/.windows/.zfs/
    writeable = yes
    browseable = yes
    recycle:repository = .recycle/%U
    recycle:keeptree = yes
    recycle:versions = yes
    recycle:touch = yes
    recycle:directory_mode = 0777
    recycle:subdir_mode = 0700
    shadow:snapdir = .zfs/snapshot
    shadow:sort = desc
    shadow:localtime = yes
    shadow:format = auto-%Y%m%d.%H%M-2m
    vfs objects = shadow_copy2 zfsacl streams_xattr aio_pthread
    hide dot files = yes
    guest ok = no
    nfs4:mode = special
    nfs4:acedup = merge
    nfs4:chown = yes
    zfsacl:acesort = dontcare
   

[sd]
    path = /mnt/raid6/camera
    printable = no
    veto files = /.snap/.windows/.zfs/
    comment = sd
    writeable = yes
    browseable = yes
    recycle:repository = .recycle/%U
    recycle:keeptree = yes
    recycle:versions = yes
    recycle:touch = yes
    recycle:directory_mode = 0777
    recycle:subdir_mode = 0700
    vfs objects = zfsacl streams_xattr aio_pthread
    hide dot files = yes
    guest ok = no
    nfs4:mode = special
    nfs4:acedup = merge
    nfs4:chown = yes
    zfsacl:acesort = dontcare

 

[cyberjock]

FAIL. That hardware isn't recommended (and therefore not exactly supported) on this forum. You should give our hardware stickies a read...

 

[anodos]

the share is using unix permissions, i access it with os x yosemite (homes share)

Do your other shares experience the same problem? (the ones with zfsacl enabled)

You could also try switching permissions type on your homes shares to "windows" and adding the following as "Homes auxiliary parameters"

Code:

vfs objects = zfsacl streams_xattr
nfs4:mode = special
nfs4:acedup = merge
nfs4:chown = yes
zfsacl:acesort = dontcare

This should have Samba start writing ACLs properly on your homes shares.
BTW, you have a typo in your [homes] share. The parameter is "writeable" not "writable" :)

 

[mactsk]

cyberjock: witch part of the hardware may be problematic in particular? i was planning to get an intel nic, however i had zero real issues with that setup, really.

anodos: i'll make some tests, but i don't remember having any problems with other shares or that share in the past. for the typo, it'a really strange, i'm sure i have not edited manually the samba config!!! i only used the gui, it could be an old bug that generated it, this NAS is the upgrade of an older Hp Microserver, and probably of a previous one, i use FreeNas since v7 or earlier, i really don't remember when it was UFS. probably this config was generated two years ago, but i can't remember of having edited samba by hand.

 

[anodos]

anodos: i'll make some tests, but i don't remember having any problems with other shares or that share in the past. for the typo, it'a really strange, i'm sure i have not edited manually the samba config!!! i only used the gui, it could be an old bug that generated it, this NAS is the upgrade of an older Hp Microserver, and probably of a previous one, i use FreeNas since v7 or earlier, i really don't remember when it was UFS. probably this config was generated two years ago, but i can't remember of having edited samba by hand.

That part of your smb4.conf file is modified through "Services" --> "CIFS" --> "Homes auxiliary parameters".

You can also try increasing logging verbosity for CIFS, but I think the initial log pretty clearly implicates a samba misconfiguration regarding ACLs.

 

[mactsk]

That part of your smb4.conf file is modified through "Services" --> "CIFS" --> "Homes auxiliary parameters".

You can also try increasing logging verbosity for CIFS, but I think the initial log pretty clearly implicates a samba misconfiguration regarding ACLs.

Ok your mods seems to have fixed the problem no more messages!!! now i'll see if it locks in the long run (i am now importing some thousand images).

What exactly are those auxiliary parameters doing? (just for pleasure of knowledge)
Thank you!

 

[anodos]

streams_xattr stores "ntfs alternate datastreams" (a way of storing Mac resource forks in Windows) as FreeBSD file system extended attributes

zfsacl essentially converts zfs access control lists into NTFS access controls lists (makes your FreeNAS server act almost exactly like a windows server). The rest of the parameters are tweaks for nfsv4 permissions under the zfsacl vfs module.

You can view rest of the parameters in the zfsacl manpage located here: ftp://ftp.samba.org/pub/unpacked/samba_current/docs-xml/manpages/

 

[cyberjock]

cyberjock: witch part of the hardware may be problematic in particular? i was planning to get an intel nic, however i had zero real issues with that setup, really.

Read our stickies. If you do you can answer the question for yourself. ;)