Adding Raw File to VM

[GamerAndds]

Hello All,

I just did a brand new install of TrueNas scale and got it setup and working for the most part. Primarily this is a storage server, however, for how much horsepower the R720 has, I would like to do a few more things with it. It is already hosting Home assistant and Jelly fin without a problem. I just want to add the last bit of functionality to it, which is ZoneMinder, an open sourced surveillance software.

I configured my server as such:
The main boot disk is a sata 500gb drive hosting TrueNas.
I have a NVME drive running all my applications and VM's (including the one in question today)
I have my main storage pool in zfs2
I have a 500gb drive to hold my 24/7 surveillance data.

My initial plan is to hold all the 24/7 data (ie the majority of the reads and writes) on the 500gb drive. I don't care too much about this drive and it know it is going to see the brunt of the read/writes. If something occurs (detection/motion) I would like the system to save that data to my main pool which will be kept safe. If I notice something, i can scrub back to the previous day and manually record that to my main pool thanks to that data on the 500gb drive.

The problem I am having is incorporating the 500gb drive into my VM. I am trying to add it as a Raw File in order to see it as a HDD in Linux.

I already tried to give the libvirt-qemu and libvirt user access to this, but it still gives me the "Permission denied error". The attached error is as follows:

Code:

 Error: Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/supervisor/supervisor.py", line 172, in start
    if self.domain.create() < 0:
  File "/usr/lib/python3/dist-packages/libvirt.py", line 1353, in create
    raise libvirtError('virDomainCreate() failed')
libvirt.libvirtError: internal error: process exited while connecting to monitor: 2023-11-04T15:37:39.382885Z qemu-system-x86_64: -blockdev {"driver":"file","filename":"/mnt/Security/Video","aio":"threads","node-name":"libvirt-2-storage","cache":{"direct":true,"no-flush":false},"auto-read-only":true,"discard":"unmap"}: Could not open '/mnt/Security/Video': Permission denied

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 184, in call_method
    result = await self.middleware._call(message['method'], serviceobj, methodobj, params, app=self)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1317, in _call
    return await methodobj(*prepared_call.args)
  File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 1379, in nf
    return await func(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 1247, in nf
    res = await f(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/vm_lifecycle.py", line 46, in start
    await self.middleware.run_in_thread(self._start, vm['name'])
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1234, in run_in_thread
    return await self.run_in_executor(self.thread_pool_executor, method, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1231, in run_in_executor
    return await loop.run_in_executor(pool, functools.partial(method, *args, **kwargs))
  File "/usr/lib/python3.9/concurrent/futures/thread.py", line 52, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/vm_supervisor.py", line 68, in _start
    self.vms[vm_name].start(vm_data=self._vm_from_name(vm_name))
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/supervisor/supervisor.py", line 181, in start
    raise CallError('\n'.join(errors))
middlewared.service_exception.CallError: [EFAULT] internal error: process exited while connecting to monitor: 2023-11-04T15:37:39.382885Z qemu-system-x86_64: -blockdev {"driver":"file","filename":"/mnt/Security/Video","aio":"threads","node-name":"libvirt-2-storage","cache":{"direct":true,"no-flush":false},"auto-read-only":true,"discard":"unmap"}: Could not open '/mnt/Security/Video': Permission denied

My ACL's and the raw file settings are attached.

Thanks for reading!