i have the server with 24nvme in front connected to PERC H740P Mini
I highly doubt that, since the H740P is a SAS controller (though the underlying SAS controller has tri-mode support, Dell does not advertise it, and Dell servers using it do not use tri-mode).
Even if it did support tri-mode
and if you had a tri-mode expander, you would
not want to use it with NVMe disks, as LSI's tri-mode solution is terrible and absolutely and completely pointless.
The good news is that the PCIe component of the drive bays is almost certainly directly connected to the host, possibly with PCIe switches, so NVMe disks should work with no issues.
On the other hand, if you want to use SAS or SATA disks, you will need to replace the H740P Mini with an HBA330 Mini, which is a pretty simple process as far as these things go.