iSCSI NTFS data missing - possible issue from multiple initiators?

R

robyn

Cadet
Joined
Feb 7, 2023
Messages
3
Hello, I have TrueNAS-13.0-U6.1 running in a 10gb VM on Windows Server 2022 w/ 64gb allocated.
Drives are as follows: 60x 6TB HGST SAS in a shelf 4U-Quanta-M4600H-JBOD-60BL-S2-2P, with LSI 9200-8e HBA (IT mode) with SFF-8088
Bare metal specs: SuperMicro CSE-113TQ-R700 1U, Dual Xeon 6134, 256gb ECC DDR4

I have a VM for our workstation software that accesses the ZVol via iSCSI in Windows 10 environment and has created a NTFS drive at ~155 TB. We have about 55 TB used. I now understand that iSCSI may not have been the best choice, but that's where I am currently. I did not realize that iSCSI/NTFS are not suited to having multiple iSCSI initiators accessing it, and this weekend I was trying to set up another server so I connected the iSCSI to the Windows Server 2022 host and mounted the drive. Now I have multiple folders and files that are apparently missing.

Is this a permanent corruption and data is gone (or whatever can't be restored by a Data / Partition recovery in Windows on the NTFS)? I've tried disconnecting/reconnecting the Win10 iSCSI, I've tried re-creating the iSCSI configuration (Portal, extents, etc) in TrueNAS, but still data has disappeared.

Here's my various outputs, let me know if I need to provide more info...
Code:
root@truenas[~]# zpool status
  pool: boot-pool
 state: ONLINE
  scan: scrub repaired 0B in 00:00:03 with 0 errors on Sat Mar 16 03:45:03 2024
config:

        NAME        STATE     READ WRITE CKSUM
        boot-pool   ONLINE       0     0     0
          da0p2     ONLINE       0     0     0

errors: No known data errors

  pool: echopool
 state: ONLINE
status: Some supported and requested features are not enabled on the pool.
        The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(7) for details.
  scan: scrub repaired 0B in 12:03:21 with 0 errors on Sun Feb 18 12:03:21 2024
config:

        NAME                                            STATE     READ WRITE CKSUM
        echopool                                        ONLINE       0     0     0
          raidz2-0                                      ONLINE       0     0     0
            gptid/77f3b5ae-cfc6-11eb-a036-00155d34f200  ONLINE       0     0     0
            gptid/77bb9747-cfc6-11eb-a036-00155d34f200  ONLINE       0     0     0
            gptid/785addde-cfc6-11eb-a036-00155d34f200  ONLINE       0     0     0
            gptid/78ad934c-cfc6-11eb-a036-00155d34f200  ONLINE       0     0     0
            gptid/78e9e5c3-cfc6-11eb-a036-00155d34f200  ONLINE       0     0     0
            gptid/78bf54d0-cfc6-11eb-a036-00155d34f200  ONLINE       0     0     0
          raidz2-1                                      ONLINE       0     0     0
            gptid/237c8ff3-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/243f136e-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/24725a0c-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/24e6a801-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/25670a00-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/2633bf0c-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
          raidz2-2                                      ONLINE       0     0     0
            gptid/21fe9d87-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/22b1b430-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/22d63c1a-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/22c212d3-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/23120876-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/270f0895-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
          raidz2-3                                      ONLINE       0     0     0
            gptid/1fdf3772-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/2034fdd9-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/20b316cc-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/27bf25f2-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/2868508d-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
            gptid/2854d4f3-d05a-11eb-b43c-00155d34f205  ONLINE       0     0     0
          raidz2-4                                      ONLINE       0     0     0
            gptid/76118f8a-c901-11ee-b34f-00155d000101  ONLINE       0     0     0
            gptid/764bcf0d-c901-11ee-b34f-00155d000101  ONLINE       0     0     0
            gptid/769fffef-c901-11ee-b34f-00155d000101  ONLINE       0     0     0
            gptid/7692bb32-c901-11ee-b34f-00155d000101  ONLINE       0     0     0
            gptid/76602e37-c901-11ee-b34f-00155d000101  ONLINE       0     0     0
            gptid/7655acb7-c901-11ee-b34f-00155d000101  ONLINE       0     0     0
          raidz2-5                                      ONLINE       0     0     0
            gptid/098ea98b-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/0a103559-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/09b1ec83-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/09c47cde-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/09d07577-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/09bb1e65-c904-11ee-b037-00155d000101  ONLINE       0     0     0
          raidz2-6                                      ONLINE       0     0     0
            gptid/26213cec-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/25ec516b-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/26603d63-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/262bb645-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/261807a2-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/260d40ea-c904-11ee-b037-00155d000101  ONLINE       0     0     0
          raidz2-7                                      ONLINE       0     0     0
            gptid/4461ec41-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/44194e53-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/44225ec5-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/446ff59d-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/43f0dd8c-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/442da36b-c904-11ee-b037-00155d000101  ONLINE       0     0     0
          raidz2-8                                      ONLINE       0     0     0
            gptid/62f5b38d-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/62b4f831-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/629d017b-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/62ea001f-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/62a8c056-c904-11ee-b037-00155d000101  ONLINE       0     0     0
            gptid/62776dee-c904-11ee-b037-00155d000101  ONLINE       0     0     0
        spares
          gptid/28e5a925-d05a-11eb-b43c-00155d34f205    AVAIL
          gptid/7aebb91d-c904-11ee-b037-00155d000101    AVAIL
          gptid/7af71b0a-c904-11ee-b037-00155d000101    AVAIL
          gptid/7b01dea9-c904-11ee-b037-00155d000101    AVAIL
          gptid/7ad48833-c904-11ee-b037-00155d000101    AVAIL

errors: No known data errors



root@truenas[~]# zfs list
NAME                                                        USED  AVAIL     REFER  MOUNTPOINT
boot-pool                                                  1.52G  7.69G       96K  none
boot-pool/ROOT                                             1.52G  7.69G       96K  none
boot-pool/ROOT/Initial-Install                                8K  7.69G     1.51G  legacy
boot-pool/ROOT/default                                     1.52G  7.69G     1.51G  legacy
echopool                                                   73.1T   123T      304K  /mnt/echopool
echopool/.system                                            278M   123T      256K  legacy
echopool/.system/configs-58c56434f6ea4b3c9885a6da77c0769f  63.0M   123T     63.0M  legacy
echopool/.system/configs-b17eb1df7fd94a8281208d511a311fb0  4.11M   123T     4.11M  legacy
echopool/.system/cores                                      192K  1024M      192K  legacy
echopool/.system/rrd-58c56434f6ea4b3c9885a6da77c0769f       105M   123T      105M  legacy
echopool/.system/rrd-b17eb1df7fd94a8281208d511a311fb0      76.0M   123T     76.0M  legacy
echopool/.system/samba4                                    22.8M   123T      783K  legacy
echopool/.system/services                                   192K   123T      192K  legacy
echopool/.system/syslog-58c56434f6ea4b3c9885a6da77c0769f   5.25M   123T     5.25M  legacy
echopool/.system/syslog-b17eb1df7fd94a8281208d511a311fb0    879K   123T      879K  legacy
echopool/.system/webui                                      192K   123T      192K  legacy
echopool/echozvol                                          73.1T   140T     56.3T  -




root@truenas[~]# zfs list -t all -r
NAME                                                        USED  AVAIL     REFER  MOUNTPOINT
boot-pool                                                  1.52G  7.69G       96K  none
boot-pool/ROOT                                             1.52G  7.69G       96K  none
boot-pool/ROOT/Initial-Install                                8K  7.69G     1.51G  legacy
boot-pool/ROOT/default                                     1.52G  7.69G     1.51G  legacy
boot-pool/ROOT/default@2024-02-08-16:09:53                 3.02M      -     1.51G  -
echopool                                                   73.1T   123T      304K  /mnt/echopool
echopool/.system                                            278M   123T      256K  legacy
echopool/.system/configs-58c56434f6ea4b3c9885a6da77c0769f  63.0M   123T     63.0M  legacy
echopool/.system/configs-b17eb1df7fd94a8281208d511a311fb0  4.11M   123T     4.11M  legacy
echopool/.system/cores                                      192K  1024M      192K  legacy
echopool/.system/rrd-58c56434f6ea4b3c9885a6da77c0769f       105M   123T      105M  legacy
echopool/.system/rrd-b17eb1df7fd94a8281208d511a311fb0      76.0M   123T     76.0M  legacy
echopool/.system/samba4                                    22.8M   123T      783K  legacy
echopool/.system/samba4@update--2023-10-12-14-49--12.0-U4   240K      -      743K  -
echopool/.system/samba4@wbc-1697122283                      224K      -      727K  -
echopool/.system/samba4@wbc-1697126113                      312K      -      727K  -
echopool/.system/samba4@wbc-1697171157                      304K      -      743K  -
echopool/.system/samba4@wbc-1697468061                      304K      -      743K  -
echopool/.system/samba4@wbc-1698420711                      320K      -      743K  -
echopool/.system/samba4@wbc-1698768133                      320K      -      743K  -
echopool/.system/samba4@wbc-1698772002                      320K      -      743K  -
echopool/.system/samba4@wbc-1698964101                      320K      -      743K  -
echopool/.system/samba4@wbc-1699232124                      320K      -      743K  -
echopool/.system/samba4@wbc-1699321211                      320K      -      743K  -
echopool/.system/samba4@wbc-1700680897                      304K      -      743K  -
echopool/.system/samba4@wbc-1700681472                      320K      -      759K  -
echopool/.system/samba4@wbc-1701461923                      304K      -      759K  -
echopool/.system/samba4@wbc-1701738674                      304K      -      759K  -
echopool/.system/samba4@wbc-1701746875                      304K      -      759K  -
echopool/.system/samba4@wbc-1701823602                      320K      -      759K  -
echopool/.system/samba4@wbc-1702056111                      320K      -      759K  -
echopool/.system/samba4@wbc-1702064901                      304K      -      759K  -
echopool/.system/samba4@wbc-1702066262                      304K      -      759K  -
echopool/.system/samba4@wbc-1702069415                      288K      -      759K  -
echopool/.system/samba4@wbc-1702071696                      288K      -      759K  -
echopool/.system/samba4@wbc-1702076396                      288K      -      759K  -
echopool/.system/samba4@wbc-1702084565                      304K      -      759K  -
echopool/.system/samba4@wbc-1702093284                      288K      -      759K  -
echopool/.system/samba4@wbc-1702094290                      288K      -      759K  -
echopool/.system/samba4@wbc-1702095301                      304K      -      759K  -
echopool/.system/samba4@wbc-1703113750                      304K      -      759K  -
echopool/.system/samba4@wbc-1703114066                      288K      -      759K  -
echopool/.system/samba4@wbc-1703114459                      304K      -      759K  -
echopool/.system/samba4@wbc-1703114864                      320K      -      759K  -
echopool/.system/samba4@wbc-1703115204                      320K      -      759K  -
echopool/.system/samba4@wbc-1703115527                      320K      -      759K  -
echopool/.system/samba4@wbc-1703115933                      304K      -      759K  -
echopool/.system/samba4@wbc-1703116348                      304K      -      759K  -
echopool/.system/samba4@wbc-1703116678                      304K      -      759K  -
echopool/.system/samba4@wbc-1703117087                      320K      -      759K  -
echopool/.system/samba4@wbc-1703117501                      336K      -      759K  -
echopool/.system/samba4@wbc-1703117916                      336K      -      759K  -
echopool/.system/samba4@wbc-1703118247                      336K      -      759K  -
echopool/.system/samba4@wbc-1703118657                      320K      -      759K  -
echopool/.system/samba4@wbc-1703119070                      320K      -      759K  -
echopool/.system/samba4@wbc-1703119486                      320K      -      759K  -
echopool/.system/samba4@wbc-1703119902                      320K      -      759K  -
echopool/.system/samba4@wbc-1703120228                      320K      -      759K  -
echopool/.system/samba4@wbc-1703120639                      304K      -      775K  -
echopool/.system/samba4@wbc-1703120969                      320K      -      775K  -
echopool/.system/samba4@wbc-1703121378                      320K      -      759K  -
echopool/.system/samba4@wbc-1703122112                      320K      -      759K  -
echopool/.system/samba4@wbc-1703122521                      320K      -      759K  -
echopool/.system/samba4@wbc-1703122936                      336K      -      759K  -
echopool/.system/samba4@wbc-1703123351                      336K      -      759K  -
echopool/.system/samba4@wbc-1703123765                      320K      -      759K  -
echopool/.system/samba4@wbc-1703124181                      320K      -      759K  -
echopool/.system/samba4@wbc-1703124593                      304K      -      759K  -
echopool/.system/samba4@wbc-1703124922                      304K      -      759K  -
echopool/.system/samba4@wbc-1703125247                      320K      -      759K  -
echopool/.system/samba4@wbc-1703125655                      320K      -      759K  -
echopool/.system/samba4@wbc-1703126069                      320K      -      759K  -
echopool/.system/samba4@wbc-1703127538                      320K      -      759K  -
echopool/.system/samba4@wbc-1703133068                      320K      -      759K  -
echopool/.system/samba4@wbc-1703133780                      336K      -      759K  -
echopool/.system/samba4@wbc-1703174660                      320K      -      759K  -
echopool/.system/samba4@wbc-1703176341                      320K      -      759K  -
echopool/.system/samba4@wbc-1704225676                      336K      -      759K  -
echopool/.system/samba4@wbc-1704229180                      336K      -      759K  -
echopool/.system/samba4@wbc-1704402047                      336K      -      759K  -
echopool/.system/samba4@wbc-1704513878                      336K      -      759K  -
echopool/.system/samba4@wbc-1704645133                      336K      -      759K  -
echopool/.system/samba4@wbc-1704759800                      336K      -      759K  -
echopool/.system/services                                   192K   123T      192K  legacy
echopool/.system/syslog-58c56434f6ea4b3c9885a6da77c0769f   5.25M   123T     5.25M  legacy
echopool/.system/syslog-b17eb1df7fd94a8281208d511a311fb0    879K   123T      879K  legacy
echopool/.system/webui                                      192K   123T      192K  legacy
echopool/echozvol                                          73.1T   140T     56.3T  -
 
C

csj

iXsystems
iXsystems
Joined
Oct 20, 2017
Messages
18
Yeah, you've more than likely caused permanent data corruption. NTFS is not a clustered filesystem so the moment you attached the other server to the NTFS drive, it probably ate data. Not much you can from an ZFS perspective since zfs doesn't care about the filesystem that sits on top of it. You'd have to have a snapshot of the zvol/dataset from _before_ you connected the windows server and try to create a new iscsi target from the snapshot to see if you can get access to your data. Or if you have backups of the drive from some other program, you can try to restore from that.
 
Davvo

Davvo

MVP
Joined
Jul 12, 2022
Messages
3,222
csj said:
You'd have to have a snapshot of the zvol/dataset from _before_ you connected the windows server and try to create a new iscsi target from the snapshot to see if you can get access to your data.
Click to expand...
And even that would require a significant amount of luck.
You might get something from ZFS data-recovery resvices, but it should be about the same.
 
You must log in or register to reply here.

Similar threads

Lucas Rey
Delete old snapshots from CLI
Replies
2
Views
426
Lucas Rey
Lucas Rey
A
freenas raidz1 all disks DEGRADED too many errors, please help
Replies
2
Views
1K
andyvfx
A
J
  • Locked
Upgrading from 9.2 to 9.3 - can not import Pool and Datasets anymore
Replies
6
Views
2K
jakal
J
D
Help needed : impossible to mount disks on new TrueNAS server from previous FreeNAS server
Replies
1
Views
650
danb35
danb35
S
zpool import doesn't list zpool
Replies
3
Views
889
sretalla
sretalla
Top