Festplatte in einen anderen Schacht wechseln! Wie?

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
Hallo,

ich habe ein FreeNas

Code:
% zpool status
  pool: Tank
state: ONLINE
  scan: scrub repaired 0 in 0 days 01:19:12 with 0 errors on Sun Nov 15 01:19:13 2020
config:

        NAME                                            STATE     READ WRITE CKSUM
        Tank                                            ONLINE       0     0     0
          raidz2-0                                      ONLINE       0     0     0
            gptid/e79b0f94-4761-11-a631-7085c2dd19fa  ONLINE       0     0     0
            gptid/e81aa5b3-4761-11-a631-7085c2dd19fa  ONLINE       0     0     0
            gptid/e83777e3-4761-11-a631-7085c2dd19fa  ONLINE       0     0     0
            gptid/e82f3761-4761-11-a631-7085c2dd19fa  ONLINE       0     0     0

# camcontrol devlist
<Marvell Console 1.01> at scbus7 target 0 lun 0 (pass0)
<ST8000VN0022-2EL112 SC61> at scbus8 target 0 lun 0 (pass1,ada0)
<ST8000VN0022-2EL112 SC61> at scbus9 target 0 lun 0 (pass2,ada1)
<ST8000VN0022-2EL112 SC61> at scbus10 target 0 lun 0 (ada2,pass3)
<ST8000VN0022-2EL112 SC61> at scbus11 target 0 lun 0 (pass4,ada3)
<CT1000MX500SSD4 M3CR023>          at scbus12 target 0 lun 0 (pass5,ada4)

% geom disk list | grep name
Geom name: ada0 8T
Geom name: ada1 8T
Geom name: ada2  8T
Geom name: ada3 8T

Geom name: ada4 SSD System Freenas


In meinem NAS sind 8 Schächte.. 1-4 sind voll. 5-8 sind leer. ich möchte nun die ada2 in einen anderen Schacht stecken. Das ist wohl besser mit der Wärme...

Aber wenn ich das tue, ist das zpool immer degraded... er erkennt nicht ada2 in dem anderen Schacht.

Was für Befehle muss ich vorher eingeben. Einfach so rausziehen geht wohl nicht.... Ich habe hotswap...

Soll ich das machen?

1) NAS runterfahren
2) ada2 von schacht 2 in schacht 6
3) NAS wieder hochfahren

danke für den tipp, irgendwie bin ich wohl zu doof.. ich frage lieber vorher

Steel-Cat

hier das Problem meiner ada2

Code:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   083   064   044    Pre-fail  Always       -       207005112
  3 Spin_Up_Time            0x0003   086   086   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       12
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   093   060   045    Pre-fail  Always       -       1803095783
  9 Power_On_Hours          0x0032   092   092   000    Old_age   Always       -       7364
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       12
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   041   021   040    Old_age   Always   In_the_past 59 (195 127 65 42 0)
 
Last edited:

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
seht euch mal den 190er Fehler an.... ich hatte ein FreeNAS Alert
 

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
Soll ich das machen?

1) NAS runterfahren
2) ada2 von schacht 2 in schacht 6
3) NAS wieder hochfahren

das habe ich jetzt mal gemacht.... hat aber nciht funktioniert... .habe es wieder zurück gebaut

Kann mir keiner helfen?

Wo kann ich denn sonst Doku finden dazu?
 

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
meine zweite Idee ist

1 ) im Pool ada2p2 offline zu setzen
2) Festplatte wegen hotplug dann einfach von slot2 zu slot 6
3) warten und schauen, ob ich dann ada2p2 wieder online setzen kann

Ist das der richtige Weg?
 

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,740
Möglicherweise ist die Platte in Slot 6 dann nicht mehr ada2 - das hängt aber von Deinem Controller und Deiner Verkabelung ab.
Andererseits ist die gesamte Information zu Deinem Zpool *auf* den Platten. Es wird keine weitere Konfiguration benötigt.

Du könntest also

1. den Pool exportieren
2. das NAS herunterfahren
3. die Platte umstecken
4. das NAS hochfahren
5. den Pool importieren

Zusätzlich könntest Du vor Schritt 5 mit camcontrol devlist mal gucken, ob er denn überhaupt 4 Platten erkennt. Evtl. sind die Schächte 5 bis 8 ja auch gar nicht angeschlossen ...
 

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
ah, danke "export" ist also das Zauberwort

5-8 sind angeschlossen, das weiss ich, da ich mit camcontrol devlist schon gesehen habe, dass er die verschobene Platte gesehen hat.

Zum export geht es in Pools und dann beim Rädchen rechtes mit export/disconnect

Dabei dann wohl nichts destroyen, sondern nur confirm export.

Die VM, die im Tank ist, vorher mit Power off ausschalten, denke ich.

Das import dann mit Pools Add und dann import an exisiting pool.. dann hoffen ist, dass da irgendwo Tank steht , so heisst ja mein Pool.
Leider sind da keine Beispielbilder in der Anleitung..

Frage zur Dauer: Wie lange dauert das ca.? Das Pool ist 1,47 TB von 12 TB belegt... (10% used) Compression rate 1.12

Frage: Gibt es irgendwo ein Test-System, wo ich export/mport einfach mal ausprobieren könnte...


...

Wenn es nicht geht mit dem verschieben, dann wohl einfach die alte Position wieder stecken und pool import...
 

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,740
Yep, alle Dienste, die den Pool benutzen, müssen aus sein. Alles andere ist richtig.

Wie lange das dauert? 10 Sekunden? Die Größe des Pools ist irrelevant, da passiert auch keine Magie, wenn der Pool exportiert wird. Es werden nur alle offenen Schreibvorgänge abgeschlossen und die Datasets ausgehängt.

Zu deinen bisherigen Problemen: wenn Du die Platte über die GPTID explizit "offline" setzt und dann verschiebst, dann musst Du sie natürlich genau so, ebenfalls über die GPTID, wieder online setzen. Es gibt da kein "autoconnect" oder sowas ... manuell offline bleibt offline.

Also
  • zpool offline Tank gptid/e81aa5b3-4761-11-a631-7085c2dd19fa # wenn das die richtige ist, kannst Du mit gpart list nachgucken
  • Platte verschieben
  • Mit dmesg/camcontrol gucken, ob sie wieder da ist
  • zpool online Tank gptid/e81aa5b3-4761-11-a631-7085c2dd19fa
Gruß
Patrick
 

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
Hallo,

ich habe es versucht... leider kam bei zpool status danach :

13681489071282867862 OFFLINE 0 0 0 was dev/gptid/e81aa5b3-4761-11-a631-7085c2dd19fa
Da habe ich das erstmal alles wieder zurück... Was auch zum Glück ging

Mein zpool ist nach degraded wieder online
 
Last edited:

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,740
Hast Du einmal ausdrücklich zpool online für die Platte eingegeben?
 

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,740
Schräg. Sind Deine Schächte 5-8 an einem anderen Controller als 1-4? Poste doch mal den Inhalt von /var/run/dmesg.boot, nachdem Du die Platte umgesteckt hast. Die Ausgabe von gpart show nach dem Umstecken wäre auch noch interessant. Ebenso wie gpart list ada2 vor dem Umstecken und gpart list ada6 nach dem Umstecken.
 

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
So nun mal mit Log:


Code:
vorher:

root@freenas[~]# cat /var/run/dmesg.boot
Copyright (c) 1992-2019 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
    The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.3-RELEASE-p14 #0 r325575+c936002dbe2(HEAD): Mon Sep 28 10:46:56 EDT 2020

root@tnbuilds05.tn.ixsystems.net:/freenas-releng/freenas/_BE/objs/freenas-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64
FreeBSD clang version 8.0.0 (tags/RELEASE_800/final 356365) (based on LLVM 8.0.0)
VT(vga): text 80x25
CPU: AMD Ryzen 5 3400G with Radeon Vega Graphics     (3693.15-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x810f81  Family=0x17  Model=0x18  Stepping=1

Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>

Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
  AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX>
  Structured Extended Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr>
  SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
  TSC: P-state invariant, performance statistics
real memory  = 34359738368 (32768 MB)
avail memory = 31088721920 (29648 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I >
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 hardware threads
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ioapic0 <Version 2.1> irqs 0-23 on motherboard
ioapic1 <Version 2.1> irqs 24-55 on motherboard
SMP: AP CPU #4 Launched!
SMP: AP CPU #2 Launched!
Timecounter "TSC-low" frequency 1846573948 Hz quality 1000
random: entropy device external interface
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
kbd1 at kbdmux0
mlx5en: Mellanox Ethernet driver 3.5.1 (April 2019)
nexus0
vtvga0: <VT VGA driver> on motherboard
cryptosoft0: <software crypto> on motherboard
aesni0: <AES-CBC,AES-XTS,AES-GCM,AES-ICM> on motherboard
padlock0: No ACE support.
acpi0: <ALASKA A M I > on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0

cpu7: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 350
Event timer "HPET2" frequency 14318180 Hz quality 350
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pcib0: _OSC returned error 0x10
pci0: <ACPI PCI bus> on pcib0
amdsmn0: <AMD Family 17h System Management Network> on hostb0
amdtemp0: <AMD CPU On-Die Thermal Sensors> on hostb0
pci0: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 1.1 on pci0
pci1: <ACPI PCI bus> on pcib1
ahci0: <Marvell 88SE9230 AHCI SATA controller> port 0xf050-0xf057,0xf040-0xf043,0xf030-0xf037,0xf020-0xf023,0xf000-0xf01f mem 0xfcf10000-0xfcf107ff irq 24 at device 0.0 on pci1
ahci0: AHCI v1.20 with 8 6Gbps ports, Port Multiplier not supported
ahci0: quirks=0x900<NOBSYRES,ALTSIG>
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
ahcich6: <AHCI channel> at channel 6 on ahci0
ahcich7: <AHCI channel> at channel 7 on ahci0
pcib2: <ACPI PCI-PCI bridge> at device 1.2 on pci0
pci2: <ACPI PCI bus> on pcib2
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xfcda0000-0xfcda7fff irq 28 at device 0.0 on pci2
xhci0: 32 bytes context size, 64-bit DMA
xhci0: Unable to map MSI-X table
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
ahci1: <AHCI SATA controller> mem 0xfcd80000-0xfcd9ffff irq 29 at device 0.1 on pci2
ahci1: AHCI v1.31 with 8 6Gbps ports, Port Multiplier supported
ahcich8: <AHCI channel> at channel 0 on ahci1
ahcich9: <AHCI channel> at channel 1 on ahci1
ahcich12: <AHCI channel> at channel 4 on ahci1
ahcich13: <AHCI channel> at channel 5 on ahci1
pcib3: <ACPI PCI-PCI bridge> irq 30 at device 0.2 on pci2
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 28 at device 0.0 on pci3
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> irq 29 at device 1.0 on pci3
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> irq 28 at device 4.0 on pci3
pci6: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> irq 29 at device 5.0 on pci3
pci7: <ACPI PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> irq 30 at device 6.0 on pci3
pci8: <ACPI PCI bus> on pcib8
pci8: <network> at device 0.0 (no driver attached)
pcib9: <ACPI PCI-PCI bridge> irq 31 at device 7.0 on pci3
pci9: <ACPI PCI bus> on pcib9
igb0: <Intel(R) PRO/1000 Network Connection, Version - 2.5.3-k> port 0xe000-0xe01f mem 0xfcb00000-0xfcb1ffff,0xfcb20000-0xfcb23fff irq 31 at device 0.0 on pci9
igb0: Using MSIX interrupts with 3 vectors
igb0: Ethernet address: 70:85:c2:dd:19:fa
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
pcib10: <ACPI PCI-PCI bridge> at device 8.1 on pci0
pci10: <ACPI PCI bus> on pcib10
vgapci0: <VGA-compatible display> port 0xd000-0xd0ff mem 0xe0000000-0xefffffff,0xf0000000-0xf01fffff,0xfca00000-0xfca7ffff irq 52 at device 0.0 on pci10
vgapci0: Boot video device
pci10: <multimedia, HDA> at device 0.1 (no driver attached)
pci10: <encrypt/decrypt> at device 0.2 (no driver attached)
xhci1: <XHCI (generic) USB 3.0 controller> mem 0xfc800000-0xfc8fffff irq 55 at device 0.3 on pci10
xhci1: 64 bytes context size, 64-bit DMA
xhci1: Unable to map MSI-X table
usbus1 on xhci1
usbus1: 5.0Gbps Super Speed USB v3.0
xhci2: <XHCI (generic) USB 3.0 controller> mem 0xfc700000-0xfc7fffff irq 52 at device 0.4 on pci10
xhci2: 64 bytes context size, 64-bit DMA
xhci2: Unable to map MSI-X table
usbus2 on xhci2
usbus2: 5.0Gbps Super Speed USB v3.0
pci10: <multimedia, HDA> at device 0.6 (no driver attached)
pcib11: <ACPI PCI-PCI bridge> at device 8.2 on pci0
pci11: <ACPI PCI bus> on pcib11
ahci2: <AMD KERNCZ AHCI SATA controller> mem 0xfce00000-0xfce007ff irq 54 at device 0.0 on pci11
ahci2: AHCI v1.31 with 1 6Gbps ports, Port Multiplier supported with FBS
ahcich17: <AHCI channel> at channel 1 on ahci2
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
acpi_button0: <Power Button> on acpi0
wbwd0: <Nuvoton NCT6792 (0xc9/0x11) Watchdog Timer> at port 0x2e-0x2f on isa0
amdsbwd0: <AMD FCH Rev 41h+ Watchdog Timer> at iomem 0xfed80b00-0xfed80b03,0xfed80b04-0xfed80b07 on isa0
amdsbwd0: watchdog hardware is disabled
device_attach: amdsbwd0 attach returned 6
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
freenas_sysctl: adding account.
freenas_sysctl: adding directoryservice.
freenas_sysctl: adding middlewared.
freenas_sysctl: adding network.
freenas_sysctl: adding services.
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
ugen2.1: <0x1022 XHCI root HUB> at usbus2
ugen0.1: <0x1022 XHCI root HUB> at usbus0
ugen1.1: <0x1022 XHCI root HUB> at usbus1
uhub0: <0x1022 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus2
uhub1: <0x1022 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
uhub2: <0x1022 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
uhub0: 2 ports with 2 removable, self powered
uhub2: 8 ports with 8 removable, self powered
uhub1: 22 ports with 22 removable, self powered
ugen0.2: <vendor 0x8087 product 0x0aa7> at usbus0
ada0 at ahcich8 bus 0 scbus8 target 0 lun 0
ada0: <ST8000VN0022-2EL112 SC61> ACS-3 ATA SATA 3.x device
ada0: Serial Number ZA1G232N
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 7630885MB (15628053168 512 byte sectors)
ada1 at ahcich9 bus 0 scbus9 target 0 lun 0
ada1: <ST8000VN0022-2EL112 SC61> ACS-3 ATA SATA 3.x device
ada1: Serial Number ZA1G2T8Z
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 7630885MB (15628053168 512 byte sectors)
ada2 at ahcich12 bus 0 scbus10 target 0 lun 0
ada2: <ST8000VN0022-2EL112 SC61> ACS-3 ATA SATA 3.x device
ada2: Serial Number ZA1G34C8
ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 7630885MB (15628053168 512 byte sectors)
ada3 at ahcich13 bus 0 scbus11 target 0 lun 0
ada3: <ST8000VN0022-2EL112 SC61> ACS-3 ATA SATA 3.x device
ada3: Serial Number ZA1FZ6WS
ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 7630885MB (15628053168 512 byte sectors)
ada4 at ahcich17 bus 0 scbus12 target 0 lun 0
ada4: <CT1000MX500SSD4 M3CR023> ACS-3 ATA SATA 3.x device
ada4: Serial Number 1931E215FC1B
ada4: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada4: Command Queueing enabled
ada4: 953869MB (1953525168 512 byte sectors)
pass0 at ahcich7 bus 0 scbus7 target 0 lun 0
pass0: <Marvell Console 1.01> Removable Processor SCSI device
pass0: Serial Number HKDP221516WL
pass0: 150.000MB/s transfers (SATA 1.x, UDMA4, ATAPI 12bytes, PIO 8192bytes)
random: unblocking device.
Trying to mount root from zfs:freenas-boot/ROOT/11.3-U5 []...
lo0: link state changed to UP
igb0: link state changed to UP
GEOM_MIRROR: Device mirror/swap0 launched (2/2).
GEOM_MIRROR: Device mirror/swap1 launched (2/2).
GEOM_ELI: Device mirror/swap0.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> F17H/6/48/0x1ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA>
igb0: link state changed to DOWN
igb0: link state changed to UP
CPU: AMD Ryzen 5 3400G with Radeon Vega Graphics     (3693.15-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x810f81  Family=0x17  Model=0x18  Stepping=1

Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>

Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
  AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX>
  Structured Extended Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr>
  SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
  TSC: P-state invariant, performance statistics
root@freenas[~]# gpart list ada2
Geom name: ada2
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 15628053127
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: ada2p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   efimedia: HD(1,GPT,e800b8d6-4761-11ea-a631-7085c2dd19fa,0x80,0x400000)
   rawuuid: e800b8d6-4761-11ea-a631-7085c2dd19fa
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada2p2
   Mediasize: 7999415652352 (7.3T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   efimedia: HD(2,GPT,e82f3761-4761-11ea-a631-7085c2dd19fa,0x400080,0x3a3412a08)
   rawuuid: e82f3761-4761-11ea-a631-7085c2dd19fa
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 7999415652352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 15628053127
   start: 4194432
Consumers:
1. Name: ada2
   Mediasize: 8001563222016 (7.3T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

root@freenas[~]# gpart show
=>         40  15628053088  ada0  GPT  (7.3T)
           40           88        - free -  (44K)
          128      4194304     1  freebsd-swap  (2.0G)
      4194432  15623858696     2  freebsd-zfs  (7.3T)

=>         40  15628053088  ada1  GPT  (7.3T)
           40           88        - free -  (44K)
          128      4194304     1  freebsd-swap  (2.0G)
      4194432  15623858696     2  freebsd-zfs  (7.3T)

=>         40  15628053088  ada3  GPT  (7.3T)
           40           88        - free -  (44K)
          128      4194304     1  freebsd-swap  (2.0G)
      4194432  15623858696     2  freebsd-zfs  (7.3T)

=>        40  1953525088  ada4  GPT  (932G)
          40        1024     1  freebsd-boot  (512K)
        1064  1953497088     2  freebsd-zfs  (932G)
  1953498152       26976        - free -  (13M)

=>         40  15628053088  ada2  GPT  (7.3T)
           40           88        - free -  (44K)
          128      4194304     1  freebsd-swap  (2.0G)
      4194432  15623858696     2  freebsd-zfs  (7.3T)




 

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
nachher

Code:

offline

runter

Festplatte tauschen 2->6

rauf

root@freenas[~]# camcontrol devlist
<Marvell Console 1.01>             at scbus7 target 0 lun 0 (pass0)
<ST8000VN0022-2EL112 SC61>         at scbus8 target 0 lun 0 (pass1,ada0)
<ST8000VN0022-2EL112 SC61>         at scbus9 target 0 lun 0 (pass2,ada1)
<ST8000VN0022-2EL112 SC61>         at scbus11 target 0 lun 0 (pass3,ada2)
<CT1000MX500SSD4 M3CR023>          at scbus12 target 0 lun 0 (pass4,ada3)
root@freenas[~]# cat /var/run/dmesg.boot
Copyright (c) 1992-2019 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
    The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.3-RELEASE-p14 #0 r325575+c936002dbe2(HEAD): Mon Sep 28 10:46:56 EDT 2020

root@tnbuilds05.tn.ixsystems.net:/freenas-releng/freenas/_BE/objs/freenas-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64
FreeBSD clang version 8.0.0 (tags/RELEASE_800/final 356365) (based on LLVM 8.0.0)
VT(vga): text 80x25
CPU: AMD Ryzen 5 3400G with Radeon Vega Graphics     (3693.13-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x810f81  Family=0x17  Model=0x18  Stepping=1

Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>

Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
  AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX>
  Structured Extended Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr>
  SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
  TSC: P-state invariant, performance statistics
real memory  = 34359738368 (32768 MB)
avail memory = 31088721920 (29648 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I >
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 hardware threads
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ioapic0 <Version 2.1> irqs 0-23 on motherboard
ioapic1 <Version 2.1> irqs 24-55 on motherboard
SMP: AP CPU #5 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #4 Launched!
Timecounter "TSC-low" frequency 1846566529 Hz quality 1000
random: entropy device external interface
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
kbd1 at kbdmux0
mlx5en: Mellanox Ethernet driver 3.5.1 (April 2019)
nexus0
vtvga0: <VT VGA driver> on motherboard
cryptosoft0: <software crypto> on motherboard
aesni0: <AES-CBC,AES-XTS,AES-GCM,AES-ICM> on motherboard
padlock0: No ACE support.
acpi0: <ALASKA A M I > on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 350
Event timer "HPET2" frequency 14318180 Hz quality 350
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pcib0: _OSC returned error 0x10
pci0: <ACPI PCI bus> on pcib0
amdsmn0: <AMD Family 17h System Management Network> on hostb0
amdtemp0: <AMD CPU On-Die Thermal Sensors> on hostb0
pci0: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 1.1 on pci0
pci1: <ACPI PCI bus> on pcib1
ahci0: <Marvell 88SE9230 AHCI SATA controller> port 0xf050-0xf057,0xf040-0xf043,0xf030-0xf037,0xf020-0xf023,0xf000-0xf01f mem 0xfcf10000-0xfcf107ff irq 24 at device 0.0 on pci1
ahci0: AHCI v1.20 with 8 6Gbps ports, Port Multiplier not supported
ahci0: quirks=0x900<NOBSYRES,ALTSIG>
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
ahcich6: <AHCI channel> at channel 6 on ahci0
ahcich7: <AHCI channel> at channel 7 on ahci0
pcib2: <ACPI PCI-PCI bridge> at device 1.2 on pci0
pci2: <ACPI PCI bus> on pcib2
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xfcda0000-0xfcda7fff irq 28 at device 0.0 on pci2
xhci0: 32 bytes context size, 64-bit DMA
xhci0: Unable to map MSI-X table
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
ahci1: <AHCI SATA controller> mem 0xfcd80000-0xfcd9ffff irq 29 at device 0.1 on pci2
ahci1: AHCI v1.31 with 8 6Gbps ports, Port Multiplier supported
ahcich8: <AHCI channel> at channel 0 on ahci1
ahcich9: <AHCI channel> at channel 1 on ahci1
ahcich12: <AHCI channel> at channel 4 on ahci1
ahcich13: <AHCI channel> at channel 5 on ahci1
pcib3: <ACPI PCI-PCI bridge> irq 30 at device 0.2 on pci2
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 28 at device 0.0 on pci3
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> irq 29 at device 1.0 on pci3
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> irq 28 at device 4.0 on pci3
pci6: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> irq 29 at device 5.0 on pci3
pci7: <ACPI PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> irq 30 at device 6.0 on pci3
pci8: <ACPI PCI bus> on pcib8
pci8: <network> at device 0.0 (no driver attached)
pcib9: <ACPI PCI-PCI bridge> irq 31 at device 7.0 on pci3
pci9: <ACPI PCI bus> on pcib9
igb0: <Intel(R) PRO/1000 Network Connection, Version - 2.5.3-k> port 0xe000-0xe01f mem 0xfcb00000-0xfcb1ffff,0xfcb20000-0xfcb23fff irq 31 at device 0.0 on pci9
igb0: Using MSIX interrupts with 3 vectors
igb0: Ethernet address: 70:85:c2:dd:19:fa
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
pcib10: <ACPI PCI-PCI bridge> at device 8.1 on pci0
pci10: <ACPI PCI bus> on pcib10
vgapci0: <VGA-compatible display> port 0xd000-0xd0ff mem 0xe0000000-0xefffffff,0xf0000000-0xf01fffff,0xfca00000-0xfca7ffff irq 52 at device 0.0 on pci10
vgapci0: Boot video device
pci10: <multimedia, HDA> at device 0.1 (no driver attached)
pci10: <encrypt/decrypt> at device 0.2 (no driver attached)
xhci1: <XHCI (generic) USB 3.0 controller> mem 0xfc800000-0xfc8fffff irq 55 at device 0.3 on pci10
xhci1: 64 bytes context size, 64-bit DMA
xhci1: Unable to map MSI-X table
usbus1 on xhci1
usbus1: 5.0Gbps Super Speed USB v3.0
xhci2: <XHCI (generic) USB 3.0 controller> mem 0xfc700000-0xfc7fffff irq 52 at device 0.4 on pci10
xhci2: 64 bytes context size, 64-bit DMA
xhci2: Unable to map MSI-X table
usbus2 on xhci2
usbus2: 5.0Gbps Super Speed USB v3.0
pci10: <multimedia, HDA> at device 0.6 (no driver attached)
pcib11: <ACPI PCI-PCI bridge> at device 8.2 on pci0
pci11: <ACPI PCI bus> on pcib11
ahci2: <AMD KERNCZ AHCI SATA controller> mem 0xfce00000-0xfce007ff irq 54 at device 0.0 on pci11
ahci2: AHCI v1.31 with 1 6Gbps ports, Port Multiplier supported with FBS
ahcich17: <AHCI channel> at channel 1 on ahci2
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
acpi_button0: <Power Button> on acpi0
wbwd0: <Nuvoton NCT6792 (0xc9/0x11) Watchdog Timer> at port 0x2e-0x2f on isa0
amdsbwd0: <AMD FCH Rev 41h+ Watchdog Timer> at iomem 0xfed80b00-0xfed80b03,0xfed80b04-0xfed80b07 on isa0
amdsbwd0: watchdog hardware is disabled
device_attach: amdsbwd0 attach returned 6
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
freenas_sysctl: adding account.
freenas_sysctl: adding directoryservice.
freenas_sysctl: adding middlewared.
freenas_sysctl: adding network.
freenas_sysctl: adding services.
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
ugen1.1: <0x1022 XHCI root HUB> at usbus1
ugen2.1: <0x1022 XHCI root HUB> at usbus2
ugen0.1: <0x1022 XHCI root HUB> at usbus0
uhub0: <0x1022 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
uhub1: <0x1022 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus2
uhub2: <0x1022 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
uhub1: 2 ports with 2 removable, self powered
uhub0: 8 ports with 8 removable, self powered
uhub2: 22 ports with 22 removable, self powered
ugen0.2: <vendor 0x8087 product 0x0aa7> at usbus0
ada0 at ahcich8 bus 0 scbus8 target 0 lun 0
ada0: <ST8000VN0022-2EL112 SC61> ACS-3 ATA SATA 3.x device
ada0: Serial Number ZA1G232N
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 7630885MB (15628053168 512 byte sectors)
ada1 at ahcich9 bus 0 scbus9 target 0 lun 0
ada1: <ST8000VN0022-2EL112 SC61> ACS-3 ATA SATA 3.x device
ada1: Serial Number ZA1G2T8Z
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 7630885MB (15628053168 512 byte sectors)
ada2 at ahcich13 bus 0 scbus11 target 0 lun 0
ada2: <ST8000VN0022-2EL112 SC61> ACS-3 ATA SATA 3.x device
ada2: Serial Number ZA1FZ6WS
ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 7630885MB (15628053168 512 byte sectors)
ada3 at ahcich17 bus 0 scbus12 target 0 lun 0
ada3: <CT1000MX500SSD4 M3CR023> ACS-3 ATA SATA 3.x device
ada3: Serial Number 1931E215FC1B
ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada3: Command Queueing enabled
ada3: 953869MB (1953525168 512 byte sectors)
pass0 at ahcich7 bus 0 scbus7 target 0 lun 0
pass0: <Marvell Console 1.01> Removable Processor SCSI device
pass0: Serial Number HKDP221516WL
pass0: 150.000MB/s transfers (SATA 1.x, UDMA4, ATAPI 12bytes, PIO 8192bytes)
random: unblocking device.
Trying to mount root from zfs:freenas-boot/ROOT/11.3-U5 []...
lo0: link state changed to UP
igb0: link state changed to UP
GEOM_MIRROR: Device mirror/swap0 launched (2/2).
GEOM_ELI: Device mirror/swap0.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> F17H/6/48/0x1ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA>
igb0: link state changed to DOWN
igb0: link state changed to UP
CPU: AMD Ryzen 5 3400G with Radeon Vega Graphics     (3693.13-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x810f81  Family=0x17  Model=0x18  Stepping=1

Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>

Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
  AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX>
  Structured Extended Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr>
  SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
  TSC: P-state invariant, performance statistics
root@freenas[~]# gpart show
=>         40  15628053088  ada0  GPT  (7.3T)
           40           88        - free -  (44K)
          128      4194304     1  freebsd-swap  (2.0G)
      4194432  15623858696     2  freebsd-zfs  (7.3T)

=>         40  15628053088  ada1  GPT  (7.3T)
           40           88        - free -  (44K)
          128      4194304     1  freebsd-swap  (2.0G)
      4194432  15623858696     2  freebsd-zfs  (7.3T)

=>         40  15628053088  ada2  GPT  (7.3T)
           40           88        - free -  (44K)
          128      4194304     1  freebsd-swap  (2.0G)
      4194432  15623858696     2  freebsd-zfs  (7.3T)

=>        40  1953525088  ada3  GPT  (932G)
          40        1024     1  freebsd-boot  (512K)
        1064  1953497088     2  freebsd-zfs  (932G)
  1953498152       26976        - free -  (13M)

root@freenas[~]# zpool status
  pool: Tank
 state: DEGRADED
status: One or more devices has been taken offline by the administrator.
    Sufficient replicas exist for the pool to continue functioning in a
    degraded state.
action: Online the device using 'zpool online' or replace the device with
    'zpool replace'.
  scan: resilvered 244K in 0 days 00:00:01 with 0 errors on Fri Dec  4 11:38:54 2020
config:

    NAME                                            STATE     READ WRITE CKSUM
    Tank                                            DEGRADED     0     0     0
      raidz2-0                                      DEGRADED     0     0     0
        gptid/e79b0f94-4761-11ea-a631-7085c2dd19fa  ONLINE       0     0     0
        gptid/e81aa5b3-4761-11ea-a631-7085c2dd19fa  ONLINE       0     0  0root@freenas[~]# zpool online Tank gptid/e82f3761-4761-11ea-a631-7085c2dd19fa

warning: device 'gptid/e82f3761-4761-11ea-a631-7085c2dd19fa' onlined, but remains in faulted state
use 'zpool replace' to replace devices that are no longer present




root@freenas[~]# zpool status
  pool: Tank
 state: DEGRADED
status: One or more devices could not be opened.  Sufficient replicas exist for
    the pool to continue functioning in a degraded state.
action: Attach the missing device and online it using 'zpool online'.
   see: http://illumos.org/msg/ZFS-8000-2Q
  scan: resilvered 244K in 0 days 00:00:01 with 0 errors on Fri Dec  4 11:38:54 2020
config:

    NAME                                            STATE     READ WRITE CKSUM
    Tank                                            DEGRADED     0     0     0
      raidz2-0                                      DEGRADED     0     0     0
        gptid/e79b0f94-4761-11ea-a631-7085c2dd19fa  ONLINE       0     0     0
        gptid/e81aa5b3-4761-11ea-a631-7085c2dd19fa  ONLINE       0     0     0
        gptid/e83777e3-4761-11ea-a631-7085c2dd19fa  ONLINE       0     0     0
        17308424075185104734                        UNAVAIL      0     0  0  was /dev/gptid/e82f3761-4761-11ea-a631-7085c2dd19fa

errors: No known data errors

  pool: freenas-boot
 state: ONLINE
  scan: scrub repaired 0 in 0 days 00:00:25 with 0 errors on Thu Dec  3 03:45:25 2020
config:

    NAME        STATE     READ WRITE CKSUM
    freenas-boot  ONLINE       0     0     0
      ada3p2    ONLINE       0     0     0

errors: No known data errors



        gptid/e83777e3-4761-11ea-a631-7085c2dd19fa  ONLINE       0     0     0
        17308424075185104734                        OFFLINE      0     0  0  was /dev/gptid/e82f3761-4761-11ea-a631-7085c2dd19fa

errors: No known data errors

  pool: freenas-boot
 state: ONLINE
  scan: scrub repaired 0 in 0 days 00:00:25 with 0 errors on Thu Dec  3 03:45:25 2020
config:

    NAME        STATE     READ WRITE CKSUM
    freenas-boot  ONLINE       0     0     0
      ada3p2    ONLINE       0     0     0

errors: No known data errors


----------

root@freenas[~]# gpart show
=>         40  15628053088  ada0  GPT  (7.3T)
           40           88        - free -  (44K)
          128      4194304     1  freebsd-swap  (2.0G)
      4194432  15623858696     2  freebsd-zfs  (7.3T)

=>         40  15628053088  ada1  GPT  (7.3T)
           40           88        - free -  (44K)
          128      4194304     1  freebsd-swap  (2.0G)
      4194432  15623858696     2  freebsd-zfs  (7.3T)

=>         40  15628053088  ada2  GPT  (7.3T)
           40           88        - free -  (44K)
          128      4194304     1  freebsd-swap  (2.0G)
      4194432  15623858696     2  freebsd-zfs  (7.3T)

=>        40  1953525088  ada3  GPT  (932G)
          40        1024     1  freebsd-boot  (512K)
        1064  1953497088     2  freebsd-zfs  (932G)
  1953498152       26976        - free -  (13M)

root@freenas[~]# gpart show ada6
gpart: No such geom: ada6.
root@freenas[~]# gpart show ada2
=>         40  15628053088  ada2  GPT  (7.3T)
           40           88        - free -  (44K)
          128      4194304     1  freebsd-swap  (2.0G)
      4194432  15623858696     2  freebsd-zfs  (7.3T)

root@freenas[~]# gpart list ada2
Geom name: ada2
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 15628053127
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: ada2p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   efimedia: HD(1,GPT,e7f592ea-4761-11ea-a631-7085c2dd19fa,0x80,0x400000)
   rawuuid: e7f592ea-4761-11ea-a631-7085c2dd19fa
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada2p2
   Mediasize: 7999415652352 (7.3T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   efimedia: HD(2,GPT,e83777e3-4761-11ea-a631-7085c2dd19fa,0x400080,0x3a3412a08)
   rawuuid: e83777e3-4761-11ea-a631-7085c2dd19fa
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 7999415652352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 15628053127
   start: 4194432
Consumers:
1. Name: ada2
   Mediasize: 8001563222016 (7.3T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

root@freenas[~]# gpart list ada6
gpart: No such geom: ada6.
 

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
bin erstmal wieder zurück , immerhin schön reproduziertbar

hmmmm

vorher in 2

efimedia: HD(2,GPT,e82f3761-4761-11ea-a631-7085c2dd19fa,0x400080,0x3a3412a08)
rawuuid: e82f3761-4761-11ea-a631-7085c2dd19fa
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b

nachher in 6

efimedia: HD(2,GPT,e83777e3-4761-11ea-a631-7085c2dd19fa,0x400080,0x3a3412a08)
rawuuid: e83777e3-4761-11ea-a631-7085c2dd19fa
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
root@freenas[~]# zpool online Tank gptid/e82f3761-4761-11ea-a631-7085c2dd19fa

warning: device 'gptid/e82f3761-4761-11ea-a631-7085c2dd19fa' onlined, but remains in faulted state
use 'zpool replace' to replace devices that are no longer present
17308424075185104734 UNAVAIL 0 0 0 was /dev/gptid/e82f3761-4761-11ea-a631-7085c2dd19fa
 

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,740
Wie wär's mit einem zpool replace? Ich bin hier jetzt auch nicht 100% sicher, ob das so sein soll, dass sich die rawuuid mit dem Schacht ändert. Ich dachte eigentlich, die stehen irgendwo auf der Platte ...

Daher würde ich an Deiner Stelle mal gezielt nach diesem uuid change im Englischen Forum fragen. Hier erwischst Du nur einen Bruchteil der Leute ...


Edit: ich glaube ich liege falsch.

Du hast vor dem Umstecken ada0 bis ada4, also 5 Platten.
Nach dem Umstecken hast Du noch ada0 bis ada3 - also 4.

Die umgesteckte Platte wird nicht erkannt. Dein gpart show ada6 zeigt ja auch "no such geom."
Mal abgesehen davon: wie kommst Du darauf, dass es eine ada6 geben sollte? Die Zahlen sind nicht Deine Schacht-Nummern. Das Mainboard und das OS wissen doch nicht wie Dein Gehäuse aussieht.
Die platten werden immer einfach von 0 bis n durchnumeriert. Und die uuids ändern sich, weil durch die gezogene ada2 nun ada3 und ada4 eine Nummer runter rutschen ...

Deine ada2 nach dem Umstecken ist die, die vorher ada3 war.

Guck Dir die Seriennummern in den beiden dmesg.boot an ...
 
Last edited:

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
ok. ich habe nun wohl ein SATA-Buchsen Hardware Problem gefunden, ich muss zum Händler....
 

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
ich glaube ich habe es, nachdem ich die SATA Kabel schon geprüft habe...

in dmesg:

ahci0: <Marvell 88SE9230 AHCI SATA controller> port 0xf050-0xf057,0xf040-0xf043,0xf030-0xf037,0xf020-0xf023,0xf000-0xf01f mem 0xfcf10000-0xfcf107ff irq 24 at device 0.0 on pci1
ahci0: AHCI v1.20 with 8 6Gbps ports, Port Multiplier not supported

damit werden die Schächte 5-8 nicht angeprochen....

Frage ist also: welche PCI-SATA Streckkarte wird von FreeBSD supported?
 

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,740
Zieh das Kabel von Schacht 2 zu Schacht 6 um ...
 

Steel-Cat

Explorer
Joined
Jan 24, 2020
Messages
83
Ja, klar, das geht, aber sowieso ist die Frage: Gibt es eine PCIe 4 SATA Short Karte (ohne den schlimmen Marvel Chip)???

Marvell Problem

Asmedia? > Marvell
Adaptec? > wohl keine Short Karten....

Noch habe ich keine gefunden...
 
Last edited:

emk2203

Guru
Joined
Nov 11, 2012
Messages
573
SATA Karten sind alle Schrott und zu vermeiden. Nimm eine SAS2 Karte, bei Ressourcen findest du Hardwareempfehlungen im Guide (unter Resources oben) ab S. 12. Die laufen genauso mit SATA Disks wie mit SAS Disks.

Aus dem zitierten Guide:

Common mistakes

The following are common mistakes which should be avoided at all costs:
• Using any SATAcontroller card. These are universally crap.
• Using SATAport multipliers. Intel SATA controllers do not support these, they are built down to a price and are generally unreliable.
• Using any sort of hardware RAID

o Exporting individual drives as RAID0 volumes is nota good solution
o The vast majority of hardware RAID controllers is not appropriate for FreeNAS

Die dort erwähnten Karten bekommt man für 30 - 60€ auf eBay.
 
Top