hrrmcelroy
Cadet
- Joined
- May 17, 2021
- Messages
- 7
Today I added an external SAS shelf to my existing setup to allow for more drives than my existing setup offered. After doing so when I go to Storage -> Disks I only see 3 of my 24 disks. I also can only see one of the new blank drives under Storage -> Pools -> Create New Pool. Prior to adding my SAS shelf via an external miniSAS connector I could see all 12 of my drives that were in the main case. All 12 of these drives were assigned to various pools and are working like a charm including showing up in the Storage -> Disks window. Below is my setup before and after the addition of the SAS shelf. Now I'm already aware my setup isn't optimal or recommended so please help with my issue and don't point out that my hardware isn't recommended. My boss is cheap so I make do with what I've got. :)
Before SAS Shelf
After SAS Shelf
All of my other hardware remained the same, but I added the following device as my SAS shelf. NetApp DS4246 with 2x IOM6 SAS SATA Expansion connected via the miniSAS port on the Perc 410i controller. Now the Perc 410i can see all the disks and they've all been configured in the same single disk RAID 0 setup as the other drives. When I boot into TrueNAS I only see my boot drive, one of the new drives, and an external USB box that is irrelevant to this discussion. Thankfully even though my existing 12 drives no longer show up in the Storage -> Disks window all of my existing pools are operational and work just fine. Oh and the SAS shelf has a LUN of 24 currently, but I've tried 03 and nothing changes. The "camcontrol devlist" shows all the drives. Output below.
Here is the output of "geom disk list"
Anyone have any thoughts? Does my LUN for the SAS shelf need to be 0 since it is on Perc 410i which is LUN 0? I'm kind of in uncharted territory here.
Before SAS Shelf
- HP Proliant DL380 G6
- 96B of RAM
- 2x 3.07GHz quad core CPUs
- 1x PCI-E Ethernet card with 4x 1Gig ports setup in a LCAP LAG
- 1x SSD drive on a PCI-E expansion card (boot drive)
- 4x 8TB Samsung SSD drives in a RAIDZ2 ZFS pool
- 8x 300GB SAS drives in a RAIDZ1 ZFS pool (slush area for temp files)
- Perc 410i RAID controller (has an external minSAS connector)
- Each drive is configured in a single disk RAID 0 so it can be handed to TrueNAS (YIKES!!!! I know, but it is what it is.)
After SAS Shelf
All of my other hardware remained the same, but I added the following device as my SAS shelf. NetApp DS4246 with 2x IOM6 SAS SATA Expansion connected via the miniSAS port on the Perc 410i controller. Now the Perc 410i can see all the disks and they've all been configured in the same single disk RAID 0 setup as the other drives. When I boot into TrueNAS I only see my boot drive, one of the new drives, and an external USB box that is irrelevant to this discussion. Thankfully even though my existing 12 drives no longer show up in the Storage -> Disks window all of my existing pools are operational and work just fine. Oh and the SAS shelf has a LUN of 24 currently, but I've tried 03 and nothing changes. The "camcontrol devlist" shows all the drives. Output below.
Code:
[~]# camcontrol devlist <HP RAID 0 OK> at scbus0 target 0 lun 0 (pass0,da0) <HP RAID 0 OK> at scbus0 target 1 lun 0 (pass1,da1) <HP RAID 0 OK> at scbus0 target 2 lun 0 (pass2,da2) <HP RAID 0 OK> at scbus0 target 3 lun 0 (pass3,da3) <HP RAID 0 OK> at scbus0 target 4 lun 0 (pass4,da4) <HP RAID 0 OK> at scbus0 target 5 lun 0 (pass5,da5) <HP RAID 0 OK> at scbus0 target 6 lun 0 (pass6,da6) <HP RAID 0 OK> at scbus0 target 7 lun 0 (pass7,da7) <HP RAID 0 OK> at scbus0 target 8 lun 0 (pass8,da8) <HP RAID 0 OK> at scbus0 target 9 lun 0 (pass9,da9) <HP RAID 0 OK> at scbus0 target 10 lun 0 (pass10,da10) <HP RAID 0 OK> at scbus0 target 11 lun 0 (pass11,da11) <HP RAID 0 OK> at scbus0 target 12 lun 0 (pass12,da12) <HP RAID 0 OK> at scbus0 target 13 lun 0 (pass13,da13) <HP RAID 0 OK> at scbus0 target 14 lun 0 (pass14,da14) <HP RAID 0 OK> at scbus0 target 15 lun 0 (pass15,da15) <HP RAID 0 OK> at scbus0 target 16 lun 0 (pass16,da16) <HP RAID 0 OK> at scbus0 target 17 lun 0 (pass17,da17) <HP RAID 0 OK> at scbus0 target 18 lun 0 (pass18,da18) <HP RAID 0 OK> at scbus0 target 19 lun 0 (pass19,da19) <HP RAID 0 OK> at scbus0 target 20 lun 0 (pass20,da20) <HP RAID 0 OK> at scbus0 target 21 lun 0 (pass21,da21) <HP RAID 0 OK> at scbus0 target 22 lun 0 (pass22,da22) <HP RAID 0 OK> at scbus0 target 23 lun 0 (pass23,da23) <hp DVD A DS8A8SH KHE4> at scbus3 target 0 lun 0 (cd0,pass24) <KINGSTON SUV400S37120G 0C3FD6SD> at scbus4 target 0 lun 0 (pass25,ada0) <Mobius H /W RAID10 0103> at scbus7 target 0 lun 0 (da24,pass26)
Here is the output of "geom disk list"
Code:
[~]# geom disk list Geom name: ada0 Providers: 1. Name: ada0 Mediasize: 120034123776 (112G) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r1w1e2 descr: KINGSTON SUV400S37120G lunid: 0550380440010000 ident: 50026B77680016CA rotationrate: 0 fwsectors: 63 fwheads: 16 Geom name: da0 Providers: 1. Name: da0 Mediasize: 299966445568 (279G) Sectorsize: 512 Mode: r2w2e5 descr: HP RAID 0 lunid: 600508b1001ce9a104969a06f8e7912c ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da1 Providers: 1. Name: da1 Mediasize: 299966445568 (279G) Sectorsize: 512 Mode: r2w2e5 descr: HP RAID 0 lunid: 600508b1001c49857ef1aebfc604f4e8 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da2 Providers: 1. Name: da2 Mediasize: 299966445568 (279G) Sectorsize: 512 Mode: r2w2e5 descr: HP RAID 0 lunid: 600508b1001c0dc8a56f321e33fb95eb ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da3 Providers: 1. Name: da3 Mediasize: 299966445568 (279G) Sectorsize: 512 Mode: r2w2e5 descr: HP RAID 0 lunid: 600508b1001cf0c20c3d8ea903c67ae0 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da4 Providers: 1. Name: da4 Mediasize: 299966445568 (279G) Sectorsize: 512 Mode: r2w2e5 descr: HP RAID 0 lunid: 600508b1001c7ae365683dadf9c09cca ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da5 Providers: 1. Name: da5 Mediasize: 299966445568 (279G) Sectorsize: 512 Mode: r2w2e5 descr: HP RAID 0 lunid: 600508b1001c004fd893c9c972cc88e1 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da6 Providers: 1. Name: da6 Mediasize: 299966445568 (279G) Sectorsize: 512 Mode: r2w2e5 descr: HP RAID 0 lunid: 600508b1001c3d291b30a6737d6ad338 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da7 Providers: 1. Name: da7 Mediasize: 299966445568 (279G) Sectorsize: 512 Mode: r2w2e5 descr: HP RAID 0 lunid: 600508b1001c8a141bd369eec685f8a1 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da8 Providers: 1. Name: da8 Mediasize: 8001529667584 (7.3T) Sectorsize: 512 Mode: r1w1e3 descr: HP RAID 0 lunid: 600508b1001c9f5c3fa7308fdba03f07 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da9 Providers: 1. Name: da9 Mediasize: 8001529667584 (7.3T) Sectorsize: 512 Mode: r1w1e3 descr: HP RAID 0 lunid: 600508b1001c2c148ae905550fa5bce9 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da10 Providers: 1. Name: da10 Mediasize: 8001529667584 (7.3T) Sectorsize: 512 Mode: r2w2e5 descr: HP RAID 0 lunid: 600508b1001c49c67e58600edde81c41 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da11 Providers: 1. Name: da11 Mediasize: 8001529667584 (7.3T) Sectorsize: 512 Mode: r2w2e5 descr: HP RAID 0 lunid: 600508b1001c038c271bf4f930a5e72d ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da12 Providers: 1. Name: da12 Mediasize: 4000753475584 (3.6T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001c0b5b461287b0672423fe ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da13 Providers: 1. Name: da13 Mediasize: 4000753475584 (3.6T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001cbd6967bf965a05d274bd ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da14 Providers: 1. Name: da14 Mediasize: 3000559427584 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001cdce56335bb8ea47298d9 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da15 Providers: 1. Name: da15 Mediasize: 3000559427584 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001c1ad213a9648e4700a5f5 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da16 Providers: 1. Name: da16 Mediasize: 3000559427584 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001c988a42d81d445a267d3c ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da17 Providers: 1. Name: da17 Mediasize: 3000559427584 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001c50fb58d7136a1d50ae18 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da18 Providers: 1. Name: da18 Mediasize: 3000559427584 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001c45da4e44923be4adf5f4 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da19 Providers: 1. Name: da19 Mediasize: 3000559427584 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001c1f30b784931c4e767a79 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da20 Providers: 1. Name: da20 Mediasize: 3000559427584 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001cd9e1fc87d79129bc318f ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da21 Providers: 1. Name: da21 Mediasize: 3000559427584 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001c8a9bb71d7a630550c6a4 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da22 Providers: 1. Name: da22 Mediasize: 3000559427584 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001cd9bbfc2b1f58827e1ba3 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: da23 Providers: 1. Name: da23 Mediasize: 3000559427584 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 descr: HP RAID 0 lunid: 600508b1001c434e64d4ca520c788eb6 ident: 50014380238AF680 rotationrate: unknown fwsectors: 32 fwheads: 255 Geom name: cd0 Providers: 1. Name: cd0 Mediasize: 0 (0B) Sectorsize: 2048 Mode: r0w0e0 descr: hp DVD A DS8A8SH ident: (null) rotationrate: unknown fwsectors: 0 fwheads: 0 Geom name: da24 Providers: 1. Name: da24 Mediasize: 12002218999808 (11T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r2w2e5 descr: Mobius H /W RAID10 lunname: JMICRON JMS567 DISK00 0123456789ABCDEF lunid: 3001234567891234 ident: 0123456789ABCDEF rotationrate: unknown fwsectors: 63 fwheads: 255
Anyone have any thoughts? Does my LUN for the SAS shelf need to be 0 since it is on Perc 410i which is LUN 0? I'm kind of in uncharted territory here.