can not reconnect to iscsi share after a reset

[Krackster]

I did a reset to my truenas server and i can not get my iscsi drive to come up can someone help me?

 

[jgreco]

iSCSI generally isn't a "share". What client do you have attached to it? ESXi?

 

[Krackster]

this is a home file server Truenas Scale, my home has 8 computers on it, 3 of which are gaming rigs. Each gaming rig has it's own ISCSI 3TB harddrive for steam librarys. this server is an all ssd (2x 7 2TB raidz2 vdev's}, dual 10gig nics, X470d4u2-t2 & amd 4750g Pro cpu, 128GB ECC 2666 ram. 3 seperate iscsi drives, one for eac of the gaming rigs. the iscsi drives are not shared.

 

[Krackster]

this is a home file server Truenas Scale, my home has 8 computers on it, 3 of which are gaming rigs. Each gaming rig has it's own ISCSI 3TB harddrive for steam librarys. this server is an all ssd (2x 7 2TB raidz2 vdev's}, dual 10gig nics, X470d4u2-t2 & amd 4750g Pro cpu, 128GB ECC 2666 ram. 3 seperate iscsi drives, one for eac of the gaming rigs. the iscsi drives are not shared.

14 - 2TB ssd's in total on the pool, all client computers run windows

 

[Krackster]

Truenas Scale server build:
AMD Ryzen 7 PRO 4750G Processor
Asrock X470D4U2-2T motherboard
128GB (4x32) ECC UDIMM DDR4-2666 PC4-21300 Memory
16 - Micron server grade 2TB ssd's (2 x 7 ssd raidz2 VDEV's, 17.21 TiB total, 2 Hot Spares)
2 - Solidigm 2TB NVME's (Mirrored Pool PCIE slotted 4x4x 2TB TOTAL pool)
2 - Intel 120GB SSD's in Mirrored (OPSYS)

M.2 slot 1 (Gen 3x2 20Gb) - 6 port sata III expander M.2 Gen 3x2 card
M.2 slot 2 (Gen 2x4 16Gb) - 6 port sata III expander M.2 Gen 3x2 card
Motherboard 6 sata III Ports
Total sata ports 18
3 - Icydock 6 bay hot swappable SSD drive caddies, total 18 hot swap bays
MSI 650 Watt power supply

 

[Krackster]

Correction:
M.2 slot 1 (Gen 3x2 16Gb) - 6 port sata III expander M.2 Gen 3x2 card
M.2 slot 2 (Gen 2x4 20Gb) - 6 port sata III expander M.2 Gen 3x2 card

 

[Krackster]

this what I built

 

[Krackster]

oops

 

[Krackster]

well I tried to make them correct but that seems to have failed, sorry

 

[HoneyBadger]

Welcome to the forums @Krackster - I appreciate the detail in the hardware configuration and photos (and applaud the creative concentration of 18x 2.5" SSDs into a compact form factor!)

If you sign into the TrueNAS SCALE web UI, is your pool visible under the Storage menu, and is the iSCSI service running under System -> Services?

I do have some slight concerns about the M.2 expander cards - I assume these are the ASM1166-based expander cards I've seen, which are better than the JMicron ones in that they don't use a SATA port multiplier, but still not as well-supported as the traditional LSI option.

 

[Krackster]

Welcome to the forums @Krackster - I appreciate the detail in the hardware configuration and photos (and applaud the creative concentration of 18x 2.5" SSDs into a compact form factor!)

If you sign into the TrueNAS SCALE web UI, is your pool visible under the Storage menu, and is the iSCSI service running under System -> Services?

I do have some slight concerns about the M.2 expander cards - I assume these are the ASM1166-based expander cards I've seen, which are better than the JMicron ones in that they don't use a SATA port multiplier, but still not as well-supported as the traditional LSI option.

yes the server came back up after the reset. the server appears to be fully functional and is currently running. after I did a reset I imported both pools, 16ssd main storage pool and the NVME VM pool. ( the nvme vm pool is not configured yet just the pool) . SMB and Iscsi services are running, The windows initiator shows the ssd pool connected but there is no harddrive is showing up under the windows drive list. The whole system was working perfect until I started messing with my trying to bond my nics, A suggestion from another person for the Future Windows VM I was thinking about. I messed that up so I reset thinking it would come back up like any other pool. I WAS VERY WRONG!!!! This is a permanant server solution derived from my home lab. I should have been testing it on my home lab before deployment on the new server.

 

[Krackster]

2 of these,

ASM1166 6Gbps Ph516 6 Port Expansion Interface Card with Smart Indicator​

Low heat, low power, high speeds ( on my 10gig network with 14 ssd read and write on the ISCSI drive in
Windows Crystal disk mark 8:
read / write
850MB's 850MB's
850MB's 850MB's
450MB's 410MB's
14.5MB's 12.0MB's
I am obviously bottle necked by the cat 5e cables in the walls the longest run being70 feet. I will be adding cat8 cabling to my 12 wall drops in a couple of months. I have been testing this configuration for 2 months. Last week I finally moved it from test bed to server chassis and it was working flawlessly until I started messing with the bonding thing. I should have just left it alone.

 

[Krackster]

I did try these cards in this config before settling on M.2 adapters:

LSI 9300-16i 16-port SAS9300-16I 12GB/s Host Bus Adapter 03-25600-01B and
LSI 9201-16i 6G 16P SAS HBA P19 IT Mode ZFS FreeNAS unRAID 4* Cable SATA US and
SATA PCIe Adapter 24 Ports SATA III to PCI Express 3.0 X1 Expansion Card US