FC HBA to Brocade 300 FC switch not working

[jjonsson]

Hi!

I have configured FC Target mode according to this: https://forums.freenas.org/index.php?threads/freenas-9-3-fc-fibre-channel-target-mode-das-san.27653

The LEDs on the FC HBA is on (solid light) but my switch is reporting "Port Status = No Light".
Any idea what I might have been done wrong ?

I haven't attached my VMWare host server to the FC switch yet, but should that make a difference ?
Shouldn't the switch have light on the port connected to the FreeNAS server and report "connected" ?

Version: FreeNAS-9.3-STABLE-201511040813
FC HBA is Qlogic with newest firmware

Any help is appreciated.....

 

[mav@]

What HBAs are you using and what tunables/scripts exactly have you set?

On my lab I have Brocade 200E successfully working with Qlogic 23xx, 24xx and 25xx cards. Now I am trying to resurrect even ancient 22xx (now working as initiator, but not target). Generally there is significant ongoing work on QLogic driver now, that I hope should get FreeNAS somewhere in a month.

 

[jjonsson]

What HBAs are you using and what tunables/scripts exactly have you set?

On my lab I have Brocade 200E successfully working with Qlogic 23xx, 24xx and 25xx cards. Now I am trying to resurrect even ancient 22xx (now working as initiator, but not target). Generally there is significant ongoing work on QLogic driver now, that I hope should get FreeNAS somewhere in a month.

It's a Qlogic QLE2562 adapter.

Tunables:
variable:ispfw_load ____value:YES_________type:loader___(start HBA firmware)?
variable:ctl_load ______value:YES _________type:loader___(start ctl service)?
variable:hint.isp.0.role__value:0 (zero)______type:loader___(target mode FC port 1)?
variable:hint.isp.1.role __value:0 (zero)______type:loader___(target mode FC port 2)?
variable:ctladm _______value:port -o on -t fc _type:loader___(bind the ports)?

ctladm is it the letter o or the number 0 (zero) ?
Should the value YES be with capital letters ?

Script:
Type:command________command:ctladm port -o on -t fc____When:Post Init

Since this HBA card has 2 ports should something else be added here:
Script:
Type:command________command:ctladm port -o on -t fc____When:Post Init


I have also remembered to turn iSCSI to "ON" in services

So what have you done to make it work ? Anything special I might have forgot or not know about ?

 

[mav@]

Tunables:
variable:ispfw_load ____value:YES_________type:loader___(start HBA firmware)?

This loads firmware bundled with FreeNAS instead of cards built-in.

variable:ctl_load ______value:YES _________type:loader___(start ctl service)?

This is not needed since CTL also used for iSCSI now and included by default.

variable:hint.isp.0.role__value:0 (zero)______type:loader___(target mode FC port 1)?
variable:hint.isp.1.role __value:0 (zero)______type:loader___(target mode FC port 2)?
variable:ctladm _______value:port -o on -t fc _type:loader___(bind the ports)?

The last line has no sense as tunable, it should be run later as a script during boot.

ctladm is it the letter o or the number 0 (zero) ?
Should the value YES be with capital letters ?

Yes, and yes.

Since this HBA card has 2 ports should something else be added here:
Script:
Type:command________command:ctladm port -o on -t fc____When:post Init

"-t fc" will enable target mode on all FC ports, no matter how many do you have.

 

[jjonsson]

So my setup is correct or do I need to remove something ?

Any ideas why it's not working ?

 

[jjonsson]

How can I check if drivers are loaded and FreeNAS can see adapter and use it ?

In a shell I tried this command:

[root@freenas] ~# ctladm portlist -v
Port Online Frontend Name pp vp
0 YES ioctl ioctl 0 0
All LUNs mapped
port_type=4
1 YES tpc tpc 0 0
All LUNs mapped
port_type=8
2 NO camsim camsim 0 0 naa.5000000692e16f03
Target: naa.5000000692e16f00
All LUNs mapped
port_type=8
3 YES iscsi iscsi 257 1 iqn.2005-10.org.freenas.ctl:esxi,t,0x0101
Target: iqn.2005-10.org.freenas.ctl:esxi
LUN 0: 1
LUN 1: 0
port_type=16
cfiscsi_state=1
cfiscsi_target=iqn.2005-10.org.freenas.ctl:esxi
cfiscsi_portal_group_tag=257
cfiscsi_target_alias=ESXi
ctld_portal_group_name=pg1

If it's the "CAMSIM" then it says Online = NO....

 

[mav@]

In portlist output should be some ports with ispX names. Seems something is wrong with cards support. Please check `dmesg |grep isp` output.

 

[jjonsson]

It gives the following result:

[root@freenas] ~# dmesg | grep isp
ispfw: registered firmware <isp_1040>
ispfw: registered firmware <isp_1040_it>
ispfw: registered firmware <isp_1080>
ispfw: registered firmware <isp_1080_it>
ispfw: registered firmware <isp_12160>
ispfw: registered firmware <isp_12160_it>
ispfw: registered firmware <isp_2100>
ispfw: registered firmware <isp_2200>
ispfw: registered firmware <isp_2300>
ispfw: registered firmware <isp_2322>
ispfw: registered firmware <isp_2400>
ispfw: registered firmware <isp_2400_multi>
ispfw: registered firmware <isp_2500>
ispfw: registered firmware <isp_2500_multi>
vgapci0: <VGA-compatible display> port 0x9000-0x907f mem 0xf8000000-0xfbffffff,0xfe100000-0xfe13ffff at device 5.0 on pci6

What to look for ?

 

[mav@]

There should be something like: isp0: <Qlogic ISP 2532 PCI FC-AL Adapter> ...

Check that card is properly installed and show output of `pciconf -lvcb`.

 

[jjonsson]

Actually I found out that the card installed was a QLE2462. I have just swapped it with a QLE2562. I'm now getting the following result:

[root@freenas] ~# ctladm portlist -v
Port Online Frontend Name pp vp
0 YES ioctl ioctl 0 0
All LUNs mapped
port_type=4
1 YES tpc tpc 0 0
All LUNs mapped
port_type=8
2 YES camsim camsim 0 0 naa.500000093143c303
Target: naa.500000093143c300
All LUNs mapped
port_type=8
3 YES iscsi iscsi 257 1 iqn.2005-10.org.freenas.ctl:esxi,t,0x0101
Target: iqn.2005-10.org.freenas.ctl:esxi
LUN 0: 1
LUN 1: 0
port_type=16
cfiscsi_state=1
cfiscsi_target=iqn.2005-10.org.freenas.ctl:esxi
cfiscsi_portal_group_tag=257
cfiscsi_target_alias=ESXi
ctld_portal_group_name=pg1

And

[root@freenas] ~# dmesg | grep isp
ispfw: registered firmware <isp_1040>
ispfw: registered firmware <isp_1040_it>
ispfw: registered firmware <isp_1080>
ispfw: registered firmware <isp_1080_it>
ispfw: registered firmware <isp_12160>
ispfw: registered firmware <isp_12160_it>
ispfw: registered firmware <isp_2100>
ispfw: registered firmware <isp_2200>
ispfw: registered firmware <isp_2300>
ispfw: registered firmware <isp_2322>
ispfw: registered firmware <isp_2400>
ispfw: registered firmware <isp_2400_multi>
ispfw: registered firmware <isp_2500>
ispfw: registered firmware <isp_2500_multi>
vgapci0: <VGA-compatible display> port 0x9000-0x907f mem 0xf8000000-0xfbffffff,0xfe100000-0xfe13ffff at device 5.0 on pci6

But my Brocade switch is not reporting link on the port. Maybe som port settings in the switch ?

 

[mav@]

And again in this result is nothing about Qlogic card. Can PCIe slot where you are inserting them dead or disabled? So far problem seems not with switch, but with QLogic cards detection by OS.

 

[jjonsson]

Damn.....

Just found out that Qlogic cards can't coexist with LSI controller in server. Swapped card bay and the Qlogic card showed up nicely, but the LSI did not... Swapped back again and LSI is working, Qlogic is not :-(

 

[mav@]

And Qlogic itself (without LSI) works in either of two slots?