P320h (Micron NVMe) not recognized

Status
Not open for further replies.

Rand

Guru
Joined
Dec 30, 2013
Messages
906
Hi,

trying to have some fun with various devices as slog for my pool.
I am running virtualized in ESX 6.5 and am passing through a couple of NVMe cards.

Intel 750 & P3500 have been recognized without any issue, but the P320h is not.
It is detected properly by ESX and other passed through VMs (Windows, will have to test others) but not FreeNas (latest stable train release), or rather it is seen, but its not identified properly as nvme drive but as storage controller

lspci

Code:
02:01.0 Ethernet controller: Intel Corporation 82545EM Gigabit Ethernet Controller (Copper) (rev 01)
03:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS1068 PCI-X Fusion-MPT SAS (rev 01)
04:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2116 PCI-Express Fusion-MPT SAS-2 [Meteor] (rev 02)
0b:00.0 Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01)
0c:00.0 Mass storage controller: Micron Technology Inc RealSSD P320h (rev 03)
13:00.0 Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)
14:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)


pciconf -l

Code:
em0@pci0:2:1:0: class=0x020000 card=0x075015ad chip=0x100f8086 rev=0x01 hdr=0x00
mpt0@pci0:3:0:0:  class=0x010700 card=0x197615ad chip=0x00541000 rev=0x01 hdr=0x00
mps0@pci0:4:0:0:  class=0x010700 card=0x30d01000 chip=0x00641000 rev=0x02 hdr=0x00
vmx0@pci0:11:0:0:  class=0x020000 card=0x07b015ad chip=0x07b015ad rev=0x01 hdr=0x00
none2@pci0:12:0:0:  class=0x018000 card=0x10081344 chip=0x51501344 rev=0x03 hdr=0x00
nvme0@pci0:19:0:0:  class=0x010802 card=0x37048086 chip=0x09538086 rev=0x01 hdr=0x00
mps1@pci0:20:0:0:  class=0x010700 card=0x1f1c1028 chip=0x00721000 rev=0x03 hdr=0x00


pciconf -lc none2@pci0:12:0:0:
Code:
none0@pci0:12:0:0:  class=0x018000 card=0x10081344 chip=0x51501344 rev=0x03 hdr=0x00
  cap 10[40] = PCI-Express 2 endpoint max data 128(128) link x32(x32)
  speed 5.0(5.0) ASPM disabled(L0s)
  cap 01[c0] = powerspec 3  supports D0 D3  current D0
  cap 05[d0] = MSI supports 1 message, 64 bit, vector masks
  ecap 0001[100] = AER 2 0 fatal 0 non-fatal 1 corrected

pciconf -lc nvme0@pci0:19:0:0:
Code:
nvme0@pci0:19:0:0:  class=0x010802 card=0x37048086 chip=0x09538086 rev=0x01 hdr=0x00
  cap 01[40] = powerspec 3  supports D0 D3  current D0
  cap 11[50] = MSI-X supports 32 messages
  Table in map 0x10[0x2000], PBA in map 0x10[0x3000]
  cap 10[60] = PCI-Express 2 endpoint max data 128(128) link x32(x32)
  speed 5.0(5.0) ASPM disabled(L0s)
  ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected
  ecap 0002[150] = VC 1 max VC0
  ecap 0004[180] = Power Budgeting 1
  ecap 000e[190] = ARI 1
  ecap 0003[270] = Serial 1 55cd2e404bde9019
  ecap 0019[2a0] = PCIe Sec 1 lane errors 0


Since its not identified as a nvme device o/c its not mapped accordingly and not usable

nvmecontrol devlist
Code:
 nvme0: INTEL SSDPEDMX400G4
  nvme0ns1 (381554MB)

nvmecontrol identify none2@pci0:12:0:0:
Code:
nvmecontrol: controller/namespace ids must begin with 'nvme'


Any ideas why the drive is not identified correctly? :)
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,175
What happens with bare metal? What hardware is this running on and what kind of PCIe connectivity do these various SSDs get?
 

Rand

Guru
Joined
Dec 30, 2013
Messages
906
Baremetal is on my Agenda for today.
Its /They (2) are running via 2 PCIe adapter cards (Funtin/SinTech) (2.5" drives) in a SM x10DRI variant.
I have actually swapped out the 750 for the second P320h after the inital issues to make sure the adapter is not an issue (as it is working fine for the 750).
One is in a PCI-E 3.0 x8, on in a PCI-E 2.0 x4 (in x8) slot

I don't think its the adapter (or the platform) since it gets detected by FN similarly to ESX or windows (Storage controller) - it just handles it differently.
O/c that doesn't mean anything and you might be totally correct suspecting the hw :)
 

Rand

Guru
Joined
Dec 30, 2013
Messages
906
Just moved one adapter to another board and booted up with my older USB based install (release from March 2016) - same issue:

upload_2017-1-13_8-49-39.png


upload_2017-1-13_8-49-9.png


Still might be the adapters o/c but with other NVMe drives working fine on them I doubt it.
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,175
Can we get a product page for that adapter?
 

Rand

Guru
Joined
Dec 30, 2013
Messages
906
No.1 : Sintech page

No.2: Can't find a vendor page, so here's the Amazon link

As i said I have a P320 on both of them atm, neither is working.
I have used a Intel 750 on the Sintech one without any issues (detected properly in FN).
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,175

mav@

iXsystems
iXsystems
Joined
Sep 29, 2011
Messages
1,428
This Micron SSD is not NVMe. It uses some proprietary AHCI-like interface.
 

Rand

Guru
Joined
Dec 30, 2013
Messages
906
You both are too quick for me to update here :p
I'll contact Micron, thanks for your help
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,175
Well, that's one mystery solved.

At least it's not an LSI SAS2008 in disguise, driving four SAS SSDs with funky RAID.
 

Rand

Guru
Joined
Dec 30, 2013
Messages
906
True:)

They have Linux drivers... but since this is a 4 yr old device I doubt they will provide FreeBSD ones :/
 
Status
Not open for further replies.
Top