Resource icon

SLOG benchmarking and finding the best SLOG

awasb

Patron
Joined
Jan 11, 2021
Messages
398
Certainly not the fastest ...

Code:
root@truenas ~ # smartctl -a /dev/nvme0                                                                                                                    [0]
smartctl 7.2 2020-12-30 r5155 [FreeBSD 12.2-RELEASE-p10 amd64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Number:                       INTEL MEMPEK1W016GA
Serial Number:                      PHBT7131042J016D
Firmware Version:                   K3110300
PCI Vendor/Subsystem ID:            0x8086
IEEE OUI Identifier:                0x5cd2e4
Controller ID:                      0
NVMe Version:                       <1.2
Number of Namespaces:               1
Namespace 1 Size/Capacity:          14,403,239,936 [14.4 GB]
Namespace 1 Formatted LBA Size:     512
Local Time is:                      Mon Oct 25 13:05:03 2021 CEST
Firmware Updates (0x02):            1 Slot
Optional Admin Commands (0x0006):   Format Frmw_DL
Optional NVM Commands (0x0046):     Wr_Unc DS_Mngmt Timestmp
Log Page Attributes (0x02):         Cmd_Eff_Lg
Maximum Data Transfer Size:         32 Pages

Supported Power States
St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat
 0 +     4.50W       -        -    0  0  0  0        0       0

Supported LBA Sizes (NSID 0x1)
Id Fmt  Data  Metadt  Rel_Perf
 0 +     512       0         2

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02)
Critical Warning:                   0x00
Temperature:                        35 Celsius
Available Spare:                    100%
Available Spare Threshold:          0%
Percentage Used:                    0%
Data Units Read:                    179,366 [91.8 GB]
Data Units Written:                 2,126,253 [1.08 TB]
Host Read Commands:                 48,755,158
Host Write Commands:                24,860,914
Controller Busy Time:               0
Power Cycles:                       21
Power On Hours:                     1,316
Unsafe Shutdowns:                   6
Media and Data Integrity Errors:    0
Error Information Log Entries:      0

Error Information (NVMe Log 0x01, 16 of 64 entries)
No Errors Logged


... but fast enough for my 1 GbE @home ...

Code:
root@truenas ~ # diskinfo -wS /dev/nvd0                                                                                                                    [0]
/dev/nvd0
        512             # sectorsize
        14403239936     # mediasize in bytes (13G)
        28131328        # mediasize in sectors
        0               # stripesize
        0               # stripeoffset
        INTEL MEMPEK1W016GA     # Disk descr.
        PHBT7131042J016D        # Disk ident.
        Yes             # TRIM/UNMAP support
        0               # Rotation rate in RPM

Synchronous random writes:
         0.5 kbytes:     22.3 usec/IO =     21.9 Mbytes/s
           1 kbytes:     20.6 usec/IO =     47.4 Mbytes/s
           2 kbytes:     26.7 usec/IO =     73.3 Mbytes/s
           4 kbytes:     40.7 usec/IO =     96.1 Mbytes/s
           8 kbytes:     67.7 usec/IO =    115.4 Mbytes/s
          16 kbytes:    121.8 usec/IO =    128.3 Mbytes/s
          32 kbytes:    231.5 usec/IO =    135.0 Mbytes/s
          64 kbytes:    468.1 usec/IO =    133.5 Mbytes/s
         128 kbytes:    918.1 usec/IO =    136.2 Mbytes/s
         256 kbytes:   1804.2 usec/IO =    138.6 Mbytes/s
         512 kbytes:   3530.9 usec/IO =    141.6 Mbytes/s
        1024 kbytes:   6991.0 usec/IO =    143.0 Mbytes/s
        2048 kbytes:  13873.9 usec/IO =    144.2 Mbytes/s
        4096 kbytes:  27740.7 usec/IO =    144.2 Mbytes/s
        8192 kbytes:  55319.9 usec/IO =    144.6 Mbytes/s
 

HoneyBadger

actually does care
Administrator
Moderator
iXsystems
Joined
Feb 6, 2014
Messages
5,110
SO what currently IS the fastest slog?

If cost and complexity is no object, NVDIMMs on supported hardware.

Next up will probably be the high-end Optane devices (P5800X, Optane DIMMs, P4800X) although the DIMM devices might be limited for now by a fairly new pmem driver. The P4801X M.2 cards are your next option.

Radian RMS-200/300 cards appear to be slower in small-block but outrun Optane at the top-end, and have the advantage of limitless endurance by design, but I haven't found a source to buy them brand new, only "refurb" and "used pulls."
 

kspare

Guru
Joined
Feb 19, 2015
Messages
507
Ive tried the rms 200 cards. I kept having fan issues.

trying a 100gb 4801x, still getting a bottleneck and can’t max out a 10gb link let alone a 40gb link.

time to figure out how to make a 5800 work!
 

HoneyBadger

actually does care
Administrator
Moderator
iXsystems
Joined
Feb 6, 2014
Messages
5,110
time to figure out how to make a 5800 work!

StarTech U.2 to PCIe adapter:

Available from Amazon and other distributors for less. Attach the P5800X U.2 and drop it in a PCIe slot, it should show up as a standard NVMe device.
 

Herr_Merlin

Patron
Joined
Oct 25, 2019
Messages
200
Last edited:

kspare

Guru
Joined
Feb 19, 2015
Messages
507
What Kind of Fan Issues ?

They would just fail, I quit buying them. I kept getting alarms for over heating and found that the fans just stopped working.
 

Kevin666

Cadet
Joined
Jul 23, 2021
Messages
3
Ive tried the rms 200 cards. I kept having fan issues.

trying a 100gb 4801x, still getting a bottleneck and can’t max out a 10gb link let alone a 40gb link.

time to figure out how to make a 5800 work!
Same problem, Maybe someone else can pitch in cause i'm thinking of stripping mine and make my own cooling on it...
 

Andrew32

Cadet
Joined
Oct 19, 2021
Messages
7
I just replaced the fan on my RMS-200. Not hard but does require some soldering skills. Cost less than $10 for a good fan. I'm still looking for the firmware update... Most of the cards seem to have some large hours on them (meaning YEARS of on-time) and have past the fan's MTBF.
 

Andrew32

Cadet
Joined
Oct 19, 2021
Messages
7
The RMS-200 takes a high RPM/CFM BB 40x40x7mm 12v 3-pin tach fan.... You could use a 7.6mm fan but the common 10mm fans stick out too much. Evercool EC4007H12CA, ADDA AD0412HB-K96 or AD0412HB-K93. The connector does not matter as you cut it off any way and solder the wires directly to the board. Watch the mounting holes. If the new holes are shallow the screws may be too long and hit the main board (use washers or short screws). Be careful of the small wires on the back of the board by the caps, they are fragile.

As for performance, I found a 10% improvement if you partition the RMS-200 8G in to two 4G slices and add them both to the pool. It's strange that writing twice to the same card this way is faster.... at least on my system. It did not seem to matter if I used 3 or 4 partitions or two different cards.

4G (total) was not enough as the system throttled quickly (with default settings). Even with 3GB/sec main storage (sequential direct write) I did not seem to get more than 1.2GB/sec with the log enabled on the pool (sustained sequential large sync writes).

The RMS-200 will become moot as some of the new NVMe SSD cards are able to do 7GB/sec at least for 100GB using SLC cache and the NVDIMMs are designed for this and are even faster and cheaper (if your MB can support them). But for an old PCIe 3 system on a budget the RMS-200 is still a good choice.

I'm still looking for the last RMS-200 firmware update if anyone has it from the NetAPP firmware bundle.
 
Joined
Nov 12, 2020
Messages
2
400GB P5800x with 4K sector size.

Code:
root@truenas[~]# smartctl -a /dev/nvme0
smartctl 7.2 2020-12-30 r5155 [FreeBSD 12.2-RELEASE-p11 amd64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Number:                       INTEL SSDPF21Q400GB
Serial Number:                      PHAL124600B2400AGN
Firmware Version:                   L0310200
PCI Vendor/Subsystem ID:            0x8086
IEEE OUI Identifier:                0x5cd2e4
Total NVM Capacity:                 400,088,457,216 [400 GB]
Unallocated NVM Capacity:           0
Controller ID:                      0
NVMe Version:                       1.3
Number of Namespaces:               128
Local Time is:                      Fri Jan 14 21:07:51 2022 EST
Firmware Updates (0x18):            4 Slots, no Reset required
Optional Admin Commands (0x001e):   Format Frmw_DL NS_Mngmt Self_Test
Optional NVM Commands (0x004e):     Wr_Unc DS_Mngmt Wr_Zero Timestmp
Log Page Attributes (0x1e):         Cmd_Eff_Lg Ext_Get_Lg Telmtry_Lg Pers_Ev_Lg
Maximum Data Transfer Size:         32 Pages
Warning  Comp. Temp. Threshold:     70 Celsius
Critical Comp. Temp. Threshold:     80 Celsius

Supported Power States
St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat
 0 +    13.00W       -        -    0  0  0  0        0       0
 1 +    11.00W       -        -    0  1  0  1        0       0
 2 +     9.00W       -        -    0  2  0  2        0       0

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02)
Critical Warning:                   0x00
Temperature:                        38 Celsius
Available Spare:                    100%
Available Spare Threshold:          0%
Percentage Used:                    0%
Data Units Read:                    42,059 [21.5 GB]
Data Units Written:                 187,026 [95.7 GB]
Host Read Commands:                 2,705,995
Host Write Commands:                3,635,320
Controller Busy Time:               0
Power Cycles:                       2
Power On Hours:                     4
Unsafe Shutdowns:                   0
Media and Data Integrity Errors:    0
Error Information Log Entries:      0
Warning  Comp. Temperature Time:    0
Critical Comp. Temperature Time:    0

Error Information (NVMe Log 0x01, 16 of 256 entries)
No Errors Logged


Code:
root@truenas[~]# diskinfo -wS /dev/nvd0
/dev/nvd0
        4096            # sectorsize
        400088457216    # mediasize in bytes (373G)
        97677846        # mediasize in sectors
        0               # stripesize
        0               # stripeoffset
        INTEL SSDPF21Q400GB     # Disk descr.
        PHAL124600B2400AGN      # Disk ident.
        Yes             # TRIM/UNMAP support
        0               # Rotation rate in RPM

Synchronous random writes:
           4 kbytes:     17.3 usec/IO =    225.5 Mbytes/s
           8 kbytes:     19.3 usec/IO =    405.5 Mbytes/s
          16 kbytes:     24.2 usec/IO =    646.4 Mbytes/s
          32 kbytes:     31.2 usec/IO =   1000.9 Mbytes/s
          64 kbytes:     42.2 usec/IO =   1482.3 Mbytes/s
         128 kbytes:     62.1 usec/IO =   2011.9 Mbytes/s
         256 kbytes:     93.7 usec/IO =   2666.9 Mbytes/s
         512 kbytes:    149.5 usec/IO =   3344.0 Mbytes/s
        1024 kbytes:    260.9 usec/IO =   3833.1 Mbytes/s
        2048 kbytes:    485.7 usec/IO =   4117.6 Mbytes/s
        4096 kbytes:    931.2 usec/IO =   4295.3 Mbytes/s
        8192 kbytes:   1812.9 usec/IO =   4412.8 Mbytes/s
 

Chris Tobey

Contributor
Joined
Feb 11, 2014
Messages
114
400GB P5800x with 4K sector size.
Do you know what steps you took to set the sector size?
I tried and failed:
Code:
PS C:\Program Files\Intel\Intel(R) Memory and Storage Tool> .\IntelMAS.exe start -intelssd 1 -nvmeformat LBAformat=3
WARNING! You have selected to format the drive!
Proceed with the format? (Y|N): y
Formatting...(This can take several minutes to complete)
IOCTL error format nvm failed

 
Joined
Nov 12, 2020
Messages
2
Do you know what steps you took to set the sector size?
I tried and failed:
Code:
PS C:\Program Files\Intel\Intel(R) Memory and Storage Tool> .\IntelMAS.exe start -intelssd 1 -nvmeformat LBAformat=3
WARNING! You have selected to format the drive!
Proceed with the format? (Y|N): y
Formatting...(This can take several minutes to complete)
IOCTL error format nvm failed

I had the same problem on a Windows VM so I spun up an Ubuntu VM and it worked per the instructions from the manual immediately.

 

mjt5282

Contributor
Joined
Mar 19, 2013
Messages
139
Do you know what steps you took to set the sector size?
I tried and failed:
Code:
PS C:\Program Files\Intel\Intel(R) Memory and Storage Tool> .\IntelMAS.exe start -intelssd 1 -nvmeformat LBAformat=3
WARNING! You have selected to format the drive!
Proceed with the format? (Y|N): y
Formatting...(This can take several minutes to complete)
IOCTL error format nvm failed


i usually use Truenas Core, that being said, some utilities are not well supported under freebsd. I have/had several used radian RMS-200 SLOG devices and I format them to 4K sector size by booting into Truenas Scale, and running the following commands (WARNING, is destructive):

nvme list
nvme format /dev/nvme1n1 --lbaf=2 --reset

use choose the LABF argument by running smartctl -a /dev/nvme1 and searching for the LBA options on your particular NVME device. Many only have 512 bytes (such as my new micron NVME drives), the radian supports 512 and 4K.

smartctl -a /dev/nvme0
...
Supported LBA Sizes (NSID 0x1)
Id Fmt Data Metadt Rel_Perf
0 + 512 0 0
...
 

jtoddowen

Cadet
Joined
May 9, 2022
Messages
1
@mjt5282 I haven't found any documentation on the RMS-200 card I have. Do you have the LED blink code meanings? The flyer mentions a reset switch. Do you know where it is located and if you've ever needed to use it? Also, do you know the significance of the eight DIP switches on the back? Mine came with #8 on and #1 thru #7 off.
 

awasb

Patron
Joined
Jan 11, 2021
Messages
398
Intel Optane P1600X (M.2 NVMe with _PLP_ PCIe3.0 x4 mounted to a PCIe2.0 8x slot)

Code:
root@truenas ~ # smartctl -a /dev/nvme0 

smartctl 7.2 2020-12-30 r5155 [FreeBSD 12.2-RELEASE-p14 amd64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Number:                       INTEL SSDPEK1A118GA
Serial Number:                      BTOC12530FJD118B
Firmware Version:                   U5110550
PCI Vendor/Subsystem ID:            0x8086
IEEE OUI Identifier:                0x5cd2e4
Controller ID:                      0
NVMe Version:                       1.1
Number of Namespaces:               1
Namespace 1 Size/Capacity:          118,410,444,800 [118 GB]
Namespace 1 Formatted LBA Size:     512
Namespace 1 IEEE EUI-64:            5cd2e4 b2ea7d0100
Local Time is:                      Wed May 11 21:16:59 2022 CEST
Firmware Updates (0x02):            1 Slot
Optional Admin Commands (0x0016):   Format Frmw_DL Self_Test
Optional NVM Commands (0x0056):     Wr_Unc DS_Mngmt Sav/Sel_Feat Timestmp
Log Page Attributes (0x03):         S/H_per_NS Cmd_Eff_Lg
Maximum Data Transfer Size:         32 Pages
Warning  Comp. Temp. Threshold:     70 Celsius
Critical Comp. Temp. Threshold:     78 Celsius

Supported Power States
St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat
 0 +     5.50W       -        -    0  0  0  0     1000    4000
 1 +     4.60W       -        -    0  1  0  1     1000    4000
 2 +     3.30W       -        -    0  2  0  2     1000    4000

Supported LBA Sizes (NSID 0x1)
Id Fmt  Data  Metadt  Rel_Perf
 0 +     512       0         2
 1 -    4096       0         0

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02)
Critical Warning:                   0x00
Temperature:                        51 Celsius
Available Spare:                    100%
Available Spare Threshold:          0%
Percentage Used:                    0%
Data Units Read:                    37,953 [19.4 GB]
Data Units Written:                 17,450 [8.93 GB]
Host Read Commands:                 37,950,056
Host Write Commands:                300,515
Controller Busy Time:               0
Power Cycles:                       2
Power On Hours:                     0
Unsafe Shutdowns:                   0
Media and Data Integrity Errors:    0
Error Information Log Entries:      0
Warning  Comp. Temperature Time:    0
Critical Comp. Temperature Time:    0

Error Information (NVMe Log 0x01, 16 of 64 entries)
No Errors Logged


Code:
root@truenas ~ # nvmecontrol identify nvme0                             

Controller Capabilities/Features
================================
Vendor ID:                   8086
Subsystem Vendor ID:         8086
Serial Number:               BTOC12530FJD118B
Model Number:                INTEL SSDPEK1A118GA
Firmware Version:            U5110550
Recommended Arb Burst:       0
IEEE OUI Identifier:         e4 d2 5c
Multi-Path I/O Capabilities: Not Supported
Max Data Transfer Size:      131072 bytes
Controller ID:               0x0000
Version:                     1.1.0

Admin Command Set Attributes
============================
Security Send/Receive:       Not Supported
Format NVM:                  Supported
Firmware Activate/Download:  Supported
Namespace Management:        Not Supported
Device Self-test:            Supported
Directives:                  Not Supported
NVMe-MI Send/Receive:        Not Supported
Virtualization Management:   Not Supported
Doorbell Buffer Config:      Not Supported
Get LBA Status:              Not Supported
Sanitize:                    crypto, block,
Abort Command Limit:         4
Async Event Request Limit:   4
Number of Firmware Slots:    1
Firmware Slot 1 Read-Only:   No
Per-Namespace SMART Log:     Yes
Error Log Page Entries:      64
Number of Power States:      3
Firmware Update Granularity: 00 (Not Reported)
Host Buffer Preferred Size:  0 bytes
Host Buffer Minimum Size:    0 bytes

NVM Command Set Attributes
==========================
Submission Queue Entry Size
  Max:                       64
  Min:                       64
Completion Queue Entry Size
  Max:                       16
  Min:                       16
Number of Namespaces:        1
Compare Command:             Not Supported
Write Uncorrectable Command: Supported
Dataset Management Command:  Supported
Write Zeroes Command:        Not Supported
Save Features:               Supported
Reservations:                Not Supported
Timestamp feature:           Supported
Verify feature:              Not Supported
Fused Operation Support:     Not Supported
Format NVM Attributes:       Crypto Erase, All-NVM Erase, All-NVM Format
Volatile Write Cache:        Not Present


sector size 512B

Code:
root@truenas ~ # nvmecontrol perftest -n 32 -o read -s 512 -t 30 nvme0ns1                                                                              

Threads: 32 Size:    512  READ Time:  30 IO/s: 1264992 MB/s:  617



Code:
root@truenas ~ # nvmecontrol perftest -n 32 -o read -s 4096 -t 30 nvme0ns1

Threads: 32 Size:   4096  READ Time:  30 IO/s:  364949 MB/s: 1425



Code:
 root@truenas ~ # diskinfo -wS /dev/nvd0
                                
/dev/nvd0
        512             # sectorsize
        118410444800    # mediasize in bytes (110G)
        231270400       # mediasize in sectors
        0               # stripesize
        0               # stripeoffset
        INTEL SSDPEK1A118GA     # Disk descr.
        BTOC12530FJD118B        # Disk ident.
        Yes             # TRIM/UNMAP support
        0               # Rotation rate in RPM

Synchronous random writes:
         0.5 kbytes:     20.2 usec/IO =     24.1 Mbytes/s
           1 kbytes:     21.1 usec/IO =     46.2 Mbytes/s
           2 kbytes:     25.3 usec/IO =     77.1 Mbytes/s
           4 kbytes:     23.4 usec/IO =    167.1 Mbytes/s
           8 kbytes:     32.7 usec/IO =    239.2 Mbytes/s
          16 kbytes:     46.5 usec/IO =    335.7 Mbytes/s
          32 kbytes:     75.1 usec/IO =    416.2 Mbytes/s
          64 kbytes:    125.9 usec/IO =    496.2 Mbytes/s
         128 kbytes:    222.0 usec/IO =    563.2 Mbytes/s
         256 kbytes:    396.2 usec/IO =    631.0 Mbytes/s
         512 kbytes:    741.1 usec/IO =    674.7 Mbytes/s
        1024 kbytes:   1562.4 usec/IO =    640.0 Mbytes/s
        2048 kbytes:   3053.9 usec/IO =    654.9 Mbytes/s
        4096 kbytes:   5792.6 usec/IO =    690.5 Mbytes/s
        8192 kbytes:  11428.0 usec/IO =    700.0 Mbytes/s


sector size 4096B

Code:
smartctl -a /dev/nvme0                                                                                                                

smartctl 7.2 2020-12-30 r5155 [FreeBSD 12.2-RELEASE-p14 amd64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Number:                       INTEL SSDPEK1A118GA
Serial Number:                      BTOC12530FJD118B
Firmware Version:                   U5110550
PCI Vendor/Subsystem ID:            0x8086
IEEE OUI Identifier:                0x5cd2e4
Controller ID:                      0
NVMe Version:                       1.1
Number of Namespaces:               1
Namespace 1 Size/Capacity:          118,410,444,800 [118 GB]
Namespace 1 Formatted LBA Size:     4096
Namespace 1 IEEE EUI-64:            5cd2e4 b2ea7d0100
Local Time is:                      Wed May 11 22:57:56 2022 CEST
Firmware Updates (0x02):            1 Slot
Optional Admin Commands (0x0016):   Format Frmw_DL Self_Test
Optional NVM Commands (0x0056):     Wr_Unc DS_Mngmt Sav/Sel_Feat Timestmp
Log Page Attributes (0x03):         S/H_per_NS Cmd_Eff_Lg
Maximum Data Transfer Size:         32 Pages
Warning  Comp. Temp. Threshold:     70 Celsius
Critical Comp. Temp. Threshold:     78 Celsius

Supported Power States
St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat
 0 +     5.50W       -        -    0  0  0  0     1000    4000
 1 +     4.60W       -        -    0  1  0  1     1000    4000
 2 +     3.30W       -        -    0  2  0  2     1000    4000

Supported LBA Sizes (NSID 0x1)
Id Fmt  Data  Metadt  Rel_Perf
 0 -     512       0         2
 1 +    4096       0         0

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02)
Critical Warning:                   0x00
Temperature:                        45 Celsius
Available Spare:                    100%
Available Spare Threshold:          0%
Percentage Used:                    0%
Data Units Read:                    159,206 [81.5 GB]
Data Units Written:                 52,388 [26.8 GB]
Host Read Commands:                 82,562,818
Host Write Commands:                889,765
Controller Busy Time:               2
Power Cycles:                       5
Power On Hours:                     1
Unsafe Shutdowns:                   0
Media and Data Integrity Errors:    0
Error Information Log Entries:      0
Warning  Comp. Temperature Time:    0
Critical Comp. Temperature Time:    0

Error Information (NVMe Log 0x01, 16 of 64 entries)
No Errors Logged


Code:
nvmecontrol perftest -n 32 -o read -s 4096 -t 30 nvme0ns1 
                                                                        
Threads: 32 Size:   4096  READ Time:  30 IO/s:  367387 MB/s: 1435


Code:
root@truenas ~ # diskinfo -wS /dev/nvd0                                                                                                                

/dev/nvd0
        4096            # sectorsize
        118410444800    # mediasize in bytes (110G)
        28908800        # mediasize in sectors
        0               # stripesize
        0               # stripeoffset
        INTEL SSDPEK1A118GA     # Disk descr.
        BTOC12530FJD118B        # Disk ident.
        Yes             # TRIM/UNMAP support
        0               # Rotation rate in RPM

Synchronous random writes:
           4 kbytes:     31.4 usec/IO =    124.5 Mbytes/s
           8 kbytes:     37.3 usec/IO =    209.5 Mbytes/s
          16 kbytes:     38.6 usec/IO =    404.5 Mbytes/s
          32 kbytes:     61.3 usec/IO =    509.9 Mbytes/s
          64 kbytes:     98.5 usec/IO =    634.5 Mbytes/s
         128 kbytes:    165.9 usec/IO =    753.4 Mbytes/s
         256 kbytes:    294.6 usec/IO =    848.5 Mbytes/s
         512 kbytes:    524.0 usec/IO =    954.2 Mbytes/s
        1024 kbytes:   1033.5 usec/IO =    967.6 Mbytes/s
        2048 kbytes:   2029.0 usec/IO =    985.7 Mbytes/s
        4096 kbytes:   4041.7 usec/IO =    989.7 Mbytes/s
        8192 kbytes:   7902.4 usec/IO =   1012.3 Mbytes/s


For about 250,- EUR and with 1292 TBW / 6 DWPD endurance rating it's a decent "home lab" slog IMHO.
 
Last edited:

Andrew32

Cadet
Joined
Oct 19, 2021
Messages
7
@jtoddowen @mjt5282
I think the "reset switch" was never installed on the cards. It looks like there is space on the board and it would have stuck out of the back bracket above LED1. Mine also came with SW1-7 off, SW8 on. Seems to be the default. I don't know the blink codes.... As these were mostly OEM cards for NetApp there's no user support.
 

ggiinnoo

Dabbler
Joined
Sep 25, 2022
Messages
24
Intel optane 900P 480GB:

Smartctl test:
Code:
smartctl 7.2 2021-09-14 r5236 [FreeBSD 13.1-RELEASE-p2 amd64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Number:                       INTEL SSDPED1D480GA
Serial Number:                      PHMB751000N0480DGN
Firmware Version:                   E2010435
PCI Vendor/Subsystem ID:            0x8086
IEEE OUI Identifier:                0x5cd2e4
Controller ID:                      0
NVMe Version:                       <1.2
Number of Namespaces:               1
Namespace 1 Size/Capacity:          480,103,981,056 [480 GB]
Namespace 1 Formatted LBA Size:     512
Local Time is:                      Thu Dec  1 00:01:45 2022 CET
Firmware Updates (0x02):            1 Slot
Optional Admin Commands (0x0007):   Security Format Frmw_DL
Optional NVM Commands (0x0006):     Wr_Unc DS_Mngmt
Log Page Attributes (0x02):         Cmd_Eff_Lg
Maximum Data Transfer Size:         32 Pages

Supported Power States
St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat
 0 +    18.00W       -        -    0  0  0  0        0       0

Supported LBA Sizes (NSID 0x1)
Id Fmt  Data  Metadt  Rel_Perf
 0 +     512       0         2

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02)
Critical Warning:                   0x00
Temperature:                        41 Celsius
Available Spare:                    100%
Available Spare Threshold:          0%
Percentage Used:                    0%
Data Units Read:                    5,947,696 [3.04 TB]
Data Units Written:                 33,512,722 [17.1 TB]
Host Read Commands:                 223,213,231
Host Write Commands:                500,078,378
Controller Busy Time:               178
Power Cycles:                       448
Power On Hours:                     2,471
Unsafe Shutdowns:                   210
Media and Data Integrity Errors:    0
Error Information Log Entries:      0

Error Information (NVMe Log 0x01, 16 of 64 entries)
No Errors Logged


Code:
Test 1:
/dev/nvd1
        512             # sectorsize
        480103981056    # mediasize in bytes (447G)
        937703088       # mediasize in sectors
        0               # stripesize
        0               # stripeoffset
        INTEL SSDPED1D480GA     # Disk descr.
        PHMB751000N0480DGN      # Disk ident.
        nvme1           # Attachment
        Yes             # TRIM/UNMAP support
        0               # Rotation rate in RPM

Synchronous random writes:
         0.5 kbytes:     28.1 usec/IO =     17.4 Mbytes/s
           1 kbytes:     29.5 usec/IO =     33.2 Mbytes/s
           2 kbytes:     28.6 usec/IO =     68.4 Mbytes/s
           4 kbytes:     27.2 usec/IO =    143.7 Mbytes/s
           8 kbytes:     27.5 usec/IO =    283.8 Mbytes/s
          16 kbytes:     17.0 usec/IO =    917.6 Mbytes/s
          32 kbytes:     41.6 usec/IO =    751.4 Mbytes/s
          64 kbytes:     56.1 usec/IO =   1114.9 Mbytes/s
         128 kbytes:     91.0 usec/IO =   1373.0 Mbytes/s
         256 kbytes:    167.1 usec/IO =   1495.9 Mbytes/s
         512 kbytes:    270.4 usec/IO =   1849.2 Mbytes/s
        1024 kbytes:    474.1 usec/IO =   2109.2 Mbytes/s
        2048 kbytes:    899.6 usec/IO =   2223.1 Mbytes/s
        4096 kbytes:   1743.7 usec/IO =   2294.0 Mbytes/s
        8192 kbytes:   3419.7 usec/IO =   2339.4 Mbytes/s

Test 2:
/dev/nvd1
        512             # sectorsize
        480103981056    # mediasize in bytes (447G)
        937703088       # mediasize in sectors
        0               # stripesize
        0               # stripeoffset
        INTEL SSDPED1D480GA     # Disk descr.
        PHMB751000N0480DGN      # Disk ident.
        nvme1           # Attachment
        Yes             # TRIM/UNMAP support
        0               # Rotation rate in RPM

Synchronous random writes:
         0.5 kbytes:     28.1 usec/IO =     17.4 Mbytes/s
           1 kbytes:     28.1 usec/IO =     34.7 Mbytes/s
           2 kbytes:     28.4 usec/IO =     68.7 Mbytes/s
           4 kbytes:     25.8 usec/IO =    151.6 Mbytes/s
           8 kbytes:     27.7 usec/IO =    281.7 Mbytes/s
          16 kbytes:     17.0 usec/IO =    916.7 Mbytes/s
          32 kbytes:     39.2 usec/IO =    797.9 Mbytes/s
          64 kbytes:     55.3 usec/IO =   1130.9 Mbytes/s
         128 kbytes:    110.2 usec/IO =   1134.0 Mbytes/s
         256 kbytes:    171.7 usec/IO =   1456.0 Mbytes/s
         512 kbytes:    272.3 usec/IO =   1836.5 Mbytes/s
        1024 kbytes:    476.1 usec/IO =   2100.5 Mbytes/s
        2048 kbytes:    893.5 usec/IO =   2238.4 Mbytes/s
        4096 kbytes:   1738.1 usec/IO =   2301.3 Mbytes/s
        8192 kbytes:   3417.4 usec/IO =   2341.0 Mbytes/s

Test 3:
/dev/nvd1
        512             # sectorsize
        480103981056    # mediasize in bytes (447G)
        937703088       # mediasize in sectors
        0               # stripesize
        0               # stripeoffset
        INTEL SSDPED1D480GA     # Disk descr.
        PHMB751000N0480DGN      # Disk ident.
        nvme1           # Attachment
        Yes             # TRIM/UNMAP support
        0               # Rotation rate in RPM

Synchronous random writes:
         0.5 kbytes:     27.0 usec/IO =     18.1 Mbytes/s
           1 kbytes:     28.0 usec/IO =     34.9 Mbytes/s
           2 kbytes:     28.4 usec/IO =     68.8 Mbytes/s
           4 kbytes:     25.7 usec/IO =    152.2 Mbytes/s
           8 kbytes:     27.4 usec/IO =    284.7 Mbytes/s
          16 kbytes:     32.6 usec/IO =    479.2 Mbytes/s
          32 kbytes:     23.8 usec/IO =   1314.3 Mbytes/s
          64 kbytes:     55.4 usec/IO =   1127.6 Mbytes/s
         128 kbytes:    111.3 usec/IO =   1123.5 Mbytes/s
         256 kbytes:    167.6 usec/IO =   1491.9 Mbytes/s
         512 kbytes:    268.8 usec/IO =   1860.4 Mbytes/s
        1024 kbytes:    476.0 usec/IO =   2101.0 Mbytes/s
        2048 kbytes:    896.6 usec/IO =   2230.6 Mbytes/s
        4096 kbytes:   1720.2 usec/IO =   2325.3 Mbytes/s
        8192 kbytes:   3419.5 usec/IO =   2339.5 Mbytes/s

 
Top