Hi There
I'm hoping someone could chime in on performance/observations of a FreeNAS box I performed load testing on this morning. the code outputs are a bit long and are not time synced. So I'm going to break this into multiple posts.
I'm not sure how to interpret these results.
arcstat show a 15-30% miss rate
gstat bounce around 10% ish
zpool iostat show peaks and valleys.
Processor Intel(R) Core(TM) i3-3240 CPU @ 3.40GHz, 3400 Mhz, 2 Core(s), 4 Logical Processor(s)
Installed Physical Memory (RAM) 32.01 GB
Drives 45 x 4TB WD RED SATA drives
Arcstat.py
zpool iostat
gstat
I'm hoping someone could chime in on performance/observations of a FreeNAS box I performed load testing on this morning. the code outputs are a bit long and are not time synced. So I'm going to break this into multiple posts.
I'm not sure how to interpret these results.
arcstat show a 15-30% miss rate
gstat bounce around 10% ish
zpool iostat show peaks and valleys.
Processor Intel(R) Core(TM) i3-3240 CPU @ 3.40GHz, 3400 Mhz, 2 Core(s), 4 Logical Processor(s)
Installed Physical Memory (RAM) 32.01 GB
Drives 45 x 4TB WD RED SATA drives
Arcstat.py
Code:
time read miss miss% dmis dm% pmis pm% mmis mm% arcsz c 08:36:30 236 64 27 64 27 0 0 52 24 18G 18G 08:36:32 260 55 21 55 21 0 0 46 20 18G 18G 08:36:33 243 53 21 53 21 0 0 43 19 18G 18G 08:36:34 310 68 21 68 21 0 0 48 18 18G 18G 08:36:35 235 63 26 63 26 0 0 53 25 18G 18G 08:36:36 222 61 27 61 27 0 0 41 22 18G 18G 08:36:38 251 66 26 66 26 0 0 54 24 18G 18G 08:36:39 208 51 24 51 24 0 0 41 22 18G 18G 08:36:40 280 57 20 57 20 0 0 47 18 18G 18G 08:36:41 249 71 28 71 28 0 0 51 25 18G 18G 08:36:42 259 64 24 64 24 0 0 54 22 18G 18G 08:36:43 239 63 26 63 26 0 0 45 20 18G 18G 08:36:45 271 67 24 67 24 0 0 45 20 18G 18G 08:36:46 280 63 22 63 22 0 0 44 18 18G 18G 08:36:47 939 64 6 64 6 0 0 49 26 18G 18G 08:36:48 1.2K 528 42 81 10 447 100 64 16 18G 18G 08:36:49 1.9K 725 38 39 3 686 100 45 8 18G 18G 08:36:51 1.5K 519 35 57 5 462 100 37 8 18G 18G 08:36:52 3.9K 195 5 195 5 0 0 195 5 18G 18G 08:36:53 243 33 13 33 13 0 0 33 15 18G 18G 08:36:54 303 35 11 35 11 0 0 35 13 18G 18G time read miss miss% dmis dm% pmis pm% mmis mm% arcsz c 08:36:55 266 33 12 33 12 0 0 33 13 18G 18G 08:36:57 407 38 9 38 9 0 0 32 15 18G 18G 08:36:58 301 33 10 33 10 0 0 32 11 18G 18G 08:36:59 241 33 13 33 13 0 0 33 15 18G 18G 08:37:00 248 28 11 28 11 0 0 28 12 18G 18G 08:37:01 258 33 12 33 12 0 0 33 14 18G 18G 08:37:03 268 35 13 35 13 0 0 35 15 18G 18G 08:37:04 281 39 13 39 13 0 0 39 15 18G 18G 08:37:05 352 63 17 63 17 0 0 49 20 18G 18G 08:37:06 266 43 16 43 16 0 0 43 17 18G 18G 08:37:07 257 26 10 26 10 0 0 26 12 18G 18G 08:37:09 219 33 15 33 15 0 0 33 17 18G 18G 08:37:10 233 27 11 27 11 0 0 27 12 18G 18G 08:37:11 269 32 11 32 11 0 0 32 13 18G 18G 08:37:12 275 41 14 41 14 0 0 41 17 18G 18G 08:37:13 238 32 13 32 13 0 0 32 14 18G 18G 08:37:15 219 27 12 27 12 0 0 27 14 18G 18G 08:37:16 250 31 12 31 12 0 0 31 14 18G 18G 08:37:17 260 27 10 27 10 0 0 27 11 18G 18G 08:37:18 257 33 12 33 12 0 0 33 15 18G 18G 08:37:19 246 26 10 26 10 0 0 26 11 18G 18G time read miss miss% dmis dm% pmis pm% mmis mm% arcsz c 08:37:20 269 40 14 40 14 0 0 40 16 18G 18G 08:37:22 198 25 12 25 12 0 0 25 14 18G 18G 08:37:23 310 37 11 37 11 0 0 34 13 18G 18G 08:37:24 252 33 13 33 13 0 0 31 13 18G 18G 08:37:25 285 40 14 40 14 0 0 40 16 18G 18G 08:37:26 413 38 9 38 9 0 0 38 16 18G 18G 08:37:28 294 40 13 40 13 0 0 40 16 18G 18G 08:37:29 239 30 12 30 12 0 0 30 14 18G 18G 08:37:30 271 27 9 27 9 0 0 27 11 18G 18G 08:37:31 221 32 14 32 14 0 0 32 16 18G 18G 08:37:32 214 25 11 25 11 0 0 25 13 18G 18G 08:37:34 262 31 11 31 11 0 0 31 14 18G 18G 08:37:35 273 33 12 33 12 0 0 33 13 18G 18G 08:37:36 257 27 10 27 10 0 0 27 12 18G 18G 08:37:37 254 35 13 35 13 0 0 35 15 18G 18G 08:37:38 306 36 11 36 11 0 0 36 14 18G 18G 08:37:39 258 40 15 40 15 0 0 40 17 18G 18G 08:37:41 241 30 12 30 12 0 0 30 13 18G 18G 08:37:42 241 30 12 30 12 0 0 30 13 18G 18G 08:37:43 277 33 11 33 11 0 0 33 13 18G 18G 08:37:44 293 48 16 48 16 0 0 46 18 18G 18G time read miss miss% dmis dm% pmis pm% mmis mm% arcsz c 08:37:45 257 27 10 27 10 0 0 26 12 18G 18G 08:37:46 240 39 16 39 16 0 0 37 17 18G 18G 08:37:48 270 30 11 30 11 0 0 29 12 18G 18G 08:37:49 261 27 10 27 10 0 0 26 12 18G 18G 08:37:50 255 40 15 40 15 0 0 39 17 18G 18G 08:37:51 226 30 13 30 13 0 0 28 14 18G 18G 08:37:52 963 43 4 43 4 0 0 31 12 18G 18G 08:37:54 248 47 18 47 18 0 0 27 13 18G 18G 08:37:55 262 45 17 45 17 0 0 35 14 18G 18G 08:37:56 279 47 16 47 16 0 0 32 14 18G 18G 08:37:57 442 77 17 77 17 0 0 60 22 18G 18G 08:37:58 235 59 25 59 25 0 0 49 23 18G 18G 08:37:59 237 69 29 69 29 0 0 47 24 18G 18G 08:38:01 243 59 24 59 24 0 0 49 22 18G 18G 08:38:02 271 58 21 58 21 0 0 48 19 18G 18G 08:38:03 242 66 27 66 27 0 0 56 25 18G 18G 08:38:04 267 64 23 64 23 0 0 45 20 18G 18G 08:38:05 248 65 26 65 26 0 0 55 24 18G 18G 08:38:07 242 64 26 64 26 0 0 44 22 18G 18G 08:38:08 349 103 29 103 29 0 0 78 31 18G 18G 08:38:09 300 71 23 71 23 0 0 51 20 18G 18G time read miss miss% dmis dm% pmis pm% mmis mm% arcsz c 08:38:10 245 55 22 55 22 0 0 45 20 18G 18G 08:38:11 212 56 26 56 26 0 0 46 24 18G 18G 08:38:12 245 52 21 52 21 0 0 42 18 18G 18G 08:38:14 236 53 22 53 22 0 0 43 20 18G 18G 08:38:15 276 70 25 70 25 0 0 49 21 18G 18G 08:38:16 266 71 26 71 26 0 0 51 22 18G 18G 08:38:17 242 68 28 68 28 0 0 57 27 18G 18G 08:38:18 222 51 22 51 22 0 0 41 20 18G 18G 08:38:20 183 45 24 45 24 0 0 34 24 18G 18G 08:38:21 279 71 25 71 25 0 0 60 24 18G 18G 08:38:22 233 54 23 54 23 0 0 44 20 18G 18G 08:38:23 321 90 28 90 28 0 0 75 26 18G 18G 08:38:24 251 60 23 60 23 0 0 48 21 18G 18G 08:38:26 266 64 24 64 24 0 0 45 20 18G 18G 08:38:27 437 68 15 68 15 0 0 51 21 18G 18G 08:38:28 301 74 24 74 24 0 0 63 23 18G 18G 08:38:29 262 64 24 64 24 0 0 53 22 18G 18G
zpool iostat
Code:
capacity operations bandwidth pool alloc free read write read write ---------- ----- ----- ----- ----- ----- ----- Production 36.9T 126T 16 4.72K 67.7K 405M Production 36.9T 126T 13 4.30K 55.7K 354M Production 36.9T 126T 10 4.81K 43.8K 397M Production 36.9T 126T 8 4.55K 35.8K 386M Production 36.9T 126T 16 4.36K 67.7K 340M Production 36.9T 126T 10 4.55K 43.3K 379M Production 36.9T 126T 27 4.87K 110K 415M Production 36.9T 126T 12 4.31K 51.8K 371M Production 36.9T 126T 9 4.31K 39.5K 346M Production 36.9T 126T 7 4.05K 31.9K 387M Production 36.9T 126T 16 4.80K 67.5K 397M Production 36.9T 126T 12 4.54K 51.2K 375M Production 36.9T 126T 14 4.95K 59.7K 401M Production 36.9T 126T 10 4.30K 43.9K 367M Production 36.9T 126T 10 4.38K 43.3K 360M Production 36.9T 126T 12 4.73K 50.4K 394M Production 36.9T 126T 10 4.54K 43.2K 368M Production 36.9T 126T 10 4.75K 43.6K 368M Production 36.9T 126T 8 4.47K 35.9K 387M Production 37.0T 126T 10 4.37K 43.9K 389M Production 37.0T 126T 14 4.58K 59.8K 397M Production 37.0T 126T 12 4.59K 51.9K 387M Production 37.0T 126T 10 4.30K 43.9K 356M Production 37.0T 126T 10 4.34K 43.6K 357M Production 37.0T 126T 12 4.67K 51.5K 389M Production 37.0T 126T 10 4.80K 43.8K 389M Production 37.0T 126T 10 4.71K 43.7K 388M Production 37.0T 126T 6 4.40K 27.9K 372M Production 37.0T 126T 12 4.45K 51.6K 358M Production 37.0T 126T 8 4.55K 35.5K 387M Production 37.0T 126T 15 4.00K 71.9K 365M Production 37.0T 126T 404 4.49K 48.2M 380M Production 37.0T 126T 561 3.95K 69.5M 365M Production 37.0T 126T 600 4.37K 74.8M 361M Production 37.0T 126T 82 4.36K 6.06M 348M Production 37.0T 126T 11 4.76K 47.9K 398M Production 37.0T 126T 0 4.53K 0 387M Production 37.0T 126T 0 4.81K 0 374M Production 37.0T 126T 0 4.76K 0 391M Production 37.0T 126T 0 4.62K 0 353M Production 37.0T 126T 0 4.74K 3.99K 377M Production 37.0T 126T 0 4.77K 0 416M Production 37.0T 126T 0 4.30K 0 354M Production 37.0T 126T 0 4.72K 0 387M Production 37.0T 126T 0 4.61K 0 363M Production 37.0T 126T 0 4.69K 0 383M Production 37.0T 126T 0 4.60K 0 382M Production 37.0T 126T 0 4.63K 0 388M Production 37.0T 126T 13 4.37K 192K 376M Production 37.0T 126T 0 4.90K 0 397M Production 37.0T 126T 0 4.50K 0 377M Production 37.0T 126T 0 4.22K 0 352M Production 37.0T 126T 0 4.84K 0 405M Production 37.0T 126T 0 4.66K 0 397M
gstat
Code:
T: 1.002s w: 1.000s L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name 1 309 0 0 0.0 299 11824 1.0 20.7| da0 1 318 0 0 0.0 308 11888 1.0 21.5| da1 1 314 0 0 0.0 304 11860 1.0 21.2| da2 1 359 0 0 0.0 349 12008 0.9 20.7| da3 1 367 0 0 0.0 357 12020 0.9 21.5| da4 1 370 0 0 0.0 360 12012 0.9 21.9| da5 1 363 0 0 0.0 353 11988 0.9 21.6| da6 1 360 0 0 0.0 350 11976 0.9 21.3| da7 1 385 2 8 0.1 375 12403 1.0 25.9| da8 1 388 0 0 0.0 380 12479 1.0 25.6| da9 2 391 0 0 0.0 383 12479 1.0 25.7| da10 1 390 0 0 0.0 382 12463 1.0 25.5| da11 1 384 0 0 0.0 376 12407 0.9 23.3| da12 1 411 0 0 0.0 404 13361 0.9 25.7| da13 1 411 0 0 0.0 404 13329 0.9 25.7| da14 1 408 0 0 0.0 401 13297 0.9 25.5| da15 2 404 0 0 0.0 397 13269 0.8 23.2| da16 1 401 0 0 0.0 394 13357 0.8 24.5| da17 2 357 1 4 0.1 350 13409 1.0 25.3| da18 2 354 0 0 0.0 348 13517 1.0 24.2| da19 2 349 0 0 0.0 343 13417 0.9 22.6| da20 2 347 0 0 0.0 341 13457 0.9 22.6| da21 2 354 0 0 0.0 348 13537 1.0 22.7| da22 2 307 0 0 0.0 301 13377 1.1 21.4| da23 2 308 2 8 0.1 300 13481 1.2 23.8| da24 2 309 2 8 0.7 301 13393 1.2 23.5| da25 1 313 0 0 0.0 307 13517 1.1 23.7| da26 2 305 0 0 0.0 299 13389 1.2 23.6| da27 2 286 0 0 0.0 279 13317 1.3 26.0| da28 2 288 1 4 0.1 280 13221 1.4 26.1| da29 2 288 0 0 0.0 281 13297 1.4 26.5| da30 1 284 0 0 0.0 277 13066 1.4 25.7| da31 2 285 0 0 0.0 278 13265 1.2 23.0| da32 1 300 0 0 0.0 292 13213 1.2 22.5| da33 2 298 0 0 0.0 290 13150 1.2 23.3| da34 2 297 0 0 0.0 289 13166 1.2 23.5| da35 1 304 0 0 0.0 296 13229 1.1 22.1| da36 1 303 0 0 0.0 295 13229 1.1 21.7| da37 2 324 0 0 0.0 314 12571 1.1 22.5| da38 2 332 0 0 0.0 322 12555 1.0 22.1| da39 2 333 0 0 0.0 323 12567 1.2 25.1| da40 2 327 1 4 1.4 316 12563 1.2 25.2| da41 2 323 0 0 0.0 313 12527 1.1 22.7| da42 1 311 0 0 0.0 301 11864 1.0 21.5| da43 1 309 1 4 1.6 298 11848 0.7 14.7| da44 0 0 0 0 0.0 0 0 0.0 0.0| da45 0 6 6 13 4.1 0 0 0.0 2.5| ada0 0 9 9 44 0.1 0 0 0.0 0.1| ada1
Last edited: