OpenBench Testing Framework

Finished
JustJeJustBotunsafe-maxxing-2diff4.0+0.04LLR: -0.19 (-2.94, 2.94) [0.00, 3.00]
Games: 30394 W: 8635 L: 8575 D: 13184
Ptnml(0-2): 300, 3362, 7812, 3424, 299
JustJeJustBotdon't-update-corrhistory-in-excluded-searchdiff40.0+0.40LLR: 0.90 (-2.94, 2.94) [0.00, 3.00]
Games: 56940 W: 14775 L: 14600 D: 27565
Ptnml(0-2): 86, 6676, 14766, 6861, 81
LTC
JustJeJustBotscore-trend-tmdiff40.0+0.40LLR: -0.20 (-2.94, 2.94) [0.00, 3.00]
Games: 4896 W: 1246 L: 1247 D: 2403
Ptnml(0-2): 7, 567, 1298, 572, 4
LTC
JustJeJustBotscore-trend-tmdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 16092 W: 4299 L: 4089 D: 7704
Ptnml(0-2): 59, 1750, 4211, 1974, 52
JustJeJustBotmasterdiff8.0+0.08Elo: 36.85 +- 5.97 (95%) [N=3000]
Games: 3076 W: 599 L: 274 D: 2203
Ptnml(0-2): 10, 163, 889, 444, 32
Added Support for EVALFILE (#140)
JustJeJustBotmasterdiff8.0+0.08LLR: 1.12 (-2.94, 2.94) [0.00, 3.00]
Games: 512 W: 191 L: 110 D: 211
Ptnml(0-2): 2, 33, 109, 106, 6
Added Support for EVALFILE (#140)
JustJeJustBotlmr-fixed-formuladiff40.0+0.40LLR: -1.40 (-2.94, 2.94) [0.00, 3.00]
Games: 6718 W: 1698 L: 1764 D: 3256
Ptnml(0-2): 9, 829, 1746, 769, 6
LTC
JustJeJustBot540-v1-1024HLdiff8.0+0.08Elo: -3.06 +- 4.99 (95%) [N=3000]
Games: 3064 W: 313 L: 340 D: 2411
Ptnml(0-2): 6, 241, 1065, 214, 6
testing out if net uploads work
JustJeJustBotlmr-fixed-formuladiff8.0+0.08LLR: 3.04 (-2.94, 2.94) [-10.00, 0.00]
Games: 9442 W: 2534 L: 2550 D: 4358
Ptnml(0-2): 71, 1057, 2477, 1049, 67
Regression Test Just Re-Using the old formula
JustJeJustBotlmr-spsadiff20.0+0.20Tuning 9 Parameters
1531/10000 Iterations
12252/80000 Games Played
JustJeJustBotlmr-fixed-formuladiff40.0+0.40LLR: -1.03 (-2.94, 2.94) [0.00, 3.00]
Games: 5812 W: 1476 L: 1524 D: 2812
Ptnml(0-2): 24, 692, 1514, 660, 16
LTC
JustJeJustBotlmr-fixed-formuladiff8.0+0.08LLR: 2.99 (-2.94, 2.94) [0.00, 3.00]
Games: 23944 W: 6667 L: 6420 D: 10857
Ptnml(0-2): 177, 2740, 5935, 2899, 221
JustJeJustBotthreadpooldiff8.0+0.08LLR: 3.42 (-2.94, 2.94) [-10.00, 0.00]
Games: 642 W: 224 L: 157 D: 261
Ptnml(0-2): 4, 53, 164, 72, 28
1T Regression Test
JustJeJustBotthreadpooldiff8.0+0.08LLR: 3.05 (-2.94, 2.94) [-5.00, 0.00]
Games: 9518 W: 2406 L: 2334 D: 4778
Ptnml(0-2): 19, 1076, 2505, 1132, 27
VSTC 8T Regression Test
JustJeJustBotthreadpooldiff8.0+0.08LLR: -0.04 (-2.94, 2.94) [0.00, 3.00]
Games: 692 W: 159 L: 160 D: 373
Ptnml(0-2): 0, 90, 168, 87, 1
SMP Test
JustJeJustBotlmr-fixed-formuladiff8.0+0.08LLR: -2.98 (-2.94, 2.94) [0.00, 3.00]
Games: 11776 W: 3044 L: 3202 D: 5530
Ptnml(0-2): 74, 1495, 2894, 1365, 60
JustJeJustBotlmr-fixed-formuladiff8.0+0.08LLR: -0.23 (-2.94, 2.94) [0.00, 3.00]
Games: 8448 W: 2239 L: 2234 D: 3975
Ptnml(0-2): 39, 1014, 2105, 1035, 31
JustJeJustBotlmr-spsadiff20.0+0.20Tuning 9 Parameters
2956/10000 Iterations
11826/40000 Games Played
JustJeJustBotdo-deeperdiff8.0+0.08LLR: -2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 53778 W: 14664 L: 14724 D: 24390
Ptnml(0-2): 429, 6470, 13111, 6490, 389
try 2
JustJeJustBotdo-deeperdiff8.0+0.08LLR: -3.06 (-2.94, 2.94) [0.00, 3.00]
Games: 10610 W: 2717 L: 2880 D: 5013
Ptnml(0-2): 60, 1330, 2676, 1191, 48
JustJeJustBotlmr-fixed-formuladiff8.0+0.08LLR: -2.99 (-2.94, 2.94) [0.00, 3.00]
Games: 21794 W: 5667 L: 5800 D: 10327
Ptnml(0-2): 111, 2645, 5522, 2504, 115
try 4
JustJeJustBotlmr-fixed-formuladiff8.0+0.08LLR: -2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 7796 W: 2026 L: 2192 D: 3578
Ptnml(0-2): 63, 975, 1972, 841, 47
experiment
JustJeJustBotlmr-fixed-formuladiff8.0+0.08LLR: -2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 26982 W: 7343 L: 7467 D: 12172
Ptnml(0-2): 212, 3251, 6691, 3123, 214
try 3
JustJeJustBotlmr-fixed-formuladiff8.0+0.08LLR: -1.41 (-2.94, 2.94) [0.00, 3.00]
Games: 11746 W: 3161 L: 3221 D: 5364
Ptnml(0-2): 73, 1413, 2969, 1337, 81
trying something a bit closer to the current formula but with noisy lmr lower than before and quiet slightly higher
JustJeJustBotmasterdiff60.0+0.60Elo: -14.20 +- 9.29 (95%) [N=1000]
Games: 1004 W: 88 L: 129 D: 787
Ptnml(0-2): 7, 91, 343, 58, 3
JustBot-dev vs Icarus 1.1.1