OpenBench Testing Framework

Finished
JustJeJustBotDatagen-13diffN=5000Generated 5000600/5000000 Games
Elo: 0.13 +- 0.25 (95%) [N=5000000]
Games: 5000600 W: 1716147 L: 1714264 D: 1570189
JustJeJustBotthread-votingdiff8.0+0.08LLR: 3.13 (-2.25, 2.89) [-5.00, 0.00]
Games: 22992 W: 6634 L: 6605 D: 9753
Ptnml(0-2): 267, 2515, 5914, 2522, 278
Regression Test
JustJeJustBotthread-votingdiff8.0+0.08LLR: 2.90 (-2.25, 2.89) [0.00, 3.00]
Games: 5630 W: 1588 L: 1392 D: 2650
Ptnml(0-2): 32, 594, 1382, 760, 47
JustJeJustBotlmr-not-pvdiff8.0+0.08LLR: 2.90 (-2.25, 2.89) [0.00, 3.00]
Games: 7268 W: 2194 L: 1989 D: 3085
Ptnml(0-2): 43, 808, 1785, 897, 101
JustJeJustBotlmp-improving-2diff8.0+0.08LLR: 2.94 (-2.25, 2.89) [0.00, 3.00]
Games: 16594 W: 5006 L: 4765 D: 6823
Ptnml(0-2): 210, 1833, 4012, 1990, 252
try 4
JustJeJustBotUpdate-Quiet-History-on-TT-Cutoffdiff8.0+0.08LLR: 2.90 (-2.25, 2.89) [0.00, 3.00]
Games: 82610 W: 23078 L: 22700 D: 36832
Ptnml(0-2): 617, 9599, 20559, 9849, 681
JustJeJustBot553-v3-1024HLdiff40.0+0.40LLR: 2.94 (-2.25, 2.89) [0.00, 3.00]
Games: 7290 W: 2077 L: 1883 D: 3330
Ptnml(0-2): 19, 806, 1814, 974, 32
LTC
JustJeJustBot553-v3-1024HLdiff8.0+0.08LLR: 2.95 (-2.25, 2.89) [0.00, 3.00]
Games: 7210 W: 2185 L: 1975 D: 3050
Ptnml(0-2): 71, 747, 1764, 947, 76
STC
JustJeJustBot553-v3-1024HLdiffN=40000LLR: 2.97 (-2.25, 2.89) [0.00, 3.00]
Games: 36038 W: 11983 L: 11662 D: 12393
Ptnml(0-2): 859, 3803, 8399, 4074, 884
Start LMR at Earlier Depth (#148)
JustJeJustBotearlier-depth-lmrdiff8.0+0.08LLR: 2.94 (-2.25, 2.89) [0.00, 3.00]
Games: 57320 W: 15479 L: 15156 D: 26685
Ptnml(0-2): 428, 6756, 13982, 7053, 441
JustJeJustBotNMP-Verifydiff8.0+0.08LLR: 3.04 (-2.25, 2.89) [-5.00, 0.00]
Games: 6296 W: 1808 L: 1712 D: 2776
Ptnml(0-2): 65, 713, 1531, 739, 100
JustJeJustBotadd-tt-entry-after-stand-patdiff8.0+0.08LLR: 2.94 (-2.25, 2.89) [0.00, 3.00]
Games: 13692 W: 4010 L: 3777 D: 5905
Ptnml(0-2): 169, 1515, 3261, 1716, 185
JustJeJustBotPrior-Countermovediff8.0+0.08LLR: 2.91 (-2.25, 2.89) [0.00, 3.00]
Games: 19738 W: 5268 L: 5044 D: 9426
Ptnml(0-2): 102, 2255, 4926, 2489, 97
JustJeJustBotDatagen-13diffN=5000Generated 5000012/5000000 Games
Elo: -0.05 +- 0.25 (95%) [N=5000000]
Games: 5000012 W: 1720373 L: 1721049 D: 1558590
JustJeJustBotHindsight-Extension-2diff8.0+0.08LLR: 2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 20608 W: 5399 L: 5175 D: 10034
Ptnml(0-2): 68, 2380, 5197, 2578, 81
JustJeJustBotunsafe-maxxing-2diff20.0+0.20LLR: 3.01 (-2.94, 2.94) [-5.00, 0.00]
Games: 1542 W: 402 L: 306 D: 834
Ptnml(0-2): 0, 133, 410, 227, 1
JustJeJustBotunsafe-maxxing-2diff4.0+0.04LLR: 3.19 (-2.94, 2.94) [-5.00, 0.00]
Games: 996 W: 298 L: 187 D: 511
Ptnml(0-2): 1, 64, 264, 161, 8
JustJeJustBotscore-trend-tmdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 16092 W: 4299 L: 4089 D: 7704
Ptnml(0-2): 59, 1750, 4211, 1974, 52
JustJeJustBotmasterdiff8.0+0.08Elo: 36.85 +- 5.97 (95%) [N=3000]
Games: 3076 W: 599 L: 274 D: 2203
Ptnml(0-2): 10, 163, 889, 444, 32
Added Support for EVALFILE (#140)
JustJeJustBotlmr-fixed-formuladiff8.0+0.08LLR: 3.04 (-2.94, 2.94) [-10.00, 0.00]
Games: 9442 W: 2534 L: 2550 D: 4358
Ptnml(0-2): 71, 1057, 2477, 1049, 67
Regression Test Just Re-Using the old formula
JustJeJustBotlmr-fixed-formuladiff8.0+0.08LLR: 2.99 (-2.94, 2.94) [0.00, 3.00]
Games: 23944 W: 6667 L: 6420 D: 10857
Ptnml(0-2): 177, 2740, 5935, 2899, 221
JustJeJustBotthreadpooldiff8.0+0.08LLR: 3.42 (-2.94, 2.94) [-10.00, 0.00]
Games: 642 W: 224 L: 157 D: 261
Ptnml(0-2): 4, 53, 164, 72, 28
1T Regression Test
JustJeJustBotthreadpooldiff8.0+0.08LLR: 3.05 (-2.94, 2.94) [-5.00, 0.00]
Games: 9518 W: 2406 L: 2334 D: 4778
Ptnml(0-2): 19, 1076, 2505, 1132, 27
VSTC 8T Regression Test
JustJeJustBot540-v1-1024HLdiff40.0+0.40LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 7450 W: 2132 L: 1941 D: 3377
Ptnml(0-2): 12, 824, 1865, 1009, 15
LTC
JustJeJustBotdon't-update-corrhistory-in-excluded-searchdiff8.0+0.08LLR: 3.03 (-2.94, 2.94) [0.00, 3.00]
Games: 127520 W: 34256 L: 33773 D: 59491
Ptnml(0-2): 760, 14998, 31769, 15465, 768
STC