OpenBench Testing Framework

Finished
JustJeJustBotDatagen-20diffN=12000Generated 378668/25000000 Games
Elo: -0.03 +- 0.96 (95%) [N=25000000]
Games: 378668 W: 143046 L: 143078 D: 92544
w/ Adjudication
JustJeJustBot10-input-bucketsdiff40.0+0.40LLR: 2.90 (-2.25, 2.89) [0.00, 3.00]
Games: 25008 W: 6082 L: 5862 D: 13064
Ptnml(0-2): 30, 2849, 6522, 3077, 26
JustJeJustBot10-input-bucketsdiff8.0+0.08LLR: 2.92 (-2.25, 2.89) [0.00, 3.00]
Games: 59146 W: 14626 L: 14316 D: 30204
Ptnml(0-2): 213, 7030, 14823, 7248, 259
STC
JustJeJustBot10-input-bucketsdiffN=40000LLR: -2.30 (-2.25, 2.89) [0.00, 3.00]
Games: 34008 W: 8923 L: 8992 D: 16093
Ptnml(0-2): 385, 4192, 7883, 4195, 349
JustJeJustBotno-rfp-ttpvdiff40.0+0.40LLR: 2.91 (-2.25, 2.89) [0.00, 3.00]
Games: 17950 W: 4161 L: 3961 D: 9828
Ptnml(0-2): 8, 1965, 4827, 2169, 6
LTC
JustJeJustBot938a8ib-1024mldiff40.0+0.40LLR: 2.90 (-2.25, 2.89) [0.00, 3.00]
Games: 6698 W: 1708 L: 1525 D: 3465
Ptnml(0-2): 8, 722, 1704, 909, 6
LTC
JustJeJustBot938a8ib-1024mldiff8.0+0.08LLR: 2.92 (-2.25, 2.89) [0.00, 3.00]
Games: 4650 W: 1266 L: 1081 D: 2303
Ptnml(0-2): 13, 467, 1189, 634, 22
STC
JustJeJustBot938a8ib-1024mldiffN=40000LLR: 2.93 (-2.25, 2.89) [0.00, 3.00]
Games: 5982 W: 1680 L: 1470 D: 2832
Ptnml(0-2): 61, 623, 1425, 809, 73
JustJeJustBotlerp-standpat-2diff8.0+0.08LLR: 2.89 (-2.25, 2.89) [0.00, 3.00]
Games: 56614 W: 13832 L: 13535 D: 29247
Ptnml(0-2): 137, 6699, 14385, 6902, 184
JustJeJustBotweighted-pcmdiff8.0+0.08LLR: -2.30 (-2.25, 2.89) [0.00, 3.00]
Games: 46418 W: 11170 L: 11204 D: 24044
Ptnml(0-2): 118, 5654, 11707, 5604, 126
try 2
JustJeJustBotno-rfp-ttpvdiff8.0+0.08LLR: -2.26 (-2.25, 2.89) [0.00, 3.00]
Games: 10792 W: 2543 L: 2652 D: 5597
Ptnml(0-2): 23, 1343, 2778, 1224, 28
JustJeJustBotscaled-quiet-malusdiff40.0+0.40LLR: -2.26 (-2.25, 2.89) [0.00, 3.00]
Games: 9726 W: 2133 L: 2239 D: 5354
Ptnml(0-2): 3, 1167, 2630, 1059, 4
LTC
JustJeJustBotrazoring-depth-gaurddiff8.0+0.08LLR: -2.36 (-2.25, 2.89) [0.00, 3.00]
Games: 55652 W: 13331 L: 13346 D: 28975
Ptnml(0-2): 96, 5335, 16979, 5320, 96
JustJeJustBotprobcut-stronger-gaurddiff40.0+0.40LLR: -2.26 (-2.25, 2.89) [0.00, 3.00]
Games: 59224 W: 13683 L: 13686 D: 31855
Ptnml(0-2): 35, 6910, 15724, 6909, 34
JustJeJustBotDatagen-20diffN=12000Generated 25000164/25000000 Games
Elo: 0.02 +- 0.12 (95%) [N=25000000]
Games: 25000164 W: 9309785 L: 9308563 D: 6381816
JustJeJustBotnmp-no-mate-scoresdiff8.0+0.08LLR: -0.52 (-2.25, 2.89) [0.00, 3.00]
Games: 14428 W: 3421 L: 3420 D: 7587
Ptnml(0-2): 24, 1293, 4576, 1300, 21
JustJeJustBotprobcut-stronger-gaurddiff8.0+0.08LLR: -1.59 (-2.25, 2.89) [0.00, 3.00]
Games: 142388 W: 34362 L: 34143 D: 73883
Ptnml(0-2): 352, 16854, 36578, 17043, 367
STC
JustJeJustBotmovepicker-historydiff8.0+0.08LLR: -2.35 (-2.25, 2.89) [0.00, 3.00]
Games: 3022 W: 668 L: 802 D: 1552
Ptnml(0-2): 6, 434, 771, 288, 12
JustJeJustBotACB50BB66E0A3693diff60.0+0.60Elo: -7.30 +- 5.64 (95%) [N=1000]
Games: 1000 W: 34 L: 55 D: 911
Ptnml(0-2): 0, 45, 431, 24, 0
Nothing makes sense anymore ;-; Edit: I’m stupid I confused dev and base…
JustJeJustBotACB50BB66E0A3693diff8.0+0.08Elo: -3.34 +- 5.03 (95%) [N=3000]
Games: 3018 W: 274 L: 303 D: 2441
Ptnml(0-2): 8, 227, 1072, 190, 12
Last progtest was higher, gotta make sure i'm not crazy
JustJeJustBotprobcut-stronger-gaurddiff40.0+0.40LLR: 0.45 (-2.25, 2.89) [-5.00, 0.00]
Games: 2442 W: 569 L: 562 D: 1311
Ptnml(0-2): 0, 299, 619, 300, 3
LTC Regression Test
JustJeJustBotno-probcutdiff40.0+0.40LLR: -2.37 (-2.25, 2.89) [-5.00, 0.00]
Games: 2648 W: 559 L: 650 D: 1439
Ptnml(0-2): 2, 361, 689, 270, 2
LTC Regression Test
JustJeJustBotmasterdiff60.0+0.60Elo: 10.04 +- 6.22 (95%) [N=1000]
Games: 1004 W: 66 L: 37 D: 901
Ptnml(0-2): 1, 25, 420, 56, 0
LTC Progtest
JustJeJustBotmasterdiff8.0+0.08Elo: 10.54 +- 5.15 (95%) [N=3000]
Games: 3000 W: 344 L: 253 D: 2403
Ptnml(0-2): 8, 180, 1034, 269, 9
STC Progtest
JustJeJustBotweighted-pcmdiff8.0+0.08LLR: -0.04 (-2.25, 2.89) [0.00, 3.00]
Games: 1862 W: 450 L: 448 D: 964
Ptnml(0-2): 7, 218, 477, 224, 5
try 3