OpenBench Testing Framework

Finished
JustJeJustBotSPSA-4-Test-1diff8.0+0.08LLR: 2.93 (-2.25, 2.89) [0.00, 3.00]
Games: 34254 W: 7948 L: 7704 D: 18602
Ptnml(0-2): 71, 3881, 8982, 4119, 74
STC
JustJeJustBotshared-lmr-historydiff8.0+0.08LLR: -1.16 (-2.25, 2.89) [0.00, 3.00]
Games: 2346 W: 511 L: 572 D: 1263
Ptnml(0-2): 2, 304, 622, 243, 2
4T STC
JustJeJustBotwdl-modeldiff40.0+0.40LLR: 2.91 (-2.25, 2.89) [-5.00, 0.00]
Games: 3130 W: 764 L: 691 D: 1675
Ptnml(0-2): 1, 218, 1054, 291, 1
LTC Regression Test
JustJeJustBotwdl-modeldiff8.0+0.08LLR: 2.93 (-2.25, 2.89) [-5.00, 0.00]
Games: 2542 W: 648 L: 562 D: 1332
Ptnml(0-2): 2, 219, 748, 295, 7
STC Regression Test
JustJeJustBotcorrhistory-check-small-changediff8.0+0.08LLR: -2.30 (-2.25, 2.89) [-5.00, 0.00]
Games: 5556 W: 1453 L: 1550 D: 2553
Ptnml(0-2): 34, 580, 1636, 505, 23
JustJeJustBotmasterdiff60.0+0.60Elo: 1.56 +- 3.11 (95%) [N=10000]
Games: 10006 W: 2562 L: 2517 D: 4927
Ptnml(0-2): 7, 996, 2951, 1043, 6
for WDL model
JustJeJustBotsoften-cutoff-scorediff8.0+0.08LLR: 2.90 (-2.25, 2.89) [0.00, 3.00]
Games: 32882 W: 9157 L: 8900 D: 14825
Ptnml(0-2): 212, 3749, 8303, 3924, 253
JustJeJustBotlmp-history-2diff40.0+0.40LLR: -1.92 (-2.25, 2.89) [0.00, 3.00]
Games: 13146 W: 3278 L: 3360 D: 6508
Ptnml(0-2): 6, 1621, 3402, 1537, 7
LTC
JustJeJustBotlmp-history-2diff8.0+0.08LLR: 2.94 (-2.25, 2.89) [0.00, 3.00]
Games: 34752 W: 9183 L: 8933 D: 16636
Ptnml(0-2): 97, 3999, 8931, 4255, 94
JustJeJustBot[Quanticade] Cronus-3.0diff60.0+0.60Elo: -9.00 +- 7.84 (95%) [N=1000]
Games: 1004 W: 62 L: 88 D: 854
Ptnml(0-2): 1, 74, 380, 44, 3
Update Network
JustJeJustBot6-input-bucketsdiff40.0+0.40LLR: -0.30 (-2.25, 2.89) [0.00, 3.00]
Games: 16926 W: 4461 L: 4442 D: 8023
Ptnml(0-2): 24, 2014, 4372, 2025, 28
LTC
JustJeJustBot6-input-bucketsdiff8.0+0.08LLR: -2.26 (-2.25, 2.89) [0.00, 3.00]
Games: 45128 W: 12208 L: 12243 D: 20677
Ptnml(0-2): 211, 5376, 11404, 5383, 190
STC
JustJeJustBot6-input-bucketsdiffN=40000LLR: 3.03 (-2.25, 2.89) [0.00, 3.00]
Games: 13258 W: 4175 L: 3938 D: 5145
Ptnml(0-2): 158, 1443, 3229, 1602, 197
JustJeJustBotlmp-history-2diff40.0+0.40LLR: -2.30 (-2.25, 2.89) [0.00, 3.00]
Games: 15166 W: 3757 L: 3857 D: 7552
Ptnml(0-2): 27, 1839, 3943, 1755, 19
LTC
JustJeJustBotlmp-history-2diff8.0+0.08LLR: 2.93 (-2.25, 2.89) [0.00, 3.00]
Games: 14508 W: 4185 L: 3964 D: 6359
Ptnml(0-2): 108, 1626, 3592, 1793, 135
JustJeJustBotshallower-deeper-2diff40.0+0.40LLR: -0.58 (-2.25, 2.89) [0.00, 3.00]
Games: 7476 W: 1859 L: 1876 D: 3741
Ptnml(0-2): 7, 859, 2025, 838, 9
LTC
JustJeJustBotDatagen-17diffN=12000Generated 117880/25000000 Games
Elo: -1.21 +- 1.45 (95%) [N=25000000]
Games: 117880 W: 31231 L: 31643 D: 55006
JustJeJustBot754a4ib-1024diff40.0+0.40LLR: 2.90 (-2.25, 2.89) [0.00, 3.00]
Games: 5268 W: 1447 L: 1264 D: 2557
Ptnml(0-2): 13, 541, 1343, 724, 13
LTC
JustJeJustBot754a4ib-1024diff8.0+0.08LLR: 2.90 (-2.25, 2.89) [0.00, 3.00]
Games: 4608 W: 1345 L: 1156 D: 2107
Ptnml(0-2): 19, 463, 1166, 622, 34
STC
JustJeJustBot754a4ib-1024diffN=40000LLR: 2.92 (-2.25, 2.89) [0.00, 3.00]
Games: 8008 W: 2550 L: 2333 D: 3125
Ptnml(0-2): 84, 874, 1913, 1007, 126
Update Tuning Step Calculation
JustJeJustBotshallower-deeper-2diff8.0+0.08LLR: -2.28 (-2.25, 2.89) [0.00, 3.00]
Games: 55726 W: 14467 L: 14479 D: 26780
Ptnml(0-2): 161, 6643, 14267, 6631, 161
JustJeJustBotDatagen-16diffN=12000Generated 14988564/25000000 Games
Elo: -0.07 +- 0.13 (95%) [N=25000000]
Games: 14988564 W: 4021906 L: 4024748 D: 6941910
JustJeJustBothmc-inputsdiff40.0+0.40LLR: -0.58 (-2.25, 2.89) [0.00, 3.00]
Games: 1504 W: 400 L: 431 D: 673
Ptnml(0-2): 6, 187, 396, 158, 5
LTC
JustJeJustBothmc-inputsdiff8.0+0.08LLR: -2.36 (-2.25, 2.89) [0.00, 3.00]
Games: 3700 W: 987 L: 1136 D: 1577
Ptnml(0-2): 64, 475, 890, 388, 33
STC try 2
JustJeJustBothmc-inputsdiffN=40000LLR: -2.35 (-2.25, 2.89) [0.00, 3.00]
Games: 90476 W: 27898 L: 27829 D: 34749
Ptnml(0-2): 1249, 10359, 21949, 10436, 1245