OpenBench

OpenBench Testing Framework

Finished
JustJe	JustBot	2-Ply-ContHistory *	diff	8.0+0.08	LLR: -0.18 (-2.94, 2.94) [0.00, 3.00] Games: 11684 W: 3485 L: 3465 D: 4734 Ptnml(0-2): 314, 1371, 2468, 1359, 330
JustJe	JustBot	No-Search-Checks-Noisy-History	diff	8.0+0.08	LLR: 0.95 (-2.94, 2.94) [-5.00, 0.00] Games: 8804 W: 2662 L: 2660 D: 3482 Ptnml(0-2): 251, 1023, 1845, 1039, 244	Try 2
JustJe	JustBot	No-Search-Checks-Noisy-History	diff	8.0+0.08	LLR: 0.21 (-2.94, 2.94) [-5.00, 0.00] Games: 5538 W: 1627 L: 1644 D: 2267 Ptnml(0-2): 169, 635, 1148, 678, 139	Try 1
JustJe	JustBot	Continuation-History	diff	8.0+0.08	LLR: 2.95 (-2.94, 2.94) [0.00, 3.00] Games: 15108 W: 4672 L: 4398 D: 6038 Ptnml(0-2): 368, 1709, 3231, 1773, 473	Try 4
JustJe	JustBot	Continuation-History	diff	8.0+0.08	LLR: -0.85 (-2.94, 2.94) [0.00, 3.00] Games: 13140 W: 3933 L: 3962 D: 5245 Ptnml(0-2): 390, 1563, 2675, 1570, 372	Try 3
JustJe	JustBot	Continuation-History *	diff	8.0+0.08	LLR: 0.85 (-2.94, 2.94) [0.00, 3.00] Games: 7670 W: 2362 L: 2274 D: 3034 Ptnml(0-2): 200, 866, 1632, 920, 217	Try 2
JustJe	JustBot	Continuation-History	diff	8.0+0.08	LLR: -2.05 (-2.94, 2.94) [0.00, 3.00] Games: 6260 W: 1800 L: 1942 D: 2518 Ptnml(0-2): 183, 783, 1322, 677, 165
JustJe	JustBot	Lazy-SMP *	diff	8.0+0.08 *	LLR: 2.97 (-2.94, 2.94) [0.00, 3.00] Games: 1150 W: 486 L: 220 D: 444 Ptnml(0-2): 13, 64, 213, 214, 71	Try 2 -- 2 threads vs 1 thread
JustJe	JustBot	Lazy-SMP	diff	8.0+0.08	LLR: 2.95 (-2.94, 2.94) [-5.00, 0.00] Games: 9242 W: 2839 L: 2746 D: 3657 Ptnml(0-2): 223, 1098, 1943, 1077, 280	Try 2 Regression Test
JustJe	JustBot	Lazy-SMP	diff	8.0+0.08	LLR: -2.96 (-2.94, 2.94) [-5.00, 0.00] Games: 2124 W: 555 L: 710 D: 859 Ptnml(0-2): 88, 289, 423, 214, 48	1 t vs 1 t regression test
JustJe	JustBot	Lazy-SMP	diff	40.0+0.40 *	LLR: 1.14 (-2.94, 2.94) [0.00, 3.00] Games: 572 W: 201 L: 111 D: 260 Ptnml(0-2): 6, 39, 115, 111, 15	LTC
JustJe	JustBot	Lazy-SMP	diff	8.0+0.08 *	LLR: 2.94 (-2.94, 2.94) [0.00, 3.00] Games: 886 W: 397 L: 124 D: 365 Ptnml(0-2): 1, 45, 155, 164, 78	4 threads vs 1
JustJe	JustBot	Lazy-SMP	diff	8.0+0.08 *	LLR: 2.95 (-2.94, 2.94) [0.00, 3.00] Games: 1744 W: 620 L: 379 D: 745 Ptnml(0-2): 23, 141, 364, 260, 84
JustJe	JustBot	192-HL	diff	8.0+0.08	LLR: 0.37 (-2.94, 2.94) [0.00, 3.00] Games: 1580 W: 535 L: 498 D: 547 Ptnml(0-2): 60, 166, 307, 191, 66
JustJe	JustBot	Use-TT-Eval *	diff	8.0+0.08	LLR: -0.15 (-2.94, 2.94) [0.00, 3.00] Games: 3748 W: 1048 L: 1049 D: 1651 Ptnml(0-2): 92, 447, 802, 436, 97
JustJe	JustBot	128-HL-B	diff	8.0+0.08	LLR: 2.95 (-2.94, 2.94) [0.00, 3.00] Games: 4508 W: 1619 L: 1360 D: 1529 Ptnml(0-2): 126, 462, 884, 591, 191
JustJe	JustBot	Datagen-4	diff	N=40000	Generated 2102438/10000000 Games Elo: -0.35 +- 0.41 (95%) [N=10000000] Games: 2102438 W: 815206 L: 817338 D: 469894
JustJe	JustBot	Clustered-TT	diff	8.0+0.08	LLR: 2.96 (-2.94, 2.94) [0.00, 3.00] Games: 8336 W: 2504 L: 2255 D: 3577 Ptnml(0-2): 168, 942, 1770, 1049, 239	Bug fix
JustJe	JustBot	Clustered-TT	diff	8.0+0.08	LLR: 0.22 (-2.94, 2.94) [0.00, 3.00] Games: 234 W: 82 L: 65 D: 87 Ptnml(0-2): 2, 27, 47, 34, 7
JustJe	JustBot	Stack-Overflow-Fixes *	diff	8.0+0.08	LLR: 2.95 (-2.94, 2.94) [-5.00, 0.00] Games: 7168 W: 2145 L: 2044 D: 2979 Ptnml(0-2): 164, 827, 1524, 882, 187
JustJe	JustBot	Bug-Fixes	diff	8.0+0.08	LLR: -0.16 (-2.94, 2.94) [0.00, 3.00] Games: 1366 W: 398 L: 406 D: 562 Ptnml(0-2): 36, 156, 300, 162, 29
JustJe	JustBot	Datagen-3	diff	N=40000	Generated 562270/10000000 Games Elo: 0.11 +- 0.80 (95%) [N=10000000] Games: 562270 W: 217524 L: 217353 D: 127393
JustJe	JustBot	128-HL	diff	8.0+0.08	LLR: 2.97 (-2.94, 2.94) [0.00, 3.00] Games: 1370 W: 621 L: 336 D: 413 Ptnml(0-2): 34, 82, 237, 229, 103
JustJe	JustBot	SEE-Prune-Try-2	diff	8.0+0.08	LLR: -0.69 (-2.94, 2.94) [0.00, 5.00] Games: 90 W: 8 L: 58 D: 24 Ptnml(0-2): 16, 18, 11, 0, 0
JustJe	JustBot	TT-Static-Eval *	diff	8.0+0.08	LLR: 2.96 (-2.94, 2.94) [0.00, 5.00] Games: 15298 W: 4680 L: 4463 D: 6155 Ptnml(0-2): 408, 1792, 3117, 1839, 493

1 2 3 15 16 17 18