Similarity Report - d=1 move chooser rarity
Posted: Tue Oct 01, 2019 4:20 pm
Below is a sorted table with a measure of how often the first move choice of an engine (at d=1) matches up with the general mass of (135 tested) engines first move choices. A low figure means the engine first move choice tends to the unusual, a high figure that the engine tends to the usual (where usual means what the mass tends to do).
NB this is not an engine-engine test result, it's one engine to all-other-engines-at-once test result. Or one could look at it the other way round, a high figure for an engine means that lots of other engines agree with it.
Algorithm is fairly straightforward, for each move selection of an engine, it scores 1.0 for every agreement move by any other engine. Divide the result by (count of engines x count of epds).
I might try splitting the "mass" up into two or three sub-groups indicated by the Simex similarity results and see if there is any further discrimination to be found.
NB this is not an engine-engine test result, it's one engine to all-other-engines-at-once test result. Or one could look at it the other way round, a high figure for an engine means that lots of other engines agree with it.
Algorithm is fairly straightforward, for each move selection of an engine, it scores 1.0 for every agreement move by any other engine. Divide the result by (count of engines x count of epds).
I might try splitting the "mass" up into two or three sub-groups indicated by the Simex similarity results and see if there is any further discrimination to be found.
Code: Select all
Ethereal 11.50 0.239
Hiarcs 14 0.319
CRafty 20.1 0.372
ProDeo 2.2 0.376
Houdini 4 0.39
Ruffian 2 0.397
Rubichess 1.4 0.397
Hiarcs 13 0.402
Ethereal 11.00 0.406
Komodo 7 0.407
Komodo 8 0.408
Fruit 1.0 0.412
Ethereal 11.25 0.414
Fire 7.1 0.424
Arasan 17 0.424
Andscacs 0.85 0.426
Andscacs 0.84 0.427
Andscacs 0.82 0.427
Andscacs 0.83 0.427
Komodo 6 0.428
Stockfish 10 0.429
Arasan 19 0.429
Arasan 18 0.429
Xiphos 0.4 0.429
Andscacs 0.81 0.43
Texel 1.07 0.43
Nemorino 2 0.432
Komodo CCT 0.432
Ethereal 9.00 0.433
Nemorino 1 0.435
Komodo 4 0.435
Komodo 3 0.435
Andscacs 0.87 0.435
Arasan 21.3 0.436
Cheng 3 0.436
Komodo 5 0.436
Andscacs 0.93 0.437
Senpai 1 0.437
Ethereal 10.55 0.437
Houdini 6 0.437
Gull 3 0.439
Gull 1 0.439
Ethereal 10.00 0.44
Ethereal 8.00 0.44
Ethereal 8.61 0.441
Schooner 2 0.442
Nirvana 2.0 0.442
Xiphos 0.5 0.442
Shredder 12 0.443
Xiphos 0.3 0.443
Ethereal 8.37 0.444
Ethereal 9.65 0.444
Ethereal 9.30 0.445
Komodo 12 0.445
Komodo 2 0.445
Xiphos 0.2 0.447
BrainFish 0.447
Fruit 1.5 0.448
Arasan 20 0.449
Stockfish 1 0.449
Fruit 2.3 0.45
Glaurung 2.2 0.451
Komodo 11 0.451
Houdini 5 0.453
Stockfish 9 0.453
Pedone 1.9 0.453
Nirvana 1.8 0.454
CRafty 24.1 0.454
Xiphos 0.1 0.455
AsmFish 0.458
Rodent 3 0.46
SugaR 1.0 0.46
CRafty 23.4 0.461
CRafty 23.3 0.461
Pedone 1.6 0.461
Komodo 10 0.462
CRafty 25.1 0.462
Stockfish 2 0.462
Wasp 3.75 0.463
Toga 3.0 0.465
Gull 2 0.465
Toga 1.2 0.467
Hannibal 1.7 0.467
Fruit 2.0 0.468
Komodo 9 0.469
DiscoCheck 0.471
Equinox 3.20 0.472
Bouquet 1.8 0.472
Equinox 3.3 0.473
Toga 3.1 0.475
Critter 1.4 0.475
Stockfish 8 0.476
Critter 1.6 0.476
Rybka 1 0.476
Shredder 13 0.476
Stockfish 7 0.479
Bouquet 1.5 0.48
Houdini 1.5 0.483
Nirvana 2.4 0.483
Strelka 5 0.483
GAmbitFruit 1.1 0.483
Toga 1.3 0.484
GAmbitFruit 1.0 0.484
Ippolit 0.485
Houdini 1.0 0.485
Strelka 2 0.485
Doch 1.2 0.485
Nirvana 2.2 0.485
Toga 4.1 0.486
Robbolito 0.486
Critter 1.2 0.486
Komodo 1 0.487
Doch 0.98 0.488
Toga 1.0 0.488
Wasp 3.00 0.489
Nirvana 2.3 0.489
Stockfish 3 0.49
Nirvana 2.1 0.49
Wasp 3.60 0.491
GAmbitFruit 4.b 0.492
Wasp 3.50 0.493
Sting 1.5 0.493
Wasp 1.01 0.494
Wasp 2.00 0.494
Wasp 2.60 0.494
Wasp 1.25 0.495
Stockfish 4 0.495
Fruit 2.1 0.495
Sting 9.6 0.495
Sting 8.8 0.495
GAmbitFruit 4.bx 0.496
Toga 1.1 0.497
Stockfish 6 0.497
Stockfish 5 0.498
Fruit 2.2 0.498