LS-rankinglist: Bouquet 1.5

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
pohl4711
Posts: 2863
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

LS-rankinglist: Bouquet 1.5

Post by pohl4711 »

The LS-rankinglist (LightSpeed-rankinglist), now with Bouquet 1.5. Test of Saros 3.1aDistro aborted (-130 Elo to 3.0)...

Intel i7-2630QM (SSE42 support, Windows 7 64bit, 2 GHz Quadcore, FritzMark=20.2, Houdini (one core) 2.2 meganodes/s (middlegame)), 64 MB Hash, 1 core per engine (Hyperthreading off), no ponder, no endgame-bases, no resign. 500 selected opening-positions (all 8 moves deep, from Frank Q.-database)
Elos calculated with bayeselo (mm 0 1)(fixpoint Robbolito 0.085g3 3000 Elo). LittleBlitzerGUI (gauntlet-mode only, because this GUI chooses opening-positions per random in the round-robin-mode from the PGN-file...)
Time: 45''+500ms Fischerbonus (= 85-90 seconds per game/engine).

LS-rankinglist with best engine-versions only (no betas, no settings, no development-versions) (RoundRobin, 1000 games against each opponent):

Code: Select all

Rank Name                    Elo    +    - games score oppo. draws 
   1 Houdini 3 x64          3151    5    5 10000   67%  3025   42% 
   2 Critter 1.6a x64       3070    5    5 10000   55%  3033   53% 
   3 Strelka 5.5 x64        3069    5    5 10000   55%  3034   53% (singlecore)
   4 Komodo 5 x64           3058    5    5 10000   53%  3035   44% (singlecore)
   5 Ivanhoe 46h x64        3022    5    5 10000   48%  3038   56% (best open source)
   6 Robbolito 0.10 x64s    3019    5    5 10000   47%  3039   57% 
   7 Bouquet 1.5 x64s       3019    5    5 10000   47%  3039   55% 
   8 Rybka 4.1 x64s         3012    5    5 10000   46%  3039   47% 
   9 Robbolito 0.085g3 x64  3000    5    5 10000   44%  3040   55% (singlecore)(Ippolit 2009)
  10 Stockfish 2.3.1 x64s   2999    5    5 10000   44%  3041   46% 
  11 Saros 3.0 x64          2986    5    5 10000   42%  3042   49% 
The results of the test-gauntlet:

Code: Select all

Bouquet 1.5 x64s   - Houdini 3 x64             320.0 - 680.0    +100/=440/-460    32.00%
Bouquet 1.5 x64s   - Komodo 5 x64              434.0 - 566.0    +219/=430/-351    43.40%
Bouquet 1.5 x64s   - Strelka 5.5 x64           421.5 - 578.5    +137/=569/-294    42.15%
Bouquet 1.5 x64s   - Critter 1.6a x64          428.5 - 571.5    +140/=577/-283    42.85%
Bouquet 1.5 x64s   - Ivanhoe 46h x64           487.5 - 512.5    +172/=631/-197    48.75%
Bouquet 1.5 x64s   - Robbolito 0.10 x64s       509.0 - 491.0    +176/=666/-158    50.90%
Bouquet 1.5 x64s   - Rybka 4.1 x64s            519.5 - 480.5    +282/=475/-243    51.95%
Bouquet 1.5 x64s   - Robbolito 0.085g3 x64     520.5 - 479.5    +202/=637/-161    52.05%
Bouquet 1.5 x64s   - Saros 3.0 x64             543.0 - 457.0    +263/=560/-177    54.30%
Bouquet 1.5 x64s   - Stockfish 2.3.1 x64s      534.5 - 465.5    +287/=495/-218    53.45%
The complete LS-rankinglist:

Code: Select all

Rank Name                    Elo    +    - games score oppo. draws 
   1 Houdini 3 x64          3151    5    5 11000   68%  3018   41% 
   2 Houdini 2.0c x64       3104    5    5 11000   62%  3015   42% 
   3 Houdini 1.5a x64       3084    5    5 10000   59%  3017   44% (best freeware (multicore))
   4 Critter 1.6a x64       3071    5    5 14000   56%  3033   52% 
   5 Strelka 5.5 x64        3071    4    5 14000   56%  3033   52% (singlecore)
   6 Komodo 5 x64           3060    5    5 14000   54%  3033   43% (singlecore)
   7 Ivanhoe 46h x64        3021    5    5 14000   48%  3036   53% (best open source)
   8 Bouquet 1.5 x64s       3020    5    5 10000   47%  3039   55% 
   9 Robbolito 0.10 x64s    3019    5    4 14000   48%  3036   54% 
  10 Rybka 4.1 x64s         3012    5    5 14000   47%  3037   46% 
  11 Stockfish 2.3.1 x64s   3002    5    5 12000   45%  3037   44% 
  12 Robbolito 0.085g3 x64  3000    4    4 14000   45%  3038   52% (singlecore)(Ippolit 2009)
  13 Stockfish 2.2.2 x64s   2996    5    5 11000   45%  3033   44% 
  14 Saros 3.0 x64          2987    5    5 14000   43%  3039   46% 
  15 Bouquet 1.4 x64s       2929    5    5 13000   34%  3044   42% 
(x64=64bit version, x64s=64bit SSE42-version)


deleted betas, development-versions, settings: none
aborted test-gauntlets (because of too bad results): Saros 3.1aDistro (-130 Elo to Saros 3.0 (2500 games))


If you want to get the games from the LS-list, send me an eMail-adress per PM. I will send the games (PGN-file) as soon as possible...

Greetings – Stefan