LS-rankinglist: Gull 2 beta2

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
pohl4711
Posts: 2848
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

LS-rankinglist: Gull 2 beta2

Post by pohl4711 »

The LS-rankinglist (LightSpeed-rankinglist), now with Gull 2 beta2.

Intel i7-2630QM (SSE42 support, Windows 7 64bit, Quadcore, FritzMark=20.2), 64 MB Hash, 1 core per engine (Hyperthreading off), no ponder, no endgame-bases, no resign. 500 selected opening-positions (all 8 moves deep, from Frank Q.-database)
Elos calculated with bayeselo (mm 0 1)(fixpoint Robbolito 0.085g3 3000 Elo). LittleBlitzerGUI (gauntlet-mode only, because this GUI chooses opening-positions per random in the round-robin-mode from the PGN-file...)
Time: 20''+250ms Fischerbonus (= 40 seconds per game/engine).

LS-rankinglist with best engine-versions only (no betas, no settings, no development-versions):

Code: Select all

Rank Name                    Elo    +    - games score oppo. draws 
   1 Houdini 2.0c x64       3118    5    5 10000   64%  3016   40% 
   2 Strelka 5.5 x64        3077    5    5 10000   58%  3020   48% (singlecore)
   3 Critter 1.6a x64       3067    5    5 10000   57%  3021   49% 
   4 Komodo 5 x64           3050    5    5 10000   54%  3023   41% (singlecore)
   5 Ivanhoe 46h x64        3027    5    5 10000   50%  3025   52% (best open source)
   6 Robbolito 0.10 x64s    3024    5    5 10000   50%  3025   53% 
   7 Rybka 4.1 x64s         3011    5    5 10000   48%  3027   43% 
   8 Robbolito 0.085g3 x64  3000    5    5 10000   46%  3028   49% (singlecore)(Ippolit 2009)
   9 Saros 3.0 x64          2995    5    5 10000   45%  3028   44% 
  10 Stockfish 2.2.2 x64s   2973    5    5 10000   42%  3030   40% 
  11 Bouquet 1.4 x64s       2935    5    5 10000   36%  3034   41% 
The results of the test-gauntlet:

Code: Select all

Gull 2 beta2 x64   - Houdini 2.0c x64          297.0 - 703.0    +105/=384/-511    29.70%
Gull 2 beta2 x64   - Critter 1.6a x64          358.5 - 641.5    +97/=523/-380    35.85%
Gull 2 beta2 x64   - Strelka 5.5 x64           360.5 - 639.5    +120/=481/-399    36.05%
Gull 2 beta2 x64   - Komodo 5 x64              377.0 - 623.0    +175/=404/-421    37.70%
Gull 2 beta2 x64   - Ivanhoe 46h x64           430.5 - 569.5    +146/=569/-285    43.05%
Gull 2 beta2 x64   - Robbolito 0.085g3 x64     448.0 - 552.0    +168/=560/-272    44.80%
Gull 2 beta2 x64   - Robbolito 0.10 x64s       441.0 - 559.0    +154/=574/-272    44.10%
Gull 2 beta2 x64   - Rybka 4.1 x64s            458.0 - 542.0    +221/=474/-305    45.80%
Gull 2 beta2 x64   - Saros 3.0 x64             472.5 - 527.5    +221/=503/-276    47.25%
Gull 2 beta2 x64   - Stockfish 2.2.2 x64s      488.5 - 511.5    +269/=439/-292    48.85%
Gull 2 beta2 x64   - Bouquet 1.4 x64s          558.0 - 442.0    +313/=490/-197    55.80%
The complete LS-rankinglist:

Code: Select all

Rank Name                     Elo    +    - games score oppo. draws 
   1 Houdini 2.0c x64        3119    5    5 15000   65%  3010   38% 
   2 Houdini 1.5a x64        3085    5    5 10000   58%  3029   42% (best freeware (multicore))
   3 Strelka 5.5 x64         3077    5    5 15000   59%  3013   46% (singlecore)
   4 Critter 1.6a x64        3067    5    5 15000   58%  3014   48% 
   5 Komodo 5 x64            3050    5    5 12000   55%  3015   41% (singlecore)
   6 Ivanhoe 46h x64         3027    4    5 15000   52%  3017   50% (best open source)
   7 Robbolito 0.10 x64s     3021    5    4 15000   51%  3017   51% 
   8 Rybka 4.1 x64s          3011    4    5 15000   49%  3018   42% 
   9 Robbolito 0.085g3 x64   3000    5    5 15000   47%  3018   48% (singlecore)(Ippolit 2009)
  10 Komodo 4 x64s           3000    5    5 11000   46%  3030   38% (singlecore)
  11 Saros 3.0 x64           2995    5    5 14000   46%  3023   44% 
  12 Stockfish 120727Q x64s  2983    6    6  9000   42%  3041   40% 
  13 Gull 2 beta2 x64        2975    5    5 11000   43%  3025   49% 
  14 Stockfish 2.2.2 x64s    2973    5    5 14000   43%  3023   39% 
  15 Saros 3.2 x64           2958    5    6  9000   39%  3033   43% 
  16 Bouquet 1.4 x64s        2935    5    5 11000   37%  3029   42% 
(x64=64bit version, x64s=64bit SSE42-version)

Deleted betas, development-versions, settings: (Stockfish 120622: Elo 2979), (Houdini 2.0c T3-setting: Elo 3114 (-5 to default))

If you want to get the games from the LS-list, send me an eMail-adress per PM. I will send the games (PGN-file) as soon as possible...

Greetings – Stefan