LS-rankinglist: Gull 2 beta2

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
pohl4711
Posts: 2810
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

LS-rankinglist: Gull 2 beta2

Post by pohl4711 »

The LS-rankinglist (LightSpeed-rankinglist), now with Gull 2 beta2. Only listed in the complete LS-list, not in the best-list, because it is a beta-version...

Intel i7-2630QM (SSE42 support, Windows 7 64bit, 2 GHz Quadcore, FritzMark=20.2, Houdini (one core) 2.2 meganodes/s (middlegame)), 64 MB Hash, 1 core per engine (Hyperthreading off), no ponder, no endgame-bases, no resign. 500 selected opening-positions (all 8 moves deep, from Frank Q.-database)
Elos calculated with bayeselo (mm 0 1)(fixpoint Robbolito 0.085g3 3000 Elo). LittleBlitzerGUI (gauntlet-mode only, because this GUI chooses opening-positions per random in the round-robin-mode from the PGN-file...)
Time: 45''+500ms Fischerbonus (= 85-90 seconds per game/engine).

LS-rankinglist with best engine-versions only (no betas, no settings, no development-versions) (RoundRobin, 1000 games against each opponent):

Code: Select all

Rank Name                    Elo    +    - games score oppo. draws 
   1 Houdini 3 x64          3151    5    5 10000   67%  3025   42% 
   2 Critter 1.6a x64       3070    5    5 10000   55%  3033   53% 
   3 Strelka 5.5 x64        3069    5    5 10000   55%  3034   53% (singlecore)
   4 Komodo 5 x64           3058    5    5 10000   53%  3035   44% (singlecore)
   5 Ivanhoe 46h x64        3022    5    5 10000   48%  3038   56% (best open source)
   6 Robbolito 0.10 x64s    3019    5    5 10000   47%  3039   57% 
   7 Bouquet 1.5 x64s       3019    5    5 10000   47%  3039   55% 
   8 Rybka 4.1 x64s         3012    5    5 10000   46%  3039   47% 
   9 Robbolito 0.085g3 x64  3000    5    5 10000   44%  3040   55% (singlecore)(Ippolit 2009)
  10 Stockfish 2.3.1 x64s   2999    5    5 10000   44%  3041   46% 
  11 Saros 3.0 x64          2986    5    5 10000   42%  3042   49% 
The results of the test-gauntlet:

Code: Select all

Gull 2 beta2 x64   - Strelka 5.5 x64           367.5 - 632.5    +113/=509/-378    36.75%
Gull 2 beta2 x64   - Komodo 5 x64              390.0 - 610.0    +167/=446/-387    39.00%
Gull 2 beta2 x64   - Houdini 3 x64             270.0 - 730.0    +86/=368/-546    27.00%
Gull 2 beta2 x64   - Critter 1.6a x64          389.0 - 611.0    +123/=532/-345    38.90%
Gull 2 beta2 x64   - Robbolito 0.10 x64s       451.5 - 548.5    +134/=635/-231    45.15%
Gull 2 beta2 x64   - Ivanhoe 46h x64           443.5 - 556.5    +131/=625/-244    44.35%
Gull 2 beta2 x64   - Rybka 4.1 x64s            452.0 - 548.0    +197/=510/-293    45.20%
Gull 2 beta2 x64   - Stockfish 2.3.1 x64s      500.5 - 499.5    +259/=483/-258    50.05%
Gull 2 beta2 x64   - Robbolito 0.085g3 x64     460.0 - 540.0    +175/=570/-255    46.00%
Gull 2 beta2 x64   - Saros 3.0 x64             485.5 - 514.5    +218/=535/-247    48.55%
Gull 2 beta2 x64   - Bouquet 1.5 x64s          465.0 - 535.0    +159/=612/-229    46.50%
The complete LS-rankinglist:

Code: Select all

Rank Name                    Elo    +    - games score oppo. draws 
   1 Houdini 3 x64          3150    5    5 12000   69%  3014   40% 
   2 Houdini 2.0c x64       3104    5    5 11000   62%  3015   42% 
   3 Houdini 1.5a x64       3083    5    5 10000   59%  3016   44% (best freeware (multicore))
   4 Strelka 5.5 x64        3071    4    4 15000   56%  3029   52% (singlecore)
   5 Critter 1.6a x64       3070    5    4 15000   56%  3029   52% 
   6 Komodo 5 x64           3060    4    4 15000   54%  3029   43% (singlecore)
   7 Ivanhoe 46h x64        3020    4    4 15000   48%  3032   54% (best open source)
   8 Robbolito 0.10 x64s    3018    4    4 15000   48%  3032   55% 
   9 Bouquet 1.5 x64s       3018    5    5 11000   48%  3034   55% 
  10 Rybka 4.1 x64s         3012    4    4 15000   47%  3033   46% 
  11 Robbolito 0.085g3 x64  3000    4    4 15000   45%  3033   52% (singlecore)(Ippolit 2009)
  12 Stockfish 2.3.1 x64s   3000    5    5 13000   45%  3033   45% 
  13 Stockfish 2.2.2 x64s   2995    5    5 11000   45%  3032   44% 
  14 Saros 3.0 x64          2987    4    4 15000   43%  3034   47% 
  15 Gull 2 beta2 x64       2985    5    5 11000   42%  3037   53% 
  16 Bouquet 1.4 x64s       2929    5    5 13000   34%  3044   42% 
(x64=64bit version, x64s=64bit SSE42-version)


deleted betas, development-versions, settings: none
aborted test-gauntlets (because of too bad results): Saros 3.1aDistro (-130 Elo to Saros 3.0 (2500 games))


If you want to get the games from the LS-list, send me an eMail-adress per PM. I will send the games (PGN-file) as soon as possible...

Greetings – Stefan