LS-rankinglist: Robbolito 0.21Q

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
pohl4711
Posts: 2901
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

LS-rankinglist: Robbolito 0.21Q

Post by pohl4711 »

The LS-rankinglist (LightSpeed-rankinglist), now with Robbolito 0.21Q. +13 elo to Robbolito 0.10. Not bad, not good...but now stronger than Ivanhoe (best open source), but still more than 50 Elo weaker than Houdini 1.5a (best freeware)...

Intel i7-2630QM (SSE42 support, Windows 7 64bit, 2 GHz Quadcore, FritzMark=20.2, Houdini (one core) 2.2 meganodes/s (middlegame)), 64 MB Hash, 1 core per engine (Hyperthreading off), no ponder, no endgame-bases, no resign. 500 selected opening-positions (all 8 moves deep, from Frank Q.-database)
Elos calculated with bayeselo (mm 0 1)(fixpoint Robbolito 0.085g3 3000 Elo). LittleBlitzerGUI (gauntlet-mode only, because this GUI chooses opening-positions per random in the round-robin-mode from the PGN-file...)
Time: 45''+500ms Fischerbonus (= 85-90 seconds per game/engine).

LS-rankinglist with best engine-versions only (no betas, no settings, no development-versions) (RoundRobin, 1000 games against each opponent):

Code: Select all

Rank Name                    Elo    +    - games score oppo. draws 
   1 Houdini 3 x64          3153    5    5 10000   67%  3028   42% 
   2 Critter 1.6a x64       3072    5    5 10000   55%  3036   53% 
   3 Strelka 5.5 x64        3069    5    5 10000   55%  3036   53% (singlecore)
   4 Komodo 5 x64           3059    5    5 10000   53%  3037   44% (singlecore)
   5 Robbolito 0.21Q x64s   3033    5    4 10000   49%  3040   57% 
   6 Ivanhoe 46h x64        3024    5    5 10000   48%  3040   56% (best open source)
   7 Bouquet 1.5 x64s       3019    5    5 10000   47%  3041   55% 
   8 Rybka 4.1 x64s         3012    5    5 10000   46%  3042   47% 
   9 Stockfish 2.3.1 x64s   3001    5    5 10000   44%  3043   46% 
  10 Robbolito 0.085g3 x64  3000    5    5 10000   44%  3043   54% (singlecore)(Ippolit 2009)
  11 Saros 3.0 x64          2987    5    5 10000   42%  3044   49% 
The results of the test-gauntlet:

Code: Select all

Robbolito 0.21Q x64s   - Houdini 3 x64             325.5 - 674.5    +109/=433/-458    32.55%
Robbolito 0.21Q x64s   - Critter 1.6a x64          444.0 - 556.0    +142/=604/-254    44.40%
Robbolito 0.21Q x64s   - Komodo 5 x64              454.0 - 546.0    +235/=438/-327    45.40%
Robbolito 0.21Q x64s   - Strelka 5.5 x64           452.5 - 547.5    +155/=595/-250    45.25%
Robbolito 0.21Q x64s   - Ivanhoe 46h x64           503.5 - 496.5    +169/=669/-162    50.35%
Robbolito 0.21Q x64s   - Rybka 4.1 x64s            541.0 - 459.0    +282/=518/-200    54.10%
Robbolito 0.21Q x64s   - Bouquet 1.5 x64s          527.5 - 472.5    +191/=673/-136    52.75%
Robbolito 0.21Q x64s   - Robbolito 0.085g3 x64     560.5 - 439.5    +241/=639/-120    56.05%
Robbolito 0.21Q x64s   - Stockfish 2.3.1 x64s      543.5 - 456.5    +295/=497/-208    54.35%
Robbolito 0.21Q x64s   - Saros 3.0 x64             561.5 - 438.5    +261/=601/-138    56.15%
The complete LS-rankinglist:

Code: Select all

Rank Name                    Elo    +    - games score oppo. draws 
   1 Houdini 3 x64          3151    5    5 13000   69%  3016   41% 
   2 Houdini 2.0c x64       3104    5    5 11000   62%  3015   42% 
   3 Houdini 1.5a x64       3084    5    5 10000   59%  3017   44% (best freeware (multicore))
   4 Strelka 5.5 x64        3071    4    4 16000   56%  3029   53% (singlecore)
   5 Critter 1.6a x64       3070    4    4 16000   56%  3029   53% 
   6 Komodo 5 x64           3061    4    4 16000   54%  3030   43% (singlecore)
   7 Robbolito 0.21Q x64s   3032    5    5 10000   49%  3039   57% 
   8 Ivanhoe 46h x64        3021    4    4 16000   48%  3033   55% (best open source)
   9 Robbolito 0.10 x64s    3019    4    4 15000   48%  3033   55% 
  10 Bouquet 1.5 x64s       3018    5    5 12000   48%  3034   56% 
  11 Rybka 4.1 x64s         3012    4    4 16000   47%  3033   46% 
  12 Stockfish 2.3.1 x64s   3000    5    5 14000   45%  3033   45% 
  13 Robbolito 0.085g3 x64  3000    4    4 16000   45%  3034   53% (singlecore)(Ippolit 2009)
  14 Stockfish 2.2.2 x64s   2995    5    5 11000   45%  3033   44% 
  15 Saros 3.0 x64          2988    4    4 16000   43%  3035   48% 
  16 Gull 2 beta2 x64       2985    5    5 11000   42%  3037   53% 
  17 Bouquet 1.4 x64s       2929    5    5 13000   34%  3044   42% 
(x64=64bit version, x64s=64bit SSE42-version)


deleted betas, development-versions, settings: none
aborted test-gauntlets (because of too bad results): Saros 3.1aDistro (-130 Elo to Saros 3.0 (2500 games))


If you want to get the games from the LS-list, send me an eMail-adress per PM. I will send the games (PGN-file) as soon as possible...

Greetings – Stefan