LS-rankinglist: Houdini 3

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
pohl4711
Posts: 2813
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

LS-rankinglist: Houdini 3

Post by pohl4711 »

The LS-rankinglist (LightSpeed-rankinglist), now with Houdini 3. Really impressive...

Intel i7-2630QM (SSE42 support, Windows 7 64bit, 2 GHz Quadcore, FritzMark=20.2, Houdini (one core) 2.2 meganodes/s (middlegame)), 64 MB Hash, 1 core per engine (Hyperthreading off), no ponder, no endgame-bases, no resign. 500 selected opening-positions (all 8 moves deep, from Frank Q.-database)
Elos calculated with bayeselo (mm 0 1)(fixpoint Robbolito 0.085g3 3000 Elo). LittleBlitzerGUI (gauntlet-mode only, because this GUI chooses opening-positions per random in the round-robin-mode from the PGN-file...)
Time: 45''+500ms Fischerbonus (= 85-90 seconds per game/engine).

LS-rankinglist with best engine-versions only (no betas, no settings, no development-versions) (RoundRobin, 1000 games against each opponent):

Code: Select all

Rank Name                    Elo    +    - games score oppo. draws 
   1 Houdini 3 x64          3150    5    5 10000   68%  3016   40% 
   2 Critter 1.6a x64       3068    5    5 10000   56%  3024   52% 
   3 Strelka 5.5 x64        3067    5    5 10000   56%  3024   52% (singlecore)
   4 Komodo 5 x64           3056    5    5 10000   54%  3025   44% (singlecore)
   5 Ivanhoe 46h x64        3021    5    5 10000   49%  3029   54% (best open source)
   6 Robbolito 0.10 x64s    3018    5    5 10000   48%  3029   55% 
   7 Rybka 4.1 x64s         3012    5    5 10000   48%  3030   47% 
   8 Stockfish 2.3.1 x64s   3000    5    5 10000   46%  3031   45% 
   9 Robbolito 0.085g3 x64  3000    5    5 10000   46%  3031   53% (singlecore)(Ippolit 2009)
  10 Saros 3.0 x64          2988    5    5 10000   44%  3032   47% 
  11 Bouquet 1.4 x64s       2928    5    5 10000   35%  3038   43% 
The results of the test-gauntlet:

Code: Select all

Houdini 3 x64   - Critter 1.6a x64          619.0 - 381.0    +377/=484/-139    61.90%
Houdini 3 x64   - Komodo 5 x64              612.5 - 387.5    +421/=383/-196    61.25%
Houdini 3 x64   - Ivanhoe 46h x64           695.0 - 305.0    +487/=416/-97    69.50%
Houdini 3 x64   - Strelka 5.5 x64           625.0 - 375.0    +375/=500/-125    62.50%
Houdini 3 x64   - Rybka 4.1 x64s            693.0 - 307.0    +508/=370/-122    69.30%
Houdini 3 x64   - Robbolito 0.10 x64s       678.0 - 322.0    +452/=452/-96    67.80%
Houdini 3 x64   - Robbolito 0.085g3 x64     715.5 - 284.5    +518/=395/-87    71.55%
Houdini 3 x64   - Saros 3.0 x64             736.0 - 264.0    +556/=360/-84    73.60%
Houdini 3 x64   - Bouquet 1.4 x64s          791.5 - 208.5    +643/=297/-60    79.15%
Houdini 3 x64   - Stockfish 2.3.1 x64s      679.0 - 321.0    +491/=376/-133    67.90%
The complete LS-rankinglist:

Code: Select all

Rank Name                    Elo    +    - games score oppo. draws 
   1 Houdini 3 x64          3151    5    5 10000   68%  3018   40% 
   2 Houdini 2.0c x64       3104    5    5 11000   62%  3016   42% 
   3 Houdini 1.5a x64       3084    5    5 10000   59%  3017   44% (best freeware (multicore))
   4 Critter 1.6a x64       3072    5    5 13000   56%  3034   51% 
   5 Strelka 5.5 x64        3071    5    5 13000   55%  3034   52% (singlecore)
   6 Komodo 5 x64           3060    5    5 13000   54%  3035   43% (singlecore)
   7 Ivanhoe 46h x64        3020    5    4 13000   48%  3038   52% (best open source)
   8 Robbolito 0.10 x64s    3020    5    5 13000   47%  3038   54% 
   9 Rybka 4.1 x64s         3013    5    5 13000   47%  3038   45% 
  10 Stockfish 2.3.1 x64s   3003    5    5 11000   45%  3039   44% 
  11 Robbolito 0.085g3 x64  3000    5    5 13000   44%  3039   51% (singlecore)(Ippolit 2009)
  12 Stockfish 2.2.2 x64s   2996    5    5 11000   45%  3033   44% 
  13 Saros 3.0 x64          2988    4    5 13000   43%  3040   46% 
  14 Bouquet 1.4 x64s       2930    5    5 13000   34%  3045   42% 
(x64=64bit version, x64s=64bit SSE42-version)


deleted betas, development-versions, settings: none
aborted test-gauntlets (because of too bad results): none


If you want to get the games from the LS-list, send me an eMail-adress per PM. I will send the games (PGN-file) as soon as possible...

Greetings – Stefan