SCCT Rating List-Houdini 2.0t3 with Perfect 2012c book

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

SCCT Rating List-Houdini 2.0t3 with Perfect 2012c book

Post by Sedat Canbaz »

Dear Friends,

I plan to repeat the test of Houdini 2.0t3,where this time all engines will use completely new book:Perfect 2012c
*For more details about Perfect 2012c book:
http://www.sedatcanbaz.com/chess/perfec ... ing-books/

*Houdini 2.0t3 x64 6c will be tested under these conditions (exception this time engines will use different book):
http://www.sedatcanbaz.com/chess/2838-2/

Let's wait and see what will be the new performance of Houdini 2.0t3 x64 6c

And I hope... this opening test will be helpful to see the the influence of the openings

Best Regards,
Sedat
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT Rating List-Houdini 2.0t3 with Perfect 2012c book

Post by Sedat Canbaz »

Hello Chess Friends,


Last Engine Uptates:
Houdini 2.0t3 Pc x64 6c
Rybka 4.1 79DT v1 x64 6c
Houdini 2.0Bar2 x64 6c
Bouquet 1.4 x64 6c


SCCT Rating List - All Versions:
http://www.sedatcanbaz.com/chess/scct-rating/

SCCT Rating List - Top 20:
http://www.sedatcanbaz.com/chess/sccttop20/

Conditions:
http://www.sedatcanbaz.com/chess/2838-2/

Games:
http://www.sedatcanbaz.com/chess/games/scct_3m2s.rar

Some Notes:
-Houdini 2.0t3 Pc x64 6c is same version as Houdini 2.0t3 Pro x64 6c,just this time is played with another new book:Perfect 2012c
*Actually during the current Houdini 2.0t3 Pc x64 6c test,all its opponents used same Perfect 2012c book too
-Looking at the current early results,it seems the various openings and shorter lines did not make a BIG negative influence over its performance
*But anyway,for a better conclusion: we need more games,probably this number of games between 1000-2000 games will be enough data
-Rybka 4.1 79DT v1 x64 6c is performed slightly better than default,but of course to be sure more games are required...
-I noticed also that in other testings (Non-SCCT results),there are some different standings (e.g i mean especially for Houdini settings)
-From my experience i can say that such different performance is appearing is not due to 95% confidence of error margin or we need at least 5.000 games and so on
*Sure more games is better,but i highly doubt that SCCT standings will be changed a lot,e.g i mean about after 5.000 games player


In other words,
*Of course I can be wrong...but however i have a little bit experience in Computerchess (10 years as Book Maker and 15 years as Tester)
And i strongly believe in that:
-Some SCCT Participants performed higher or lower than others,due to my used conditions are completely different than all available testings



Kind Regards,
Sedat
marijan
Posts: 56
Joined: Mon Jan 16, 2012 1:16 am

Re: SCCT Rating List-Houdini 2.0t3 with Perfect 2012c book

Post by marijan »

Thanks Sedat! You are doing great job!

Regards
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT Rating List-Houdini 2.0t3 with Perfect 2012c book

Post by Sedat Canbaz »

marijan wrote:Thanks Sedat! You are doing great job!

Regards
Dear Marijan,

Not at all...

And i'd like to thank you for your good job too

Best Wishes,
Sedat
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT Rating List-Houdini 2.0t3 with Perfect 2012c book

Post by Sedat Canbaz »

New Update:
-More games have been added,played mainly by Houdini 2.0t3 and Rybka 4.1 79DT v1

SCCT Rating List - All Versions:
http://www.sedatcanbaz.com/chess/scct-rating/


Best,
Sedat
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT Rating List-Houdini 2.0t3 with Perfect 2012c book

Post by Sedat Canbaz »

The current standings:

Code: Select all

Rank Name                         Elo     +    – games score oppo. draws 
   1 Houdini 2.0t3 Pro x64 6c     3365   12   12  1588   70%  3210   39%
   3 Houdini 2.0t3 Pc x64 6c      3359   18   18   701   74%  3180   39%
  11 Rybka 4.1 79DT v1 x64 6c     3292   17   17   753   66%  3168   37%
  15 Deep Rybka 4.1 x64 6c        3277   11   11  1735   60%  3205   48%

SCCT Rating List - All Versions:
http://www.sedatcanbaz.com/chess/scct-rating/


Greetings,
Sedat
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT Rating List-Houdini 2.0t3 with Perfect 2012c book

Post by Sedat Canbaz »

New Standings:

Houdini 2.0t3/Rybka 4.1 79DT v1's standings after 1000 games per player:
http://www.sedatcanbaz.com/chess/scct-rating/

SCCT-BayesElo's calculation notes:
offset 3300 Critter 1.6 x64 6c
mm 1 1


More Details:
-Surprisingly, Houdini 2.0t3 using a shorter book+more various openings performed identically so far
-Well done to Mindbreaker, Rybka 4.1 79DT v1 x64 6c performed 15 Elo better than default version
-Next SCCT Engine,which will be tested:Stockfish VE09 x64 6c


Best Wishes,
Sedat