Komodo 5.1 MP running for the IPON ....

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Ajedrecista
Posts: 2177
Joined: Wed Jul 13, 2011 9:04 pm
Location: Madrid, Spain.

Re: Komodo 5.1 MP running for the IPON...

Post by Ajedrecista »

Hello again:

Results after 2700 games:

Code: Select all

K51

Komodo 5.1 - Houdini 3 STD (3076)              66.0 - 84.0   44.00%  Perf=3035 
Komodo 5.1 - Critter 1.4a (2977)               95.0 - 55.0   63.33%  Perf=3071 
Komodo 5.1 - Stockfish 3 (2976)                79.0 - 71.0   52.67%  Perf=2994 
Komodo 5.1 - Deep Rybka 4.1 (2954)             84.5 - 65.5   56.33%  Perf=2998 
Komodo 5.1 - Gull II (2929)                   100.0 - 50.0   66.67%  Perf=3049 
Komodo 5.1 - Chiron 1.5 (2845)                110.0 - 40.0   73.33%  Perf=3020 
Komodo 5.1 - Protector 1.5.0 (2867)           105.0 - 45.0   70.00%  Perf=3014 
Komodo 5.1 - Naum 4.2 (2832)                  118.0 - 32.0   78.67%  Perf=3058 
Komodo 5.1 - Hannibal 1.3 (2822)              112.0 - 38.0   74.67%  Perf=3009 
Komodo 5.1 - HIARCS 14 WCSC 32b (2816)        117.0 - 33.0   78.00%  Perf=3035 
Komodo 5.1 - Deep Shredder 12 (2800)          121.0 - 29.0   80.67%  Perf=3048 
Komodo 5.1 - Deep Sjeng c't 2010 32b (2781)   120.5 - 29.5   80.33%  Perf=3025 
Komodo 5.1 - Spike 1.4 32b (2767)             130.5 - 19.5   87.00%  Perf=3097 
Komodo 5.1 - spark-1.0 (2758)                 124.5 - 25.5   83.00%  Perf=3033 
Komodo 5.1 - Deep Junior 13.3 (2743)          121.5 - 28.5   81.00%  Perf=2994 
Komodo 5.1 - Booot 5.2.0 (2738)               126.0 - 24.0   84.00%  Perf=3026 
Komodo 5.1 - Quazar 0.4 (2726)                129.0 - 21.0   86.00%  Perf=3041 
Komodo 5.1 - Toga II 3.0 32b (2715)           130.0 - 20.0   86.67%  Perf=3040 
                                             1989.5 - 710.5  73.69%  Perf=3018 

2700 out of 2700 games played
Yesterday I did my first rating estimate of approximately 3033 Elo when Komodo had scored 1982.5 points out of 2687 games, so I expected that it will finish with (2700/2687)*1982.5 ~ 1992 points. It finally scored 7/13 in the last 13 games instead of 9.5 that I supposed yesterday. Now my rating estimate with my strange interpolation method is 3032 Elo more less (1 Elo less than yesterday), but remember that games versus Fritz are still missing.

I was much faster today in my calculation (I had it recent from yesterday...). I am waiting for know how much wrong I am in my rating estimate.

Thank you very much for your work, Ingo. :D

Regards from Spain.

Ajedrecista.
IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

Re: Komodo 5.1 MP running for the IPON ....

Post by IWB »

Test finished.

26 Elo better than K5 but 15 Elo below K-CCT.

http://www.inwoba.de

Bye
Ingo

PS: No more testing at more than 30°C. To all programmers: Please do not release engines in June, July and August!
IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

Re: Komodo 5.1 MP running for the IPON...

Post by IWB »

Ajedrecista wrote:
Yesterday I did my first rating estimate of approximately 3033 Elo when Komodo had scored 1982.5 points out of 2687 games, so I expected that it will finish with (2700/2687)*1982.5 ~ 1992 points. It finally scored 7/13 in the last 13 games instead of 9.5 that I supposed yesterday. Now my rating estimate with my strange interpolation method is 3032 Elo more less (1 Elo less than yesterday), but remember that games versus Fritz are still missing.

I was much faster today in my calculation (I had it recent from yesterday...). I am waiting for know how much wrong I am in my rating estimate.

Thank you very much for your work, Ingo. :D

Regards from Spain.

Ajedrecista.
8 Elo off, the automatic estimation was better :-)

Bye
Ingo
User avatar
Ajedrecista
Posts: 2177
Joined: Wed Jul 13, 2011 9:04 pm
Location: Madrid, Spain.

Re: Komodo 5.1 MP running for the IPON...

Post by Ajedrecista »

Hello Ingo:
IWB wrote:
Ajedrecista wrote:
Yesterday I did my first rating estimate of approximately 3033 Elo when Komodo had scored 1982.5 points out of 2687 games, so I expected that it will finish with (2700/2687)*1982.5 ~ 1992 points. It finally scored 7/13 in the last 13 games instead of 9.5 that I supposed yesterday. Now my rating estimate with my strange interpolation method is 3032 Elo more less (1 Elo less than yesterday), but remember that games versus Fritz are still missing.

I was much faster today in my calculation (I had it recent from yesterday...). I am waiting for know how much wrong I am in my rating estimate.

Thank you very much for your work, Ingo. :D

Regards from Spain.

Ajedrecista.
8 Elo off, the automatic estimation was better :-)

Bye
Ingo
True, but I had in mind my estimated rating not in the section of full list but in the top-20 (excluding CCT version and replacing it by 5.1). For example, Quazar 0.4 has a difference of 8 Elo depending on which list it is (top-20 or full list); Houdini 3 ratings differ in 5 Elo, etc. A while ago, I did other rating estimate for SF 3: I said 2979 and the official result was 2978 IIRC... later it has dropped a little due to Komodo CCT and Booot 5.2.0.

Again, I repeat that the rating of Protector was 30 Elo higher than its real rating in the live transmission (2867 instead of the real 2837), which undoubtedly made the live rating a bit inflated (1 or 2 Elo).

Once again, thank you very much!

Regards from Spain.

Ajedrecista.