Discussion of anything and everything relating to chess playing software and machines.
Moderator: Ras
Dann Corbit
Posts: 12782 Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA
Post
by Dann Corbit » Sat Jul 15, 2017 2:39 am
For completeness, here are the ICGA results:
Code: Select all
Program Elo + - Games Score Av.Op. Draws
1 Komodo : 2942 104 42 15 56.7 % 2895 86.7 %
2 Jonny : 2913 65 65 15 50.0 % 2913 86.7 %
3 Shredder : 2886 75 75 13 50.0 % 2886 84.6 %
4 Chiron : 2851 48 119 13 42.3 % 2905 84.6 %
and here are the CEGT results:
Code: Select all
no Program Elo + - Games Score Av.Op. Draws
1 Stockfish 8.0 x64 4CPU 3414 15 15 1602 71.0% 3241 51.6%
2 Komodo 11.01 x64 4CPU 3402 17 17 1332 71.7% 3224 47.3%
3 Komodo 10.4 x64 4CPU 3397 15 15 2077 76.1% 3174 41.0%
4 Houdini 5.0 x64 4CPU 3380 15 15 1505 68.1% 3234 54.0%
5 Komodo 10.2 x64 4CPU 3361 14 14 1785 70.9% 3191 44.8%
6 Komodo 10.3 x64 4CPU 3359 17 17 1102 66.7% 3229 52.7%
7 Komodo 10 x64 4CPU 3346 13 13 2616 73.5% 3150 42.6%
8 Komodo 10.1 x64 4CPU 3346 19 19 1061 71.8% 3174 46.1%
9 Komodo 9.42 x64 4CPU 3343 14 14 2001 73.8% 3142 42.6%
10 Stockfish 7.0 x64 4CPU 3339 10 10 4221 67.1% 3200 52.6%
11 Komodo 9.2 x64 4CPU 3335 12 12 2177 72.9% 3145 42.5%
12 Komodo 9.3 x64 4CPU 3323 16 16 1498 72.1% 3147 46.4%
13 Deep Shredder 13 x64 4CPU 3225 12 12 2325 48.7% 3236 56.3%
14 Fizbo 1.9 x64 4CPU 3207 13 13 2254 49.0% 3217 52.8%
15 Houdini 4.0 x64 4CPU 3197 9 9 4649 49.9% 3195 45.6%
16 Gull 3.0 x64 4CPU 3186 8 8 6937 53.5% 3151 50.1%
17 Ginkgo 2.0 x64 4CPU 3174 18 18 1023 41.9% 3239 57.3%
18 Andscacs 0.90 x64 4CPU 3174 16 16 1119 48.1% 3190 55.8%
19 Andscacs 0.89 x64 4CPU 3169 17 17 1000 48.9% 3177 55.1%
20 Jonny 8.00 x64 4CPU 3157 14 14 1750 42.1% 3220 50.6%
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Dann Corbit
Posts: 12782 Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA
Post
by Dann Corbit » Sat Jul 15, 2017 2:43 am
CEGT at 40/4:
Code: Select all
no Program Elo + - Games Score Av.Op. Draws
1 Stockfish 8.0 x64 12CPU 3542 19 19 1750 66.2% 3396 53.6%
2 Houdini 5.0 x64 12CPU 3538 20 20 1400 58.5% 3467 64.4%
3 Komodo 11.01 x64 12CPU 3515 29 29 400 51.3% 3506 68.5%
4 Gull 3.0 x64 12CPU 3247 12 12 2600 40.5% 3322 49.8%
5 Deep Shredder 13 x64 4CPU 3245 14 14 1600 48.0% 3261 56.6%
6 Fizbo 1.9 x64 4CPU 3214 18 18 1050 43.0% 3268 48.3%
7 Fire 5 x64 2CPU 3198 23 23 730 67.5% 3046 39.2%
8 Fritz 15 x64 12CPU 3174 17 17 1550 31.5% 3329 38.1%
9 Ginkgo 1.8 x64 4CPU 3151 14 14 1700 44.5% 3197 51.1%
10 Jonny 8.00 x64 4CPU 3147 14 14 1800 42.4% 3208 46.1%
I think this list is the first one I found.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Dann Corbit
Posts: 12782 Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA
Post
by Dann Corbit » Sat Jul 15, 2017 2:46 am
This CEGT listing at 40/4 has more core combinations:
Code: Select all
no Program Elo + - Games Score Av.Op. Draws
1 Stockfish 8.0 x64 12CPU 3542 19 19 1750 66.2% 3396 53.6%
2 Houdini 5.0 x64 12CPU 3538 20 20 1400 58.5% 3467 64.4%
3 Komodo 11.01 x64 12CPU 3515 29 29 400 51.3% 3506 68.5%
4 Houdini 5.0 Tac x64 12CPU 3485 22 22 850 52.3% 3463 55.2%
5 Komodo 10.3 x64 12CPU 3484 23 23 650 56.1% 3428 51.2%
6 Komodo 10.4 x64 12CPU 3484 25 25 600 59.8% 3393 52.8%
7 Stockfish 7.0 x64 12CPU 3459 14 14 2200 56.5% 3405 57.9%
8 Komodo 10.1 x64 12CPU 3450 19 19 1050 69.7% 3286 43.0%
9 Komodo 10.2 x64 12CPU 3450 17 17 1400 64.3% 3330 48.6%
10 Komodo 10.0 x64 12CPU 3435 18 18 1050 68.7% 3282 44.0%
11 Stockfish TCEC8 x64 12CPU 3432 14 14 2050 59.6% 3356 56.4%
12 Komodo 9.42 x64 12CPU 3424 17 17 1500 68.5% 3273 45.1%
13 Stockfish 8.0 x64 4CPU 3417 20 20 1050 75.7% 3200 43.0%
14 Komodo 9.2 x64 C0 12CPU 3415 15 15 1600 60.5% 3331 56.7%
15 Komodo 9.3 x64 12CPU 3414 17 17 1200 63.2% 3308 48.8%
16 Komodo 9.1 x64 12CPU 3404 19 19 1000 68.2% 3262 53.4%
17 Houdini 5.0 x64 4CPU 3403 20 20 1050 72.5% 3217 45.6%
18 Komodo 9.2 x64 12CPU 3402 16 16 1450 60.7% 3318 51.7%
19 Komodo 10.4 x64 4CPU 3396 22 22 950 73.7% 3198 42.3%
20 Komodo 9.42 x64 4CPU 3382 17 17 1200 74.5% 3181 35.9%
21 Komodo 10.0 x64 4CPU 3380 19 19 1200 73.6% 3189 40.8%
22 Komodo 9.0 x64 12CPU 3378 16 16 1150 61.9% 3286 56.0%
23 Komodo 11.01 x64 2CPU 3372 29 29 700 84.6% 3027 26.1%
24 Stockfish 7.0 x64 4CPU 3370 15 15 1600 67.3% 3230 49.9%
25 Stockfish 6.0 x64 12CPU 3362 11 11 2750 53.4% 3335 61.1%
26 Komodo 9.0 x64 8CPU 3359 18 18 1000 63.3% 3256 53.8%
27 Stockfish 8.0 x64 2CPU 3358 19 19 1430 79.0% 3080 37.3%
28 Houdini 5.0 x64 2CPU 3354 17 17 1430 77.7% 3088 36.6%
29 Stockfish 20170522 x64 1CPU 3353 13 13 2000 74.5% 3146 43.7%
30 Stockfish 6.0 x64 8CPU 3348 13 13 2050 53.2% 3322 59.0%
31 Komodo 9.3 x64 4CPU 3340 15 15 1400 67.7% 3201 47.6%
32 Komodo 9.2 x64 4CPU 3337 25 25 600 65.0% 3223 47.0%
33 Stockfish 8.0 x64 1CPU 3333 9 9 4500 73.1% 3138 44.4%
34 Komodo 10.3 x64 2CPU 3330 17 17 1100 66.1% 3198 47.7%
35 Stockfish 20161222 x64 1CPU 3330 16 16 1200 71.2% 3155 48.8%
36 Komodo 10.0 x64 2CPU 3326 20 20 1200 79.8% 3049 30.7%
37 Houdini 5.0 x64 1CPU 3319 9 9 4400 68.1% 3169 49.7%
38 Komodo 9.0 x64 4CPU 3315 14 14 1400 71.3% 3144 43.3%
39 Komodo 10.2 x64 2CPU 3314 22 22 1030 80.5% 3027 29.2%
40 Komodo 11.01 x64 1CPU 3312 11 11 2500 69.3% 3155 44.4%
41 Komodo 8.0 x64 12CPU 3312 12 12 2300 59.6% 3240 52.2%
42 Stockfish 5.0 x64 12CPU 3310 14 14 1650 59.4% 3240 51.8%
43 Stockfish 20160716 x64 1CPU 3307 14 14 2000 79.0% 3063 37.0%
44 Stockfish 7.0 x64 2CPU 3305 15 15 1950 69.0% 3135 43.4%
45 Komodo 9.3 x64 2CPU 3305 20 20 1250 79.5% 3040 33.3%
46 Komodo 10.4 x64 1CPU 3303 12 12 2700 68.5% 3153 45.0%
47 Stockfish 6.0 x64 4CPU 3298 12 12 2550 67.1% 3140 46.7%
48 Komodo 9.2 x64 2CPU 3298 19 19 1000 68.0% 3159 43.9%
49 Houdini 5.0 w32 1CPU 3296 20 20 1100 80.1% 3024 31.4%
50 Stockfish 8.0 w32 1CPU 3296 17 17 1300 79.7% 3034 36.4%
51 Komodo 10.3 x64 1CPU 3294 12 12 2400 65.6% 3169 48.7%
52 Stockfish 5.0 x64 8CPU 3292 12 12 1900 53.3% 3267 53.7%
53 Komodo 9.0 x64 2CPU 3289 17 17 1200 69.5% 3137 44.4%
54 Komodo 8.0 x64 8CPU 3287 12 12 1900 57.5% 3231 52.2%
55 Stockfish 6.0 x64 2CPU 3275 16 16 1600 63.8% 3168 51.3%
56 Komodo 10.2 x64 1CPU 3273 14 14 1900 66.0% 3148 48.3%
57 Komodo 7.0a x64 12CPU 3271 21 21 650 53.0% 3249 58.9%
58 Komodo 10.0 x64 1CPU 3266 13 13 2200 76.6% 3047 34.6%
59 Komodo 10.1 x64 1CPU 3266 12 12 2400 72.7% 3081 37.9%
60 Komodo 9.42 x64 1CPU 3258 13 13 2000 74.2% 3062 35.9%
61 Stockfish 7.0 x64 1CPU 3250 10 10 3700 69.5% 3093 47.2%
62 Gull 3.0 x64 12CPU 3247 12 12 2600 40.5% 3322 49.8%
63 Deep Shredder 13 x64 4CPU 3245 14 14 1600 48.0% 3261 56.6%
64 Houdini 4.0 x64 12CPU 3245 12 12 2500 40.5% 3319 43.5%
65 Komodo 7.0a x64 8CPU 3244 18 18 900 51.2% 3234 52.2%
66 Stockfish 5.0 x64 4CPU 3238 10 10 4300 71.2% 3045 38.5%
67 Komodo 8.0 x64 4CPU 3236 11 11 3350 74.7% 3009 33.2%
68 Houdini 4.0 x64 8CPU 3234 12 12 2100 44.9% 3271 44.1%
69 Houdini 3.0 x64 12CPU 3233 19 19 850 37.8% 3327 47.4%
70 Komodo 9.3 x64 1CPU 3225 11 11 3100 69.5% 3070 43.0%
71 Gull 3.0 x64 8CPU 3223 17 17 1000 50.0% 3223 52.5%
72 Komodo 10.2 w32 1CPU 3218 18 18 1200 71.0% 3045 38.6%
73 Stockfish 7.0 w32 1CPU 3217 17 17 1400 75.6% 2994 39.4%
74 Houdini 4.0 x64 4CPU 3217 9 9 5950 58.5% 3131 36.1%
75 Komodo 8.0 x64 2CPU 3216 16 16 1300 59.4% 3145 49.6%
76 Komodo 9.2 x64 1CPU 3216 10 10 2900 70.5% 3051 42.2%
77 Houdini 4.0 Tac x64 12CPU 3215 17 17 1600 30.9% 3371 38.0%
78 Fizbo 1.9 x64 4CPU 3214 18 18 1050 43.0% 3268 48.3%
79 Komodo 7.0a x64 4CPU 3212 14 14 1450 56.7% 3159 44.8%
80 Houdini 3.0 x64 4CPU 3210 11 11 4100 79.6% 2939 29.2%
81 Komodo 10.0 w32 1CPU 3207 21 21 800 73.7% 3012 36.1%
82 Deep Shredder 13 x64 2CPU 3206 12 12 2000 57.3% 3150 49.9%
83 Komodo 9.1 x64 1CPU 3205 11 11 2900 72.6% 3016 40.4%
84 Stockfish 5.0 x64 2CPU 3202 15 15 1350 61.8% 3110 49.3%
85 Stockfish 6.0 x64 1CPU 3201 9 9 3900 60.4% 3119 50.7%
86 Komodo 9.0 x64 1CPU 3200 14 14 2000 76.8% 2973 35.6%
87 Fire 5 x64 2CPU 3198 23 23 730 67.5% 3046 39.2%
88 Stockfish DD x64 4CPU 3192 12 12 3050 71.6% 3000 37.0%
89 Houdini 4.0 x64 2CPU 3191 10 10 3500 59.6% 3108 38.0%
90 Komodo TCEC x64 4CPU 3186 17 17 1000 66.3% 3061 40.5%
91 Gull 3.0 x64 4CPU 3183 7 7 6700 54.2% 3139 44.2%
92 Komodo 9.3 w32 1CPU 3180 19 19 900 71.8% 3006 39.9%
93 Stockfish 6.0 w32 1CPU 3177 11 11 2700 72.7% 2992 41.3%
94 Fritz 15 x64 12CPU 3174 17 17 1550 31.5% 3329 38.1%
95 Komodo 9.2 w32 1CPU 3173 17 17 1200 67.2% 3038 43.4%
96 Houdini 3.0 x64 2CPU 3168 13 13 1800 72.9% 2981 33.8%
97 Gull 2.8 beta x64 4CPU 3166 18 18 1000 63.0% 3067 42.3%
98 Houdini 2.0c x64 4CPU 3160 11 11 3200 78.7% 2903 28.2%
99 Stockfish 5.0 x64 1CPU 3159 10 10 4150 60.6% 3073 43.3%
100 Komodo 7.0a x64 2CPU 3154 16 16 1050 57.4% 3098 44.1%
101 Fizbo 1.9 x64 2CPU 3153 17 17 1380 59.0% 3076 40.4%
102 Deep Shredder 13 x64 1CPU 3153 9 9 4550 53.7% 3123 45.7%
103 Ginkgo 1.8 x64 4CPU 3151 14 14 1700 44.5% 3197 51.1%
104 Jonny 8.00 x64 4CPU 3147 14 14 1800 42.4% 3208 46.1%
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Dann Corbit
Posts: 12782 Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA
Post
by Dann Corbit » Sat Jul 15, 2017 3:21 am
BTW,
I like HGM just fine.
We both go over the top when debating these life and death topics.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
BrendanJNorman
Posts: 2583 Joined: Mon Feb 08, 2016 12:43 am
Full name: Brendan J Norman
Post
by BrendanJNorman » Sat Jul 15, 2017 5:36 am
Dann Corbit wrote: The main issue, as I see it, is that the ICGA (like Australia ) is entirely peopled with criminals.
I hope you're not serious...
Graham Banks
Posts: 44375 Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ
Post
by Graham Banks » Sat Jul 15, 2017 6:13 am
BrendanJNorman wrote: Dann Corbit wrote: The main issue, as I see it, is that the ICGA (like Australia ) is entirely peopled with criminals.
I hope you're not serious...
gbanksnz at gmail.com
Dann Corbit
Posts: 12782 Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA
Post
by Dann Corbit » Sat Jul 15, 2017 6:28 am
BrendanJNorman wrote: Dann Corbit wrote: The main issue, as I see it, is that the ICGA (like Australia ) is entirely peopled with criminals.
I hope you're not serious...
It's a reference to the movie, "The Princess Bride."
For instance, from here:
http://www.imdb.com/character/ch0003791/quotes
We find this:
"Vizzini: Not remotely. Because iocane comes from Australia, as everyone knows, and Australia is entirely peopled with criminals, and criminals are used to having people not trust them, as you are not trusted by me, so I can clearly not choose the wine in front of you. "
It's supposed to be a joke.
P.S.
I don't really think the ICGA is entirely peopled with criminals either.
But I do not like their handling of the Rybka case.
So for the smiley impaired:
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
BrendanJNorman
Posts: 2583 Joined: Mon Feb 08, 2016 12:43 am
Full name: Brendan J Norman
Post
by BrendanJNorman » Sat Jul 15, 2017 6:41 am
Dann Corbit wrote: BrendanJNorman wrote: Dann Corbit wrote: The main issue, as I see it, is that the ICGA (like Australia ) is entirely peopled with criminals.
I hope you're not serious...
It's a reference to the movie, "The Princess Bride."
For instance, from here:
http://www.imdb.com/character/ch0003791/quotes
We find this:
"Vizzini: Not remotely. Because iocane comes from Australia, as everyone knows, and Australia is entirely peopled with criminals, and criminals are used to having people not trust them, as you are not trusted by me, so I can clearly not choose the wine in front of you. "
It's supposed to be a joke.
P.S.
I don't really think the ICGA is entirely peopled with criminals either.
But I do not like their handling of the Rybka case.
So for the smiley impaired:
I knew you couldn't be serious...
At least HALF of us aren't criminals.
BTW...given the recent political turmoil in the U.S, I've been pondering some things. I wonder if the convicts transported by ship to Australia back in the days - if they were black - would they be labelled as "slaves" now and demanding reparations?
It's an interesting question...
hgm
Posts: 28361 Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller
Post
by hgm » Sat Jul 15, 2017 6:46 am
Dann Corbit wrote: I misremembered you as supporting the ICGA's findings.
Therefore, I do apologize for that.
Thank you, apology accepted! I knew you are a gentleman.
Until such time as they should apologize for the Rybka affair, I would not join the ICGA.
I respect that, but you cannot expect or coerce others to join you in such a crusade. I'll be damned if I let Vas' misbehavior affect my life. Why should I suffer from other people's faults?
I think we see data in a fundamentally different way. It is OK to see things differently.
Apparently so. But I did nothing else than pointing out what the standard analysis of the data tells us. 200-Elo error bars deny a 300-Elo Elo difference with a confidence larger than that of the error bars, and you need 10,000 times fewer games to get 200-Elo error bars than to get 2-Elo error bars of the same confidence.
MonteCarlo
Posts: 188 Joined: Sun Dec 25, 2016 4:59 pm
Post
by MonteCarlo » Sat Jul 15, 2017 6:46 am
@Dann:
Yeah, I would agree with your further points as well.
One minor correction: TCEC 9 did not use 44 cores until after Jonny was gone (just the superfinal).
Jonny "only" had 20 cores to work with in that tournament