What happend to TCEC?

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Dann Corbit
Posts: 12782
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: What happend to TCEC?

Post by Dann Corbit »

For completeness, here are the ICGA results:

Code: Select all

  Program    Elo    +   -   Games   Score   Av.Op.  Draws 
1 Komodo   : 2942  104  42    15    56.7 %   2895   86.7 %
2 Jonny    : 2913   65  65    15    50.0 %   2913   86.7 %
3 Shredder : 2886   75  75    13    50.0 %   2886   84.6 %
4 Chiron   : 2851   48 119    13    42.3 %   2905   84.6 %
and here are the CEGT results:

Code: Select all

no	Program	Elo	+	-	Games	Score	Av.Op.	Draws
1 	Stockfish 8.0 x64 4CPU 	3414 	15 	15 	1602 	71.0% 	3241 	51.6%
2 	Komodo 11.01 x64 4CPU 	3402 	17 	17 	1332 	71.7% 	3224 	47.3%
3 	Komodo 10.4 x64 4CPU 	3397 	15 	15 	2077 	76.1% 	3174 	41.0%
4 	Houdini 5.0 x64 4CPU 	3380 	15 	15 	1505 	68.1% 	3234 	54.0%
5 	Komodo 10.2 x64 4CPU 	3361 	14 	14 	1785 	70.9% 	3191 	44.8%
6 	Komodo 10.3 x64 4CPU 	3359 	17 	17 	1102 	66.7% 	3229 	52.7%
7 	Komodo 10 x64 4CPU 	3346 	13 	13 	2616 	73.5% 	3150 	42.6%
8 	Komodo 10.1 x64 4CPU 	3346 	19 	19 	1061 	71.8% 	3174 	46.1%
9 	Komodo 9.42 x64 4CPU 	3343 	14 	14 	2001 	73.8% 	3142 	42.6%
10 	Stockfish 7.0 x64 4CPU 	3339 	10 	10 	4221 	67.1% 	3200 	52.6%
11 	Komodo 9.2 x64 4CPU 	3335 	12 	12 	2177 	72.9% 	3145 	42.5%
12 	Komodo 9.3 x64 4CPU 	3323 	16 	16 	1498 	72.1% 	3147 	46.4%
13 	Deep Shredder 13 x64 4CPU 	3225 	12 	12 	2325 	48.7% 	3236 	56.3%
14 	Fizbo 1.9 x64 4CPU 	3207 	13 	13 	2254 	49.0% 	3217 	52.8%
15 	Houdini 4.0 x64 4CPU 	3197 	9 	9 	4649 	49.9% 	3195 	45.6%
16 	Gull 3.0 x64 4CPU 	3186 	8 	8 	6937 	53.5% 	3151 	50.1%
17 	Ginkgo 2.0 x64 4CPU 	3174 	18 	18 	1023 	41.9% 	3239 	57.3%
18 	Andscacs 0.90 x64 4CPU 	3174 	16 	16 	1119 	48.1% 	3190 	55.8%
19 	Andscacs 0.89 x64 4CPU 	3169 	17 	17 	1000 	48.9% 	3177 	55.1%
20 	Jonny 8.00 x64 4CPU 	3157 	14 	14 	1750 	42.1% 	3220 	50.6%
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Dann Corbit
Posts: 12782
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: What happend to TCEC?

Post by Dann Corbit »

CEGT at 40/4:

Code: Select all

no	Program	Elo	+	-	Games	Score	Av.Op.	Draws
1 	Stockfish 8.0 x64 12CPU 	3542 	19 	19 	1750 	66.2% 	3396 	53.6%
2 	Houdini 5.0 x64 12CPU 	3538 	20 	20 	1400 	58.5% 	3467 	64.4%
3 	Komodo 11.01 x64 12CPU 	3515 	29 	29 	400 	51.3% 	3506 	68.5%
4 	Gull 3.0 x64 12CPU 	3247 	12 	12 	2600 	40.5% 	3322 	49.8%
5 	Deep Shredder 13 x64 4CPU 	3245 	14 	14 	1600 	48.0% 	3261 	56.6%
6 	Fizbo 1.9 x64 4CPU 	3214 	18 	18 	1050 	43.0% 	3268 	48.3%
7 	Fire 5 x64 2CPU 	3198 	23 	23 	730 	67.5% 	3046 	39.2%
8 	Fritz 15 x64 12CPU 	3174 	17 	17 	1550 	31.5% 	3329 	38.1%
9 	Ginkgo 1.8 x64 4CPU 	3151 	14 	14 	1700 	44.5% 	3197 	51.1%
10 	Jonny 8.00 x64 4CPU 	3147 	14 	14 	1800 	42.4% 	3208 	46.1%
I think this list is the first one I found.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Dann Corbit
Posts: 12782
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: What happend to TCEC?

Post by Dann Corbit »

This CEGT listing at 40/4 has more core combinations:

Code: Select all

no	Program	Elo	+	-	Games	Score	Av.Op.	Draws
1 	Stockfish 8.0 x64 12CPU 	3542 	19 	19 	1750 	66.2% 	3396 	53.6%
2 	Houdini 5.0 x64 12CPU 	3538 	20 	20 	1400 	58.5% 	3467 	64.4%
3 	Komodo 11.01 x64 12CPU 	3515 	29 	29 	400 	51.3% 	3506 	68.5%
4 	Houdini 5.0 Tac x64 12CPU 	3485 	22 	22 	850 	52.3% 	3463 	55.2%
5 	Komodo 10.3 x64 12CPU 	3484 	23 	23 	650 	56.1% 	3428 	51.2%
6 	Komodo 10.4 x64 12CPU 	3484 	25 	25 	600 	59.8% 	3393 	52.8%
7 	Stockfish 7.0 x64 12CPU 	3459 	14 	14 	2200 	56.5% 	3405 	57.9%
8 	Komodo 10.1 x64 12CPU 	3450 	19 	19 	1050 	69.7% 	3286 	43.0%
9 	Komodo 10.2 x64 12CPU 	3450 	17 	17 	1400 	64.3% 	3330 	48.6%
10 	Komodo 10.0 x64 12CPU 	3435 	18 	18 	1050 	68.7% 	3282 	44.0%
11 	Stockfish TCEC8 x64 12CPU 	3432 	14 	14 	2050 	59.6% 	3356 	56.4%
12 	Komodo 9.42 x64 12CPU 	3424 	17 	17 	1500 	68.5% 	3273 	45.1%
13 	Stockfish 8.0 x64 4CPU 	3417 	20 	20 	1050 	75.7% 	3200 	43.0%
14 	Komodo 9.2 x64 C0 12CPU 	3415 	15 	15 	1600 	60.5% 	3331 	56.7%
15 	Komodo 9.3 x64 12CPU 	3414 	17 	17 	1200 	63.2% 	3308 	48.8%
16 	Komodo 9.1 x64 12CPU 	3404 	19 	19 	1000 	68.2% 	3262 	53.4%
17 	Houdini 5.0 x64 4CPU 	3403 	20 	20 	1050 	72.5% 	3217 	45.6%
18 	Komodo 9.2 x64 12CPU 	3402 	16 	16 	1450 	60.7% 	3318 	51.7%
19 	Komodo 10.4 x64 4CPU 	3396 	22 	22 	950 	73.7% 	3198 	42.3%
20 	Komodo 9.42 x64 4CPU 	3382 	17 	17 	1200 	74.5% 	3181 	35.9%
21 	Komodo 10.0 x64 4CPU 	3380 	19 	19 	1200 	73.6% 	3189 	40.8%
22 	Komodo 9.0 x64 12CPU 	3378 	16 	16 	1150 	61.9% 	3286 	56.0%
23 	Komodo 11.01 x64 2CPU 	3372 	29 	29 	700 	84.6% 	3027 	26.1%
24 	Stockfish 7.0 x64 4CPU 	3370 	15 	15 	1600 	67.3% 	3230 	49.9%
25 	Stockfish 6.0 x64 12CPU 	3362 	11 	11 	2750 	53.4% 	3335 	61.1%
26 	Komodo 9.0 x64 8CPU 	3359 	18 	18 	1000 	63.3% 	3256 	53.8%
27 	Stockfish 8.0 x64 2CPU 	3358 	19 	19 	1430 	79.0% 	3080 	37.3%
28 	Houdini 5.0 x64 2CPU 	3354 	17 	17 	1430 	77.7% 	3088 	36.6%
29 	Stockfish 20170522 x64 1CPU 	3353 	13 	13 	2000 	74.5% 	3146 	43.7%
30 	Stockfish 6.0 x64 8CPU 	3348 	13 	13 	2050 	53.2% 	3322 	59.0%
31 	Komodo 9.3 x64 4CPU 	3340 	15 	15 	1400 	67.7% 	3201 	47.6%
32 	Komodo 9.2 x64 4CPU 	3337 	25 	25 	600 	65.0% 	3223 	47.0%
33 	Stockfish 8.0 x64 1CPU 	3333 	9 	9 	4500 	73.1% 	3138 	44.4%
34 	Komodo 10.3 x64 2CPU 	3330 	17 	17 	1100 	66.1% 	3198 	47.7%
35 	Stockfish 20161222 x64 1CPU 	3330 	16 	16 	1200 	71.2% 	3155 	48.8%
36 	Komodo 10.0 x64 2CPU 	3326 	20 	20 	1200 	79.8% 	3049 	30.7%
37 	Houdini 5.0 x64 1CPU 	3319 	9 	9 	4400 	68.1% 	3169 	49.7%
38 	Komodo 9.0 x64 4CPU 	3315 	14 	14 	1400 	71.3% 	3144 	43.3%
39 	Komodo 10.2 x64 2CPU 	3314 	22 	22 	1030 	80.5% 	3027 	29.2%
40 	Komodo 11.01 x64 1CPU 	3312 	11 	11 	2500 	69.3% 	3155 	44.4%
41 	Komodo 8.0 x64 12CPU 	3312 	12 	12 	2300 	59.6% 	3240 	52.2%
42 	Stockfish 5.0 x64 12CPU 	3310 	14 	14 	1650 	59.4% 	3240 	51.8%
43 	Stockfish 20160716 x64 1CPU 	3307 	14 	14 	2000 	79.0% 	3063 	37.0%
44 	Stockfish 7.0 x64 2CPU 	3305 	15 	15 	1950 	69.0% 	3135 	43.4%
45 	Komodo 9.3 x64 2CPU 	3305 	20 	20 	1250 	79.5% 	3040 	33.3%
46 	Komodo 10.4 x64 1CPU 	3303 	12 	12 	2700 	68.5% 	3153 	45.0%
47 	Stockfish 6.0 x64 4CPU 	3298 	12 	12 	2550 	67.1% 	3140 	46.7%
48 	Komodo 9.2 x64 2CPU 	3298 	19 	19 	1000 	68.0% 	3159 	43.9%
49 	Houdini 5.0 w32 1CPU 	3296 	20 	20 	1100 	80.1% 	3024 	31.4%
50 	Stockfish 8.0 w32 1CPU 	3296 	17 	17 	1300 	79.7% 	3034 	36.4%
51 	Komodo 10.3 x64 1CPU 	3294 	12 	12 	2400 	65.6% 	3169 	48.7%
52 	Stockfish 5.0 x64 8CPU 	3292 	12 	12 	1900 	53.3% 	3267 	53.7%
53 	Komodo 9.0 x64 2CPU 	3289 	17 	17 	1200 	69.5% 	3137 	44.4%
54 	Komodo 8.0 x64 8CPU 	3287 	12 	12 	1900 	57.5% 	3231 	52.2%
55 	Stockfish 6.0 x64 2CPU 	3275 	16 	16 	1600 	63.8% 	3168 	51.3%
56 	Komodo 10.2 x64 1CPU 	3273 	14 	14 	1900 	66.0% 	3148 	48.3%
57 	Komodo 7.0a x64 12CPU 	3271 	21 	21 	650 	53.0% 	3249 	58.9%
58 	Komodo 10.0 x64 1CPU 	3266 	13 	13 	2200 	76.6% 	3047 	34.6%
59 	Komodo 10.1 x64 1CPU 	3266 	12 	12 	2400 	72.7% 	3081 	37.9%
60 	Komodo 9.42 x64 1CPU 	3258 	13 	13 	2000 	74.2% 	3062 	35.9%
61 	Stockfish 7.0 x64 1CPU 	3250 	10 	10 	3700 	69.5% 	3093 	47.2%
62 	Gull 3.0 x64 12CPU 	3247 	12 	12 	2600 	40.5% 	3322 	49.8%
63 	Deep Shredder 13 x64 4CPU 	3245 	14 	14 	1600 	48.0% 	3261 	56.6%
64 	Houdini 4.0 x64 12CPU 	3245 	12 	12 	2500 	40.5% 	3319 	43.5%
65 	Komodo 7.0a x64 8CPU 	3244 	18 	18 	900 	51.2% 	3234 	52.2%
66 	Stockfish 5.0 x64 4CPU 	3238 	10 	10 	4300 	71.2% 	3045 	38.5%
67 	Komodo 8.0 x64 4CPU 	3236 	11 	11 	3350 	74.7% 	3009 	33.2%
68 	Houdini 4.0 x64 8CPU 	3234 	12 	12 	2100 	44.9% 	3271 	44.1%
69 	Houdini 3.0 x64 12CPU 	3233 	19 	19 	850 	37.8% 	3327 	47.4%
70 	Komodo 9.3 x64 1CPU 	3225 	11 	11 	3100 	69.5% 	3070 	43.0%
71 	Gull 3.0 x64 8CPU 	3223 	17 	17 	1000 	50.0% 	3223 	52.5%
72 	Komodo 10.2 w32 1CPU 	3218 	18 	18 	1200 	71.0% 	3045 	38.6%
73 	Stockfish 7.0 w32 1CPU 	3217 	17 	17 	1400 	75.6% 	2994 	39.4%
74 	Houdini 4.0 x64 4CPU 	3217 	9 	9 	5950 	58.5% 	3131 	36.1%
75 	Komodo 8.0 x64 2CPU 	3216 	16 	16 	1300 	59.4% 	3145 	49.6%
76 	Komodo 9.2 x64 1CPU 	3216 	10 	10 	2900 	70.5% 	3051 	42.2%
77 	Houdini 4.0 Tac x64 12CPU 	3215 	17 	17 	1600 	30.9% 	3371 	38.0%
78 	Fizbo 1.9 x64 4CPU 	3214 	18 	18 	1050 	43.0% 	3268 	48.3%
79 	Komodo 7.0a x64 4CPU 	3212 	14 	14 	1450 	56.7% 	3159 	44.8%
80 	Houdini 3.0 x64 4CPU 	3210 	11 	11 	4100 	79.6% 	2939 	29.2%
81 	Komodo 10.0 w32 1CPU 	3207 	21 	21 	800 	73.7% 	3012 	36.1%
82 	Deep Shredder 13 x64 2CPU 	3206 	12 	12 	2000 	57.3% 	3150 	49.9%
83 	Komodo 9.1 x64 1CPU 	3205 	11 	11 	2900 	72.6% 	3016 	40.4%
84 	Stockfish 5.0 x64 2CPU 	3202 	15 	15 	1350 	61.8% 	3110 	49.3%
85 	Stockfish 6.0 x64 1CPU 	3201 	9 	9 	3900 	60.4% 	3119 	50.7%
86 	Komodo 9.0 x64 1CPU 	3200 	14 	14 	2000 	76.8% 	2973 	35.6%
87 	Fire 5 x64 2CPU 	3198 	23 	23 	730 	67.5% 	3046 	39.2%
88 	Stockfish DD x64 4CPU 	3192 	12 	12 	3050 	71.6% 	3000 	37.0%
89 	Houdini 4.0 x64 2CPU 	3191 	10 	10 	3500 	59.6% 	3108 	38.0%
90 	Komodo TCEC x64 4CPU 	3186 	17 	17 	1000 	66.3% 	3061 	40.5%
91 	Gull 3.0 x64 4CPU 	3183 	7 	7 	6700 	54.2% 	3139 	44.2%
92 	Komodo 9.3 w32 1CPU 	3180 	19 	19 	900 	71.8% 	3006 	39.9%
93 	Stockfish 6.0 w32 1CPU 	3177 	11 	11 	2700 	72.7% 	2992 	41.3%
94 	Fritz 15 x64 12CPU 	3174 	17 	17 	1550 	31.5% 	3329 	38.1%
95 	Komodo 9.2 w32 1CPU 	3173 	17 	17 	1200 	67.2% 	3038 	43.4%
96 	Houdini 3.0 x64 2CPU 	3168 	13 	13 	1800 	72.9% 	2981 	33.8%
97 	Gull 2.8 beta x64 4CPU 	3166 	18 	18 	1000 	63.0% 	3067 	42.3%
98 	Houdini 2.0c x64 4CPU 	3160 	11 	11 	3200 	78.7% 	2903 	28.2%
99 	Stockfish 5.0 x64 1CPU 	3159 	10 	10 	4150 	60.6% 	3073 	43.3%
100 	Komodo 7.0a x64 2CPU 	3154 	16 	16 	1050 	57.4% 	3098 	44.1%
101 	Fizbo 1.9 x64 2CPU 	3153 	17 	17 	1380 	59.0% 	3076 	40.4%
102 	Deep Shredder 13 x64 1CPU 	3153 	9 	9 	4550 	53.7% 	3123 	45.7%
103 	Ginkgo 1.8 x64 4CPU 	3151 	14 	14 	1700 	44.5% 	3197 	51.1%
104 	Jonny 8.00 x64 4CPU 	3147 	14 	14 	1800 	42.4% 	3208 	46.1%
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Dann Corbit
Posts: 12782
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: What happend to TCEC?

Post by Dann Corbit »

BTW,
I like HGM just fine.
We both go over the top when debating these life and death topics.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
BrendanJNorman
Posts: 2583
Joined: Mon Feb 08, 2016 12:43 am
Full name: Brendan J Norman

Re: What happend to TCEC?

Post by BrendanJNorman »

Dann Corbit wrote: The main issue, as I see it, is that the ICGA (like Australia) is entirely peopled with criminals.
I hope you're not serious...
User avatar
Graham Banks
Posts: 44375
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: What happend to TCEC?

Post by Graham Banks »

BrendanJNorman wrote:
Dann Corbit wrote: The main issue, as I see it, is that the ICGA (like Australia) is entirely peopled with criminals.
I hope you're not serious...
:lol:
gbanksnz at gmail.com
Dann Corbit
Posts: 12782
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: What happend to TCEC?

Post by Dann Corbit »

BrendanJNorman wrote:
Dann Corbit wrote: The main issue, as I see it, is that the ICGA (like Australia) is entirely peopled with criminals.
I hope you're not serious...
It's a reference to the movie, "The Princess Bride."

For instance, from here:
http://www.imdb.com/character/ch0003791/quotes

We find this:
"Vizzini: Not remotely. Because iocane comes from Australia, as everyone knows, and Australia is entirely peopled with criminals, and criminals are used to having people not trust them, as you are not trusted by me, so I can clearly not choose the wine in front of you. "

It's supposed to be a joke.
P.S.
I don't really think the ICGA is entirely peopled with criminals either.
But I do not like their handling of the Rybka case.

So for the smiley impaired:
;-)
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
BrendanJNorman
Posts: 2583
Joined: Mon Feb 08, 2016 12:43 am
Full name: Brendan J Norman

Re: What happend to TCEC?

Post by BrendanJNorman »

Dann Corbit wrote:
BrendanJNorman wrote:
Dann Corbit wrote: The main issue, as I see it, is that the ICGA (like Australia) is entirely peopled with criminals.
I hope you're not serious...
It's a reference to the movie, "The Princess Bride."

For instance, from here:
http://www.imdb.com/character/ch0003791/quotes

We find this:
"Vizzini: Not remotely. Because iocane comes from Australia, as everyone knows, and Australia is entirely peopled with criminals, and criminals are used to having people not trust them, as you are not trusted by me, so I can clearly not choose the wine in front of you. "

It's supposed to be a joke.
P.S.
I don't really think the ICGA is entirely peopled with criminals either.
But I do not like their handling of the Rybka case.

So for the smiley impaired:
;-)
I knew you couldn't be serious...

At least HALF of us aren't criminals. :lol:

BTW...given the recent political turmoil in the U.S, I've been pondering some things. I wonder if the convicts transported by ship to Australia back in the days - if they were black - would they be labelled as "slaves" now and demanding reparations?

It's an interesting question...
User avatar
hgm
Posts: 28361
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: What happend to TCEC?

Post by hgm »

Dann Corbit wrote:I misremembered you as supporting the ICGA's findings.
Therefore, I do apologize for that.
Thank you, apology accepted! I knew you are a gentleman.
Until such time as they should apologize for the Rybka affair, I would not join the ICGA.
I respect that, but you cannot expect or coerce others to join you in such a crusade. I'll be damned if I let Vas' misbehavior affect my life. Why should I suffer from other people's faults?
I think we see data in a fundamentally different way. It is OK to see things differently.
Apparently so. But I did nothing else than pointing out what the standard analysis of the data tells us. 200-Elo error bars deny a 300-Elo Elo difference with a confidence larger than that of the error bars, and you need 10,000 times fewer games to get 200-Elo error bars than to get 2-Elo error bars of the same confidence.
MonteCarlo
Posts: 188
Joined: Sun Dec 25, 2016 4:59 pm

Re: What happend to TCEC?

Post by MonteCarlo »

@Dann:

Yeah, I would agree with your further points as well.

One minor correction: TCEC 9 did not use 44 cores until after Jonny was gone (just the superfinal).

Jonny "only" had 20 cores to work with in that tournament :)