Komodo TCEC 64-bit Gauntlet for CCRL 40/40

PaulieD · Post by **PaulieD** » Wed Dec 18, 2013 3:07 pm

ouachita wrote:
PaulieD wrote:. . . the author's who's engines are only good at very LTC speak primarily of that and how "it" is the primary way in chess. . .

The top three are so close . . .
These two statements are inconsistent, unreasonable and unfair, because, as you have said, "The top three are so close". Indeed, they are reasonably close at all TC.

Another expression of the practical relevance of testing is to run a 50 game match/test with white at 1+1 TC and black at 40/120. What would you guess the cross table will look like?

Ok, on one hand I was talking about what the authors say, and on the other I was talking about how close I know the engines (2 different things) are in strength...this is certainly not unfair. The rest that you have extracted and implied here does not make any sense.
Have a good day my friend..I do have other things to do..

ouachita · Post by **ouachita** » Wed Dec 18, 2013 3:22 pm

PaulieD wrote:The rest that you have extracted and implied here does not make any sense.

Sure it does: Although I use an extreme illustration, TC are the, or a, primary determinant of match results.

PaulieD · Post by **PaulieD** » Wed Dec 18, 2013 3:36 pm

Yes, of course, but not 1+1 vs 40/120

ouachita · Post by **ouachita** » Wed Dec 18, 2013 5:25 pm

. . . and, btw, if Paul or anyone here ever takes any of my posts as any kind of subjective, personal attack, I apologize in advance as that is certainly not my intention.

beram · Post by **beram** » Wed Dec 18, 2013 6:55 pm

Komodo 6TCEC now at +60%
And I have put the SF DD results under it as well

Code: Select all

RANK	ENGINE	GAMES	POINTS
-----	-----------------------------------	---------------	-----------
1.	KOMODO TCEC 64-BIT	80	48,5
2.	STOCKFISH DD 64-BIT	6	3.5
3.	CRITTER 1.6A 64-BIT	6	3.0
4.	RYBKA 4.1 64-BIT	6	3.0
5.	BOUQUET 1.8 64-BIT	6	3.0
6.	HOUDINI 4 64-BIT	6	2.5
7.	DEEPSAROS 4.1.3C 64-BIT	4	2.5
8.	CHIRON 2 64-BIT	6	2.0
9.	GULL 2.3 64-BIT	6	2.0
10.	HANNIBAL 1.4B 64-BIT	6	2.0
11.	PROTECTOR 1.5.0 64-BIT	6	2.0
12.	STRELKA 5.5 64-BIT	6	1.5
13.	FIRE 3.0 64-BIT	6	1.5
14.	BLACKMAMBA 1.4 64-BIT	6	1.5
15.	VITRUVIUS 1.11C 64-BIT	4	1.5
			
Total	games = 80	60,63%	
			
RANK	ENGINE	GAMES	POINTS
-----	-----------------------------------	---------------	-----------
1.	HOUDINI 4 64-BIT	212	144
2.	STOCKFISH DD 64-BIT	16	8.0
3.	CRITTER 1.6A 64-BIT	16	6.5
4.	STRELKA 5.5 64-BIT	16	6.0
5.	KOMODO 6 64-BIT	16	5.5
6.	BOUQUET 1.8 64-BIT	16	5.5
7.	VITRUVIUS 1.11C 64-BIT	14	5.5
8.	RYBKA 4.1 64-BIT	16	5.0
9.	BLACKMAMBA 1.4 64-BIT	16	4.5
10.	FIRE 3.0 64-BIT	14	4.5
11.	CHIRON 2 64-BIT	14	4.0
12.	DEEPSAROS 4.1.3C 64-BIT	14	4.0
13.	GULL 2.3 64-BIT	16	3.5
14.	PROTECTOR 1.5.0 64-BIT	14	3.5
15.	HANNIBAL 1.4B 64-BIT	14	2.0
			
Total	games = 212	67,92%	
			
RANK	ENGINE	GAMES	POINTS
-----	-----------------------------------	---------------	-----------
1.	STOCKFISH DD 64-BIT	89	58
2.	HOUDINI 4 64-BIT	16	8.0
3.	KOMODO TCEC 64-BIT	6	3.5
4.	STRELKA 5.5 64-BIT	6	3.0
5.	CRITTER 1.6A 64-BIT	6	3.0
6.	GULL 2.3 64-BIT	6	2.5
7.	RYBKA 4.1 64-BIT	6	2.0
8.	CHIRON 2 64-BIT	6	1.5
9.	BLACKMAMBA 1.4 64-BIT	6	1.5
10.	FIRE 3.0 64-BIT	6	1.5
11.	DEEPSAROS 4.1.3C 64-BIT	4	1.5
12.	BOUQUET 1.8 64-BIT	6	1.0
13.	HANNIBAL 1.4B 64-BIT	6	1.0
14.	PROTECTOR 1.5.0 64-BIT	5	1.0
15.	VITRUVIUS 1.11C 64-BIT	4	1.0
			
Total	games = 89	65,17%

PaulieD · Post by **PaulieD** » Wed Dec 18, 2013 9:26 pm

ouachita wrote:. . . and, btw, if Paul or anyone here ever takes any of my posts as any kind of subjective, personal attack, I apologize in advance as that is certainly not my intention.

Merry Christmas Bobby,

I like the "banter"...lol

beram · Post by **beram** » Thu Dec 19, 2013 8:37 pm

It kind of stabilizes. Komodo 6TCEC around 60- 61%, Houdini 4 around 68% and SFDD 66-67%
The difference in performance between Komodo 6 TCEC and Houdini 4 is about 7%
In CEGT 5m3s pure list, it is 6,8 % performance difference (81,5 for H4 and 74,8% for K6t against 23 same opponents)
http://www.husvankempen.de/nunn/5Plus3R ... liste.html

I know there are more games needed to be sure, but trend is becoming obvious. Houdini for example is around 68% from game 50 till 226 now

Code: Select all

RANK	ENGINE	GAMES	POINTS
-----	-----------------------------------	---------------	-----------
1.	KOMODO TCEC 64-BIT	94	57
2.	STOCKFISH DD 64-BIT	8	4.5
3.	CRITTER 1.6A 64-BIT	8	4.5
4.	DEEPSAROS 4.1.3C 64-BIT	6	3.5
5.	HOUDINI 4 64-BIT	8	3.0
6.	RYBKA 4.1 64-BIT	6	3.0
7.	BOUQUET 1.8 64-BIT	6	3.0
8.	STRELKA 5.5 64-BIT	8	2.5
9.	CHIRON 2 64-BIT	8	2.0
10.	GULL 2.3 64-BIT	6	2.0
11.	HANNIBAL 1.4B 64-BIT	6	2.0
12.	PROTECTOR 1.5.0 64-BIT	6	2.0
13.	VITRUVIUS 1.11C 64-BIT	6	2.0
14.	FIRE 3.0 64-BIT	6	1.5
15.	BLACKMAMBA 1.4 64-BIT	6	1.5
			
Total	games = 94	60,64%	

RANK	ENGINE	GAMES	POINTS
-----	-----------------------------------	---------------	-----------
1.	HOUDINI 4 64-BIT	226	153,5
2.	STOCKFISH DD 64-BIT	16	8.0
3.	KOMODO 6 64-BIT	18	6.5
4.	CRITTER 1.6A 64-BIT	16	6.5
5.	STRELKA 5.5 64-BIT	16	6.0
6.	VITRUVIUS 1.11C 64-BIT	16	6.0
7.	BOUQUET 1.8 64-BIT	16	5.5
8.	CHIRON 2 64-BIT	16	5.5
9.	RYBKA 4.1 64-BIT	16	5.0
10.	FIRE 3.0 64-BIT	16	5.0
11.	BLACKMAMBA 1.4 64-BIT	16	4.5
12.	DEEPSAROS 4.1.3C 64-BIT	16	4.5
13.	GULL 2.3 64-BIT	16	3.5
14.	PROTECTOR 1.5.0 64-BIT	16	3.5
15.	HANNIBAL 1.4B 64-BIT	16	2.5
			
Total	games = 226	67,92%	

RANK	ENGINE	GAMES	POINTS
-----	-----------------------------------	---------------	-----------
1.	STOCKFISH DD 64-BIT	104	69
	HOUDINI 4 64-BIT	16	8.0
	KOMODO TCEC 64-BIT	8	3.5
2.	STRELKA 5.5 64-BIT	8	3.5
3.	CRITTER 1.6A 64-BIT	8	3.0
4.	RYBKA 4.1 64-BIT	8	2.5
5.	GULL 2.3 64-BIT	6	2.5
6.	DEEPSAROS 4.1.3C 64-BIT	6	2.0
7.	CHIRON 2 64-BIT	8	1.5
8.	BLACKMAMBA 1.4 64-BIT	6	1.5
9.	FIRE 3.0 64-BIT	6	1.5
10.	VITRUVIUS 1.11C 64-BIT	6	1.5
11.	BOUQUET 1.8 64-BIT	6	1.0
12.	HANNIBAL 1.4B 64-BIT	6	1.0
13.	PROTECTOR 1.5.0 64-BIT	6	1.0
			
Total	games = 104	66,35%

beram · Post by **beram** » Sat Dec 21, 2013 10:33 am

Things have altered a bit for Houdini 4
I have replaced its games against Komodo 6 where its score was pretty good for games against Komodo 6TCEC, against which it is doing not so well. So H4 performance has lowered 1%
Difference between Houdini 4 and SFDD is minimal 0,14 % (66,94% and 66,81%) while there is a gap of 6% between those two and Komodo 6TCEC (60,96%)
Noticably Komodo 6TCEC scores pretty well against Houdini 4

I predict for CCRL 40/40 tomorrow after two years of Houdini domination, SF DD (4cpu) - the new leader

Code: Select all

RANK	ENGINE	GAMES	POINTS
-----	-----------------------------------
1.	KOMODO TCEC 64-BIT	114	69,5
2.	STOCKFISH DD 64-BIT	10	6.0
3.	CRITTER 1.6A 64-BIT	8	4.5
4.	BOUQUET 1.8 64-BIT	8	4.0
5.	DEEPSAROS 4.1.3C 64-BIT	8	4.0
6.	HOUDINI 4 64-BIT	8	3.0
7.	RYBKA 4.1 64-BIT	8	3.0
8.	VITRUVIUS 1.11C 64-BIT	8	3.0
9.	STRELKA 5.5 64-BIT	8	2.5
10.	FIRE 3.0 64-BIT	8	2.5
11.	BLACKMAMBA 1.4 64-BIT	8	2.5
12.	GULL 2.3 64-BIT	8	2.5
13.	HANNIBAL 1.4B 64-BIT	8	2.5
14.	PROTECTOR 1.5.0 64-BIT	8	2.5
15.	CHIRON 2 64-BIT	8	2.0

Total games = 114 = 60,96%

Code: Select all

			
RANK	ENGINE	GAMES	POINTS
------	---------------------------------
1.	HOUDINI 4 64-BIT	236	158
2.	STOCKFISH DD 64-BIT	18	9.0
3.	CRITTER 1.6A 64-BIT	18	7.0
4.	KOMODO 6 TCEC 64-BIT*	8	5
5.	STRELKA 5.5 64-BIT	18	6.5
6.	BOUQUET 1.8 64-BIT	18	6.5
7.	CHIRON 2 64-BIT	18	6.0
8.	VITRUVIUS 1.11C 64-BIT	16	6.0
9.	RYBKA 4.1 64-BIT	18	5.5
10.	BLACKMAMBA 1.4 64-BIT	18	5.0
11.	FIRE 3.0 64-BIT	16	5.0
12.	DEEPSAROS 4.1.3C 64-BIT	16	4.5
13.	GULL 2.3 64-BIT	18	4.0
14.	HANNIBAL 1.4B 64-BIT	18	4.0
15.	PROTECTOR 1.5.0 64-BIT	18	4.0

Total games 246 = 66,95%

Code: Select all

			
RANK	ENGINE	GAMES	POINTS
-----	-----------------------------------
1.	STOCKFISH DD 64-BIT	119	79,5
	HOUDINI 4 64-BIT	10	5
	KOMODO 6TCEC 64-BIT	10	4
2.	STRELKA 5.5 64-BIT	10	4.5
3.	CRITTER 1.6A 64-BIT	9	4.0
4.	DEEPSAROS 4.1.3C 64-BIT	8	3.5
5.	RYBKA 4.1 64-BIT	8	2.5
6.	BLACKMAMBA 1.4 64-BIT	8	2.5
7.	FIRE 3.0 64-BIT	8	2.5
8.	GULL 2.3 64-BIT	8	2.5
9.	BOUQUET 1.8 64-BIT	8	2.0
10.	VITRUVIUS 1.11C 64-BIT	8	2.0
11.	CHIRON 2 64-BIT	8	1.5
12.	HANNIBAL 1.4B 64-BIT	8	1.5
13.	PROTECTOR 1.5.0 64-BIT	8	1.5

Total games 119 = 66,81%

beram · Post by **beram** » Wed Jan 01, 2014 10:54 pm

After over 261 games against same competition in 40/40 1CPU Komodo TCEC still 61-62% while for Houdini 4 score has lowered to 65-66 %
Stockfish DD is now best with 66,49%

Komodo TCEC 61,49%
Houdini 4 65,14%
Stockfish DD 66,49%

Code: Select all

RANK	ENGINE	GAMES	POINTS	1
-------	------------------------------------------
1.	KOMODO TCEC 64-BIT	261	160,5	********************
2.	STOCKFISH DD 64-BIT	20	11.0	==01=1011===========
3.	DEEPSAROS 4.1.3C 64-BIT	18	10.5	=101===001=1=110=1..
4.	CRITTER 1.6A 64-BIT	19	10.0	0==1===1=1=1===0==0.
5.	HOUDINI 4 64-BIT	20	8.5	0==1=00=0===01===10=
6.	BOUQUET 1.8 64-BIT	18	8.0	1===0=====00==1=0=..
7.	STRELKA 5.5 64-BIT	20	7.5	0=1000==0===0===1=0=
8.	RYBKA 4.1 64-BIT	18	7.0	======001===0010=0..
9.	FIRE 3.0 64-BIT	18	6.5	=0==00==0=0=======..
10.	GULL 2.3 64-BIT	18	6.0	=00===0=0=====0==0..
11.	PROTECTOR 1.5.0 64-BIT	18	6.0	0===0==0==0===0001..
12.	VITRUVIUS 1.11C 64-BIT	18	5.5	==0=0===0===0=000=..
13.	HANNIBAL 1.4B 64-BIT	18	5.0	0===0=0==00=0=0=0=..
14.	CHIRON 2 64-BIT	20	4.5	0===0=0000000=000=1=
15.	BLACKMAMBA 1.4 64-BIT	18	4.5	==0=00==0=00===000..

Total games = 261 61,49%

Code: Select all

RANK	ENGINE	GAMES	POINTS	1
-------	------------------------------------------
1.	HOUDINI 4 64-BIT	393	256	*****************************
2.	STOCKFISH DD 64-BIT	28	15.5	=101==0==101=0=====1==0111==.
3.	CRITTER 1.6A 64-BIT	28	14.0	==0=0=0=101=0===0=1=11110===.
4.	STRELKA 5.5 64-BIT	28	10.5	0=0===1===0=0=0=0======0==0=.
5.	KOMODO 6TCEC 64-BIT*	29	11.5*	10=10=000=0=0===100======0=00
6.	RYBKA 4.1 64-BIT	28	10.0	0==0=001===000==0=1==00=0011.
7.	BOUQUET 1.8 64-BIT	28	10.0	=0=0==0==00===1001==0=0100==.
8.	BLACKMAMBA 1.4 64-BIT	28	9.0	==00==00===00==0=0====000=1=.
9.	VITRUVIUS 1.11C 64-BIT	28	9.0	==0====001==0==0000=0=00====.
10.	DEEPSAROS 4.1.3C 64-BIT	28	9.0	==0=000==00====0=0010==0==01.
11.	CHIRON 2 64-BIT	28	8.5	0==00==0001=0==10==00==0==00.
12.	FIRE 3.0 64-BIT	28	8.5	00==0=====0==00=0===00=00=01.
13.	GULL 2.3 64-BIT	28	8.0	000==0000===0=0==0=====0===0.
14.	PROTECTOR 1.5.0 64-BIT	28	7.5	0===00==0000==000=0===00==10.
15.	HANNIBAL 1.4B 64-BIT	28	6.0	0=0000000=0==00=1==000===000.

Total games = 393 65,14%

Code: Select all

RANK	ENGINE	GAMES	POINTS	1
-------	------------------------------------------	
1.	STOCKFISH DD 64-BIT	282	187,5	**********************
	HOUDINI 4 64-BIT*	20	9	
	KOMODO 6TCEC 64-BIT*	20	9	
2.	CRITTER 1.6A 64-BIT	20	10.0	=0=1==001=1=========..
3.	STRELKA 5.5 64-BIT	22	9.5	==0==1=0===0010=======
4.	BOUQUET 1.8 64-BIT	20	7.0	=00=00==00=0====011=..
5.	BLACKMAMBA 1.4 64-BIT	20	7.0	00==0===00=1010===0=..
6.	FIRE 3.0 64-BIT	20	7.0	000============0==00..
7.	DEEPSAROS 4.1.3C 64-BIT	20	7.0	==0=0==10001=00==0==..
8.	RYBKA 4.1 64-BIT	20	6.0	==0=0==000000==101=0..
9.	VITRUVIUS 1.11C 64-BIT	20	6.0	=00=0=0==0===0=000=1..
10.	GULL 2.3 64-BIT	20	5.0	==0===00=00=00=00=0=..
11.	HANNIBAL 1.4B 64-BIT	20	4.5	000=0==00=0===000==0..
12.	PROTECTOR 1.5.0 64-BIT	20	4.0	==00000=00=0==00==00..
13.	CHIRON 2 64-BIT	20	3.5	00==0=000=0=000=000=..

Total games = 282 66,49%

mwyoung · Post by **mwyoung** » Thu Jan 02, 2014 12:10 am

beram wrote:Things have altered a bit for Houdini 4
I have replaced its games against Komodo 6 where its score was pretty good for games against Komodo 6TCEC, against which it is doing not so well. So H4 performance has lowered 1%
Difference between Houdini 4 and SFDD is minimal 0,14 % (66,94% and 66,81%) while there is a gap of 6% between those two and Komodo 6TCEC (60,96%)
Noticably Komodo 6TCEC scores pretty well against Houdini 4

I predict for CCRL 40/40 tomorrow after two years of Houdini domination, SF DD (4cpu) - the new leader

Code: Select all

RANK	ENGINE	GAMES	POINTS
-----	-----------------------------------
1.	KOMODO TCEC 64-BIT	114	69,5
2.	STOCKFISH DD 64-BIT	10	6.0
3.	CRITTER 1.6A 64-BIT	8	4.5
4.	BOUQUET 1.8 64-BIT	8	4.0
5.	DEEPSAROS 4.1.3C 64-BIT	8	4.0
6.	HOUDINI 4 64-BIT	8	3.0
7.	RYBKA 4.1 64-BIT	8	3.0
8.	VITRUVIUS 1.11C 64-BIT	8	3.0
9.	STRELKA 5.5 64-BIT	8	2.5
10.	FIRE 3.0 64-BIT	8	2.5
11.	BLACKMAMBA 1.4 64-BIT	8	2.5
12.	GULL 2.3 64-BIT	8	2.5
13.	HANNIBAL 1.4B 64-BIT	8	2.5
14.	PROTECTOR 1.5.0 64-BIT	8	2.5
15.	CHIRON 2 64-BIT	8	2.0

Total games = 114 = 60,96%

Code: Select all

			
RANK	ENGINE	GAMES	POINTS
------	---------------------------------
1.	HOUDINI 4 64-BIT	236	158
2.	STOCKFISH DD 64-BIT	18	9.0
3.	CRITTER 1.6A 64-BIT	18	7.0
4.	KOMODO 6 TCEC 64-BIT*	8	5
5.	STRELKA 5.5 64-BIT	18	6.5
6.	BOUQUET 1.8 64-BIT	18	6.5
7.	CHIRON 2 64-BIT	18	6.0
8.	VITRUVIUS 1.11C 64-BIT	16	6.0
9.	RYBKA 4.1 64-BIT	18	5.5
10.	BLACKMAMBA 1.4 64-BIT	18	5.0
11.	FIRE 3.0 64-BIT	16	5.0
12.	DEEPSAROS 4.1.3C 64-BIT	16	4.5
13.	GULL 2.3 64-BIT	18	4.0
14.	HANNIBAL 1.4B 64-BIT	18	4.0
15.	PROTECTOR 1.5.0 64-BIT	18	4.0

Total games 246 = 66,95%

Code: Select all

			
RANK	ENGINE	GAMES	POINTS
-----	-----------------------------------
1.	STOCKFISH DD 64-BIT	119	79,5
	HOUDINI 4 64-BIT	10	5
	KOMODO 6TCEC 64-BIT	10	4
2.	STRELKA 5.5 64-BIT	10	4.5
3.	CRITTER 1.6A 64-BIT	9	4.0
4.	DEEPSAROS 4.1.3C 64-BIT	8	3.5
5.	RYBKA 4.1 64-BIT	8	2.5
6.	BLACKMAMBA 1.4 64-BIT	8	2.5
7.	FIRE 3.0 64-BIT	8	2.5
8.	GULL 2.3 64-BIT	8	2.5
9.	BOUQUET 1.8 64-BIT	8	2.0
10.	VITRUVIUS 1.11C 64-BIT	8	2.0
11.	CHIRON 2 64-BIT	8	1.5
12.	HANNIBAL 1.4B 64-BIT	8	1.5
13.	PROTECTOR 1.5.0 64-BIT	8	1.5

Total games 119 = 66,81%

My testing agrees with that conclusion, I guess you will wait for the next official release before testing the stronger versions of stockfish?

Nice work Stockfish team if they do take the top spot on your list.

Komodo TCEC 64-bit Gauntlet for CCRL 40/40

Re: Komodo TCEC 64-bit Gauntlet for CCRL 40/40

Re: Komodo TCEC 64-bit Gauntlet for CCRL 40/40

Re: Komodo TCEC 64-bit Gauntlet for CCRL 40/40

Re: Komodo TCEC 64-bit Gauntlet for CCRL 40/40

Re: Komodo TCEC 64-bit Gauntlet for CCRL 40/40

Re: Komodo TCEC 64-bit Gauntlet for CCRL 40/40

Re: Komodo TCEC 64-bit Gauntlet for CCRL 40/40

Re: Komodo TCEC 64-bit Gauntlet for CCRL 40/40

Re: Komodo TCEC 64-bit Gauntlet for CCRL 40/40

Re: Komodo TCEC 64-bit Gauntlet for CCRL 40/40