Question for Engines testers ?

Discussion of computer chess matches and engine tournaments.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Chessqueen
Posts: 624
Joined: Wed Sep 05, 2018 12:16 am
Full name: Nancy M Pichardo

Question for Engines testers ?

Post by Chessqueen » Wed Nov 07, 2018 3:57 pm

I saw that GM Nakamura drew Versus Komodo on the Internet https://www.chess.com/article/view/naka ... odds-match, and I am curious as what old program with what strength based on the CCR rating list could draw versus Komodo playing the same position. Here it is 3. Exchange odds: Komodo as White, Nakamura as Black, a1 rook removed, b8 knight removed, Black rook on b8, White to move. since you have many many experience testing engines vs engines what old engines do you believe could draw vs Komodo, for example you can say Fritz 10 or Fritz 11. Lets do some testing and find out !
[D] 1rbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/1NBQKBNR w KQkq - 0 1

lkaufman
Posts: 3724
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: Question for Engines testers ?

Post by lkaufman » Wed Nov 07, 2018 5:04 pm

The result depends on the time limit, but in general Komodo does surprisingly well giving material handicaps to weaker engines. I would think that it will take a rather strong modern engine to score 50% at some moderately rapid time control against Komodo at this Exhange odds handicap.
Komodo rules!

Chessqueen
Posts: 624
Joined: Wed Sep 05, 2018 12:16 am
Full name: Nancy M Pichardo

Re: Question for Engines testers ?

Post by Chessqueen » Thu Nov 08, 2018 2:44 am

lkaufman wrote:
Wed Nov 07, 2018 5:04 pm
The result depends on the time limit, but in general Komodo does surprisingly well giving material handicaps to weaker engines. I would think that it will take a rather strong modern engine to score 50% at some moderately rapid time control against Komodo at this Exhange odds handicap.
Since you said that, it seems that you have done several testing versus weaker programs such as Fritz 10, SF7 or Fritz 16 Vs your latest Komodo version, can you post some of your testing games also using this position in which GM Nakamura played vs Komodo:

[D]rnbqkbnr/pp1pp1pp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1

Final question, what are the chances of GM Hou Yifan to win vs Komodo with a Knight odd. You probably will end up paying her half the prize or money that you pay GM Nakamura to play vs Komodo.

Uri Blass
Posts: 8594
Joined: Wed Mar 08, 2006 11:37 pm
Location: Tel-Aviv Israel

Re: Question for Engines testers ?

Post by Uri Blass » Thu Nov 08, 2018 5:42 am

Chessqueen wrote:
Thu Nov 08, 2018 2:44 am
lkaufman wrote:
Wed Nov 07, 2018 5:04 pm
The result depends on the time limit, but in general Komodo does surprisingly well giving material handicaps to weaker engines. I would think that it will take a rather strong modern engine to score 50% at some moderately rapid time control against Komodo at this Exhange odds handicap.
Since you said that, it seems that you have done several testing versus weaker programs such as Fritz 10, SF7 or Fritz 16 Vs your latest Komodo version, can you post some of your testing games also using this position in which GM Nakamura played vs Komodo:

[D]rnbqkbnr/pp1pp1pp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1

Final question, what are the chances of GM Hou Yifan to win vs Komodo with a Knight odd. You probably will end up paying her half the prize or money that you pay GM Nakamura to play vs Komodo.
For the last question it dependent on the time control but I expect every GM to win easily vs komodo with a knight odd if you do not use a very fast time control.

Chessqueen
Posts: 624
Joined: Wed Sep 05, 2018 12:16 am
Full name: Nancy M Pichardo

Re: Question for Engines testers ?

Post by Chessqueen » Thu Nov 08, 2018 8:32 am

Uri Blass wrote:
Thu Nov 08, 2018 5:42 am
Chessqueen wrote:
Thu Nov 08, 2018 2:44 am
lkaufman wrote:
Wed Nov 07, 2018 5:04 pm
The result depends on the time limit, but in general Komodo does surprisingly well giving material handicaps to weaker engines. I would think that it will take a rather strong modern engine to score 50% at some moderately rapid time control against Komodo at this Exhange odds handicap.
Since you said that, it seems that you have done several testing versus weaker programs such as Fritz 10, SF7 or Fritz 16 Vs your latest Komodo version, can you post some of your testing games also using this position in which GM Nakamura played vs Komodo:

[D]rnbqkbnr/pp1pp1pp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1

Final question, what are the chances of GM Hou Yifan to win vs Komodo with a Knight odd. You probably will end up paying her half the prize or money that you pay GM Nakamura to play vs Komodo.
For the last question it dependent on the time control but I expect every GM to win easily vs komodo with a knight odd if you do not use a very fast time control.
Lets say GM Hou Yifan vs Komodo or Fritz 10 Vs Komodo game in 5 Minutes Blitz ?

tpoppins
Posts: 919
Joined: Tue Nov 24, 2015 8:11 pm
Location: upstate

Re: Question for Engines testers ?

Post by tpoppins » Thu Nov 08, 2018 4:44 pm

Since CCRL has been mentioned...

Four games mimicking CCRL testing conditions:
TC: 40/2 (CCRL's 40/4 equivalent on this hardware)
5-men EGTBs
512 MB hash
Threads=1
Fritz 15 x64 GUI

1) Deep Fritz 14 64-bit (AKA Pandix) 3077 Elo
2) Rybka 4 64-bit 3101 Elo
3) Spike 1.4 Leiden 2921 Elo
4) Fritz 11 2887 Elo



Too bad Cute Chess won't accept the FEN, I have hundreds of engines installed in it compared to a couple dozen in Fritz. The earliest Fritz version I got installed is Fritz 11, though.
Tirsa Poppins
CCRL

Chessqueen
Posts: 624
Joined: Wed Sep 05, 2018 12:16 am
Full name: Nancy M Pichardo

Re: Question for Engines testers ?

Post by Chessqueen » Thu Nov 08, 2018 8:27 pm

Komodo 12.2 is amazingly strong at this time control, and I came to the conclusion that Komodo 12.2 could give GM Hou Yifan or even fritz 11 a Knight odd and it would be very very hard to beat; since CCRL rating of 2880-2900 for Fritz 11 is comparable to 2658-2690 in Human FIDE.
[D]rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/R1BQKBNR w KQkq - 0 1

https://www.youtube.com/watch?v=oKfrqpu95xk

https://www.youtube.com/watch?v=RW-RwYvRX5M

Chessqueen
Posts: 624
Joined: Wed Sep 05, 2018 12:16 am
Full name: Nancy M Pichardo

Re: Question for Engines testers ?

Post by Chessqueen » Thu Nov 08, 2018 9:05 pm

This is how I concluded that CCRL rating in computer is about a difference of 200 to human FIDE, therefore GM Nakamura highest FIDE rating is about 2819 which translate to Deep Fritz 14.
https://www.youtube.com/watch?v=gEsFEKOcJWI

Chessqueen
Posts: 624
Joined: Wed Sep 05, 2018 12:16 am
Full name: Nancy M Pichardo

Re: Question for Engines testers ?

Post by Chessqueen » Thu Nov 08, 2018 10:53 pm

Chessqueen wrote:
Thu Nov 08, 2018 8:32 am
Uri Blass wrote:
Thu Nov 08, 2018 5:42 am
Chessqueen wrote:
Thu Nov 08, 2018 2:44 am
lkaufman wrote:
Wed Nov 07, 2018 5:04 pm
The result depends on the time limit, but in general Komodo does surprisingly well giving material handicaps to weaker engines. I would think that it will take a rather strong modern engine to score 50% at some moderately rapid time control against Komodo at this Exhange odds handicap.
Since you said that, it seems that you have done several testing versus weaker programs such as Fritz 10, SF7 or Fritz 16 Vs your latest Komodo version, can you post some of your testing games also using this position in which GM Nakamura played vs Komodo:

[D]rnbqkbnr/pp1pp1pp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1

Final question, what are the chances of GM Hou Yifan to win vs Komodo with a Knight odd. You probably will end up paying her half the prize or money that you pay GM Nakamura to play vs Komodo.
For the last question it dependent on the time control but I expect every GM to win easily vs komodo with a knight odd if you do not use a very fast time control.
Lets say GM Hou Yifan vs Komodo or Fritz 10 Vs Komodo game in 45 Minutes ?
I meant to write game in 45 minutes, not in Blitz 5 minutes.
https://www.youtube.com/watch?v=gEsFEKOcJWI

Chessqueen
Posts: 624
Joined: Wed Sep 05, 2018 12:16 am
Full name: Nancy M Pichardo

Re: Question for Engines testers ?

Post by Chessqueen » Fri Nov 09, 2018 5:21 am

tpoppins wrote:
Thu Nov 08, 2018 4:44 pm
Since CCRL has been mentioned...

Four games mimicking CCRL testing conditions:
TC: 40/2 (CCRL's 40/4 equivalent on this hardware)
5-men EGTBs
512 MB hash
Threads=1
Fritz 15 x64 GUI

1) Deep Fritz 14 64-bit (AKA Pandix) 3077 Elo
2) Rybka 4 64-bit 3101 Elo
3) Spike 1.4 Leiden 2921 Elo
4) Fritz 11 2887 Elo

Try Fritz15 as well, but anyway I am convinced that Komodo can easily take any GM rated between 2650 thru 2700 with a Knight odd.

Post Reply