GM Anand playing Vs Komodo ( Anand Bot) ?

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Marcus9
Posts: 85
Joined: Mon May 13, 2019 6:05 pm
Full name: Marco Giorgio

Re: GM Anand playing Vs Komodo ( Anand Bot) ?

Post by Marcus9 »

If the evaluation of komodo skill 24 on ccrl 40/15 is 2687, what evaluation would have on ccrl 40/2?
lkaufman
Posts: 6279
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: GM Anand playing Vs Komodo ( Anand Bot) ?

Post by lkaufman »

Marcus9 wrote: Thu Aug 26, 2021 1:02 am If the evaluation of komodo skill 24 on ccrl 40/15 is 2687, what evaluation would have on ccrl 40/2?
I haven't yet rated skill 24 at ccrl blitz, but skill 22 came out 2603 CCRL blitz vs 2294 CCRL Rapid based on one five hundred game match. Of this 309 elo gain, 73 was due to the opponent having a higher rating on the blitz list than on the Rapid list (which seems to be normal), the other 236 elo was due to improved performance. This is just as one would expect, since the skill levels plays the same regardless of the time control, while the opposing engine will play much worse in blitz than in Rapid. I'll plan to determine a ccrl blitz rating for skill 24 later, if the elo gain is the same it would come out 2996 CCRL blitz. Against the best human players in blitz I think that skill 22 is the best match, since 23 usually wins in blitz even against Nakamura while 21 is beatable by ordinary GMs sometimes. So with Nakamura at 2884 FIDE blitz this suggests that adding about 280 to CCRL blitz ratings might be about right for conversion to FIDE blitz ratings.
Komodo rules!
lkaufman
Posts: 6279
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: GM Anand playing Vs Komodo ( Anand Bot) ?

Post by lkaufman »

Marcus9 wrote: Thu Aug 26, 2021 1:02 am If the evaluation of komodo skill 24 on ccrl 40/15 is 2687, what evaluation would have on ccrl 40/2?
OK, first result for dragon 2 skill 24 under CCRL blitz (2' + 1" now is the standard) conditions: +160 -190 =150 for a minus 21 elo result against Rybka 2.3.2a 64 bit (one thread), ccrl blitz 2978. That gives a performance of CCRL blitz 2957. Now running same level against Wasp 2 (2945 on that list).
Komodo rules!
lkaufman
Posts: 6279
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: GM Anand playing Vs Komodo ( Anand Bot) ?

Post by lkaufman »

Marcus9 wrote: Thu Aug 26, 2021 1:02 am If the evaluation of komodo skill 24 on ccrl 40/15 is 2687, what evaluation would have on ccrl 40/2?
Final result after 2000 games by Dragon 2 Skill 24 single thread at 2' + 1" (500 each vs Rybka 2.3.2a 64 bit, Wasp 2, Wasp 1.01, and Fruit 2.2.1, average CCRL blitz rating 2887.5) was a 2905 performance. Probably that's close to 3200 on the human FIDE blitz scale, meaning that Carlsen or Nakamura might score about 15% in blitz against it. It was averaging about 33 milliseconds per move, roughly 100 times faster than the normal speed at which a 2' + 1" game would be played. So this suggests that single thread Dragon could give 100 to one time odds (without pondering!) to the world's two top human blitz players and still score about 85%. Or it could give 100 to 1 time odds to Rybka 2.3.2a and score about 40%, which is something given that Rybka 2.3.2a was clearly the world's best engine in 2007, well above the level of any human, able to give pawn odds successfully at serious time limits to famous grandmasters. Incredible progress, no one could have imagined this.
Komodo rules!
Marcus9
Posts: 85
Joined: Mon May 13, 2019 6:05 pm
Full name: Marco Giorgio

Re: GM Anand playing Vs Komodo ( Anand Bot) ?

Post by Marcus9 »

Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
Chessqueen
Posts: 5685
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: GM Anand playing Vs Komodo ( Anand Bot) ?

Post by Chessqueen »

Marcus9 wrote: Fri Aug 27, 2021 5:56 pm Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
Komodo 13.3 is very powerful, even the Free Version of Komodo 12.1 can hold its own against Ethereal, here is a small match :roll:

I decided to let Ethereal play against Komodo 12.1 and final score for Ethereal is won 3 Lost 4 and Draw 13

Score of Ethereal-pext-avx2 vs komodo-12.1.1-64bit-bmi2: 3 - 4 - 13 [0.475]
... Ethereal-pext-avx2 playing White: 2 - 1 - 7 [0.550] 10
... Ethereal-pext-avx2 playing Black: 1 - 3 - 6 [0.400] 10
... White vs Black: 5 - 2 - 13 [0.575] 20
Elo difference: -17.4 +/- 92.0, LOS: 35.3 %, DrawRatio: 65.0 %
20 of 20 games finished.
lkaufman
Posts: 6279
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: GM Anand playing Vs Komodo ( Anand Bot) ?

Post by lkaufman »

Marcus9 wrote: Fri Aug 27, 2021 5:56 pm Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
Dragon 2 does use NNUE in the skill levels, but we reduced the search depth (by one ply in the depth 20 to 23 range) to compensate as well as significantly increasing the degree of randomization. Despite these changes, the skill levels in Dragon 2 are somewhat stronger (at least in the top range, 20 and up) than pre-Dragon (Komodo 14.1), maybe about fifty elo on average.
Komodo rules!
Chessqueen
Posts: 5685
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: GM Anand playing Vs Komodo ( Anand Bot) ?

Post by Chessqueen »

lkaufman wrote: Sat Aug 28, 2021 3:03 am
Marcus9 wrote: Fri Aug 27, 2021 5:56 pm Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
Dragon 2 does use NNUE in the skill levels, but we reduced the search depth (by one ply in the depth 20 to 23 range) to compensate as well as significantly increasing the degree of randomization. Despite these changes, the skill levels in Dragon 2 are somewhat stronger (at least in the top range, 20 and up) than pre-Dragon (Komodo 14.1), maybe about fifty elo on average.
Is it hard to get GM Nkakamura to play versus Dragon 2 at TC 30'+10'" ( 2 pawns odds) or you have to offer a strong GM from India like GM Pentala Harikrishna ?
lkaufman
Posts: 6279
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA
Full name: Larry Kaufman

Re: GM Anand playing Vs Komodo ( Anand Bot) ?

Post by lkaufman »

Chessqueen wrote: Sat Aug 28, 2021 4:56 am
lkaufman wrote: Sat Aug 28, 2021 3:03 am
Marcus9 wrote: Fri Aug 27, 2021 5:56 pm Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
Dragon 2 does use NNUE in the skill levels, but we reduced the search depth (by one ply in the depth 20 to 23 range) to compensate as well as significantly increasing the degree of randomization. Despite these changes, the skill levels in Dragon 2 are somewhat stronger (at least in the top range, 20 and up) than pre-Dragon (Komodo 14.1), maybe about fifty elo on average.
Is it hard to get GM Nkakamura to play versus Dragon 2 at TC 30'+10'" ( 2 pawns odds) or you have to offer a strong GM from India like GM Pentala Harikrishna ?
I don't think Nakamura would want to replay that match, even with a little more time. Chess.com isn't interested in sponsoring events with long time controls like this, they prefer matches that fall within the "blitz" range. I think that we have convincingly graduated from the two White pawn handicap, although of course I wouldn't turn down a match with a strong GM if we had a sponsor. We could try the same two pawn handicaps but as Black rather than White against a strong GM at normal Rapid (15' + 10"), that might be about fair. But the prime focus for Dragon vs. human matches must be knight odds, with the time limit and the rating of the grandmaster as variables. Beating a "par" (FIDE 2500 or a bit more) GM in a Rapid match or a top GM in a blitz (not bullet) match at knight odds are the two big goals we can realistically hope for in the next couple years.
Komodo rules!
jorose
Posts: 377
Joined: Thu Jan 22, 2015 3:21 pm
Location: Zurich, Switzerland
Full name: Jonathan Rosenthal

Re: GM Anand playing Vs Komodo ( Anand Bot) ?

Post by jorose »

lkaufman wrote: Sat Aug 28, 2021 4:41 pm
Chessqueen wrote: Sat Aug 28, 2021 4:56 am
lkaufman wrote: Sat Aug 28, 2021 3:03 am
Marcus9 wrote: Fri Aug 27, 2021 5:56 pm Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
Dragon 2 does use NNUE in the skill levels, but we reduced the search depth (by one ply in the depth 20 to 23 range) to compensate as well as significantly increasing the degree of randomization. Despite these changes, the skill levels in Dragon 2 are somewhat stronger (at least in the top range, 20 and up) than pre-Dragon (Komodo 14.1), maybe about fifty elo on average.
Is it hard to get GM Nkakamura to play versus Dragon 2 at TC 30'+10'" ( 2 pawns odds) or you have to offer a strong GM from India like GM Pentala Harikrishna ?
I don't think Nakamura would want to replay that match, even with a little more time. Chess.com isn't interested in sponsoring events with long time controls like this, they prefer matches that fall within the "blitz" range. I think that we have convincingly graduated from the two White pawn handicap, although of course I wouldn't turn down a match with a strong GM if we had a sponsor. We could try the same two pawn handicaps but as Black rather than White against a strong GM at normal Rapid (15' + 10"), that might be about fair. But the prime focus for Dragon vs. human matches must be knight odds, with the time limit and the rating of the grandmaster as variables. Beating a "par" (FIDE 2500 or a bit more) GM in a Rapid match or a top GM in a blitz (not bullet) match at knight odds are the two big goals we can realistically hope for in the next couple years.
With Armageddon or standard scoring? Anthony Wirig would have won his match with standard scoring and I think the two categories are separate challenges. In one format you are trying to find the toughest defence and in another it is the toughest defence while keeping the ball in play.
-Jonathan