GM Anand playing Vs Komodo ( Anand Bot) ?
Moderator: Ras
-
Marcus9
- Posts: 85
- Joined: Mon May 13, 2019 6:05 pm
- Full name: Marco Giorgio
Re: GM Anand playing Vs Komodo ( Anand Bot) ?
If the evaluation of komodo skill 24 on ccrl 40/15 is 2687, what evaluation would have on ccrl 40/2?
-
lkaufman
- Posts: 6279
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
- Full name: Larry Kaufman
Re: GM Anand playing Vs Komodo ( Anand Bot) ?
I haven't yet rated skill 24 at ccrl blitz, but skill 22 came out 2603 CCRL blitz vs 2294 CCRL Rapid based on one five hundred game match. Of this 309 elo gain, 73 was due to the opponent having a higher rating on the blitz list than on the Rapid list (which seems to be normal), the other 236 elo was due to improved performance. This is just as one would expect, since the skill levels plays the same regardless of the time control, while the opposing engine will play much worse in blitz than in Rapid. I'll plan to determine a ccrl blitz rating for skill 24 later, if the elo gain is the same it would come out 2996 CCRL blitz. Against the best human players in blitz I think that skill 22 is the best match, since 23 usually wins in blitz even against Nakamura while 21 is beatable by ordinary GMs sometimes. So with Nakamura at 2884 FIDE blitz this suggests that adding about 280 to CCRL blitz ratings might be about right for conversion to FIDE blitz ratings.
Komodo rules!
-
lkaufman
- Posts: 6279
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
- Full name: Larry Kaufman
Re: GM Anand playing Vs Komodo ( Anand Bot) ?
OK, first result for dragon 2 skill 24 under CCRL blitz (2' + 1" now is the standard) conditions: +160 -190 =150 for a minus 21 elo result against Rybka 2.3.2a 64 bit (one thread), ccrl blitz 2978. That gives a performance of CCRL blitz 2957. Now running same level against Wasp 2 (2945 on that list).
Komodo rules!
-
lkaufman
- Posts: 6279
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
- Full name: Larry Kaufman
Re: GM Anand playing Vs Komodo ( Anand Bot) ?
Final result after 2000 games by Dragon 2 Skill 24 single thread at 2' + 1" (500 each vs Rybka 2.3.2a 64 bit, Wasp 2, Wasp 1.01, and Fruit 2.2.1, average CCRL blitz rating 2887.5) was a 2905 performance. Probably that's close to 3200 on the human FIDE blitz scale, meaning that Carlsen or Nakamura might score about 15% in blitz against it. It was averaging about 33 milliseconds per move, roughly 100 times faster than the normal speed at which a 2' + 1" game would be played. So this suggests that single thread Dragon could give 100 to one time odds (without pondering!) to the world's two top human blitz players and still score about 85%. Or it could give 100 to 1 time odds to Rybka 2.3.2a and score about 40%, which is something given that Rybka 2.3.2a was clearly the world's best engine in 2007, well above the level of any human, able to give pawn odds successfully at serious time limits to famous grandmasters. Incredible progress, no one could have imagined this.
Komodo rules!
-
Marcus9
- Posts: 85
- Joined: Mon May 13, 2019 6:05 pm
- Full name: Marco Giorgio
Re: GM Anand playing Vs Komodo ( Anand Bot) ?
Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
-
Chessqueen
- Posts: 5685
- Joined: Wed Sep 05, 2018 2:16 am
- Location: Moving
- Full name: Jorge Picado
Re: GM Anand playing Vs Komodo ( Anand Bot) ?
Komodo 13.3 is very powerful, even the Free Version of Komodo 12.1 can hold its own against Ethereal, here is a small matchMarcus9 wrote: ↑Fri Aug 27, 2021 5:56 pm Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
I decided to let Ethereal play against Komodo 12.1 and final score for Ethereal is won 3 Lost 4 and Draw 13
Score of Ethereal-pext-avx2 vs komodo-12.1.1-64bit-bmi2: 3 - 4 - 13 [0.475]
... Ethereal-pext-avx2 playing White: 2 - 1 - 7 [0.550] 10
... Ethereal-pext-avx2 playing Black: 1 - 3 - 6 [0.400] 10
... White vs Black: 5 - 2 - 13 [0.575] 20
Elo difference: -17.4 +/- 92.0, LOS: 35.3 %, DrawRatio: 65.0 %
20 of 20 games finished.
-
lkaufman
- Posts: 6279
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
- Full name: Larry Kaufman
Re: GM Anand playing Vs Komodo ( Anand Bot) ?
Dragon 2 does use NNUE in the skill levels, but we reduced the search depth (by one ply in the depth 20 to 23 range) to compensate as well as significantly increasing the degree of randomization. Despite these changes, the skill levels in Dragon 2 are somewhat stronger (at least in the top range, 20 and up) than pre-Dragon (Komodo 14.1), maybe about fifty elo on average.Marcus9 wrote: ↑Fri Aug 27, 2021 5:56 pm Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
Komodo rules!
-
Chessqueen
- Posts: 5685
- Joined: Wed Sep 05, 2018 2:16 am
- Location: Moving
- Full name: Jorge Picado
Re: GM Anand playing Vs Komodo ( Anand Bot) ?
Is it hard to get GM Nkakamura to play versus Dragon 2 at TC 30'+10'" ( 2 pawns odds) or you have to offer a strong GM from India like GM Pentala Harikrishna ?lkaufman wrote: ↑Sat Aug 28, 2021 3:03 amDragon 2 does use NNUE in the skill levels, but we reduced the search depth (by one ply in the depth 20 to 23 range) to compensate as well as significantly increasing the degree of randomization. Despite these changes, the skill levels in Dragon 2 are somewhat stronger (at least in the top range, 20 and up) than pre-Dragon (Komodo 14.1), maybe about fifty elo on average.Marcus9 wrote: ↑Fri Aug 27, 2021 5:56 pm Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
-
lkaufman
- Posts: 6279
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
- Full name: Larry Kaufman
Re: GM Anand playing Vs Komodo ( Anand Bot) ?
I don't think Nakamura would want to replay that match, even with a little more time. Chess.com isn't interested in sponsoring events with long time controls like this, they prefer matches that fall within the "blitz" range. I think that we have convincingly graduated from the two White pawn handicap, although of course I wouldn't turn down a match with a strong GM if we had a sponsor. We could try the same two pawn handicaps but as Black rather than White against a strong GM at normal Rapid (15' + 10"), that might be about fair. But the prime focus for Dragon vs. human matches must be knight odds, with the time limit and the rating of the grandmaster as variables. Beating a "par" (FIDE 2500 or a bit more) GM in a Rapid match or a top GM in a blitz (not bullet) match at knight odds are the two big goals we can realistically hope for in the next couple years.Chessqueen wrote: ↑Sat Aug 28, 2021 4:56 amIs it hard to get GM Nkakamura to play versus Dragon 2 at TC 30'+10'" ( 2 pawns odds) or you have to offer a strong GM from India like GM Pentala Harikrishna ?lkaufman wrote: ↑Sat Aug 28, 2021 3:03 amDragon 2 does use NNUE in the skill levels, but we reduced the search depth (by one ply in the depth 20 to 23 range) to compensate as well as significantly increasing the degree of randomization. Despite these changes, the skill levels in Dragon 2 are somewhat stronger (at least in the top range, 20 and up) than pre-Dragon (Komodo 14.1), maybe about fifty elo on average.Marcus9 wrote: ↑Fri Aug 27, 2021 5:56 pm Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
Komodo rules!
-
jorose
- Posts: 377
- Joined: Thu Jan 22, 2015 3:21 pm
- Location: Zurich, Switzerland
- Full name: Jonathan Rosenthal
Re: GM Anand playing Vs Komodo ( Anand Bot) ?
With Armageddon or standard scoring? Anthony Wirig would have won his match with standard scoring and I think the two categories are separate challenges. In one format you are trying to find the toughest defence and in another it is the toughest defence while keeping the ball in play.lkaufman wrote: ↑Sat Aug 28, 2021 4:41 pmI don't think Nakamura would want to replay that match, even with a little more time. Chess.com isn't interested in sponsoring events with long time controls like this, they prefer matches that fall within the "blitz" range. I think that we have convincingly graduated from the two White pawn handicap, although of course I wouldn't turn down a match with a strong GM if we had a sponsor. We could try the same two pawn handicaps but as Black rather than White against a strong GM at normal Rapid (15' + 10"), that might be about fair. But the prime focus for Dragon vs. human matches must be knight odds, with the time limit and the rating of the grandmaster as variables. Beating a "par" (FIDE 2500 or a bit more) GM in a Rapid match or a top GM in a blitz (not bullet) match at knight odds are the two big goals we can realistically hope for in the next couple years.Chessqueen wrote: ↑Sat Aug 28, 2021 4:56 amIs it hard to get GM Nkakamura to play versus Dragon 2 at TC 30'+10'" ( 2 pawns odds) or you have to offer a strong GM from India like GM Pentala Harikrishna ?lkaufman wrote: ↑Sat Aug 28, 2021 3:03 amDragon 2 does use NNUE in the skill levels, but we reduced the search depth (by one ply in the depth 20 to 23 range) to compensate as well as significantly increasing the degree of randomization. Despite these changes, the skill levels in Dragon 2 are somewhat stronger (at least in the top range, 20 and up) than pre-Dragon (Komodo 14.1), maybe about fifty elo on average.Marcus9 wrote: ↑Fri Aug 27, 2021 5:56 pm Not bad, 33ms is also the time between frames in a 30fps video, in fact the responses seem really instant!
Unfortunately I don't have dragon but only komodo 13, did Dragon use NNUE or it's just "normal" komodo at fixed depth? In the first case I expect the higher levels of Dragon to have had an increase in elo over the pre-Dragon version Otherwise it could use the NNUE net to reach the same force at lower depth and move faster, But I realize that it might be awkward to have versions of komodo where the strength of the levels varies between version and version.
-Jonathan