UCI_Elo 1500 engines and FIDE Elo

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: UCI_Elo 1500 engines and FIDE Elo

Post by Ferdy »

wheelman wrote: Wed Apr 21, 2021 7:21 pm I have an off-topic question if you don't mind. How do you get Delfi 5.4 to play at 1500 ELO? Do you have a version different from the free version? Thank you.
Delfi supports UCI_Elo and UCI_LimitStrength

Code: Select all

; Delfi 5.4 - Winboard/UCI chess engine [MMX version]
uci
id name Delfi 5.4
id author Fabio Cavicchio
option name Hash type spin default 16 min 2 max 128
option name UCI_Elo type spin default 2600 min 1000 max 2600
option name UCI_LimitStrength type check default false
uciok
So you can do:
setoption name UCI_LimitStrength value true
setoption name UCI_Elo value 1500

I get delfi.zip from here.
Carlos777
Posts: 1728
Joined: Sun Dec 13, 2009 6:09 pm

Re: UCI_Elo 1500 engines and FIDE Elo

Post by Carlos777 »

Ferdy wrote: Wed Apr 21, 2021 7:47 pm
wheelman wrote: Wed Apr 21, 2021 7:21 pm I have an off-topic question if you don't mind. How do you get Delfi 5.4 to play at 1500 ELO? Do you have a version different from the free version? Thank you.
Delfi supports UCI_Elo and UCI_LimitStrength

Code: Select all

; Delfi 5.4 - Winboard/UCI chess engine [MMX version]
uci
id name Delfi 5.4
id author Fabio Cavicchio
option name Hash type spin default 16 min 2 max 128
option name UCI_Elo type spin default 2600 min 1000 max 2600
option name UCI_LimitStrength type check default false
uciok
So you can do:
setoption name UCI_LimitStrength value true
setoption name UCI_Elo value 1500

I get delfi.zip from here.
From the readme in Delfi:

Code: Select all

Easy levels:
To set a easy level modify the file Delfi.ini, (standard version
is limited to 1000 ELO or full strength).
Thanks KLc and Guenther!
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: UCI_Elo 1500 engines and FIDE Elo

Post by MikeB »

lkaufman wrote: Wed Apr 21, 2021 6:24 am
MikeB wrote: Tue Apr 20, 2021 5:25 pm
Ferdy wrote: Tue Apr 20, 2021 12:02 pm Maia Lichess 1546 has a blitz Lichess rating of around 1546. This engine is run with maia-1100.pb.gz net at node 1 on a gauntlet test below.

The formula to get FIDE Elo from Lichess Blitz Elo is,

Code: Select all

FIDE rating = 65 + [0.87 x Lichess Blitz Rating]
based from the regression in 2019.

Maia FIDE Elo = 65 + 0.87 x 1546 = 1410

Maia gauntlet bullet at TC 60s+100ms and is set at FIDE Elo 1410.

Code: Select all

   # Player                                    :  FIDE Elo  Points  Played  Points(%)
   1 Rybka v2.3.2a UCI_Elo 1500                :      2217    99.0     100       99.0
   2 Minic 2.51 UCI_Elo 1500                   :      2145    98.5     100       98.5
   3 Cheese 2.1 UCI_Elo 1500                   :      2094    98.0     100       98.0
   4 Honey X5i UCI_Elo 1500                    :      2054    97.5     100       97.5
   5 Cheng 4.39 UCI_Elo 1500                   :      2054    97.5     100       97.5
   6 Ufim v8.02 UCI_Elo 1500                   :      2021    97.0     100       97.0
   7 Amyan 1.72 UCI_Elo 1500                   :      1910    94.5     100       94.5
   8 Wasp 4.5 UCI_Elo 1500                     :      1840    92.0     100       92.0
   9 MadChess 3.0 UCI_Elo 1500                 :      1817    91.0     100       91.0
  10 Deuterium v2021.1.38.29.4 UCI_Elo 1500    :      1753    87.5     100       87.5
  11 Rhetoric 1.4.3 UCI_Elo 1500               :      1737    86.5     100       86.5
  12 Discocheck 5.2 UCI_Elo 1500               :      1730    86.0     100       86.0
  13 Arasan 21.1 UCI_Elo 1500                  :      1716    85.0     100       85.0
  14 Rodent IV 022 UCI_Elo 1500                :      1716    85.0     100       85.0
  15 Deuterium v2019.2.37.73 UCI_Elo 1500      :      1599    74.5     100       74.5
  16 Danasah 7.9 UCI_Elo 1500                  :      1599    74.5     100       74.5
  17 Stockfish 13 UCI_Elo 1500                 :      1539    67.5     100       67.5
  18 Hiarcs 14 UCI_Elo 1500                    :      1449    55.5     100       55.5
  19 Maia Lichess 1546                         :      1410   312.5    1900       16.4
  20 Deuterium v2014.2.33.276 UCI_Elo 1500     :      1171    20.5     100       20.5
The closest engines at FIDE Elo 1500 within 100 Elo are Stockfish, Hiarcs, Maia, Danasah and Deuterium v2019.2.37.73.
Looks like several engines are tuning to CCRL 1500 which is significantly stronger than 1500 FIDE . about 1890 +/- 100
Does this last sentence mean that on average, an engine with a CCRL blitz rating of 1500 should be an even match for a human with a FIDE rating of about 1890 if they are playing blitz chess? If so what is the time limit assumed for the human vs engine match? I suppose it is based on the average blitz game played between humans and engines on Lichess, is that correct? If so can you estimate the average time limit of such human vs engine games? Time limit makes a huge difference in engine vs human play; a human might be hundreds of elo stronger against engines at game in ten minutes than at game in three minutes. This estimate of about four hundred elo gap between CCRL and FIDE ratings in blitz might be about right at some time control in that range.
I discovered this prior to LiChess became big, but yes I am talking Blitz Chess - around 3 3 maybe. I' am a 1600 player, and few years, when playing Shadow Blue ( about 1700 CCRL) for calibrating my Honey engines, - I realized immediately that it was not 1700 USCF, SO I dug deeper and came across this post with a lot of good info

http://talkchess.com/forum3/viewtopic.p ... 2&#p661409

So in my Honey Engines I let the user to choose CCRL (for the programmers) or FIDE ( for humans).

Convert CCRL to FIDE:

(CCRL-Ra * 10) / 7) - 1200 = FIDE-RA

Convert FIDE to CCRL:

(FIDE-Ra+1200)*7/10=CCRL-Ra

.. at 2800 , they are about the same ... (2800 *10 /7 ) - 1200 = 2800

Most my Elo testing of engines have been around 3 3. I don't play well faster than that ,and longer times control take too long for me.

(note any number i state above could easily be off a hundred Elo either way - Was never looking for greater precision, just ball park #'s.
Image
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: UCI_Elo 1500 engines and FIDE Elo

Post by Ferdy »

Carlos777 wrote: Thu Apr 22, 2021 3:19 am
Ferdy wrote: Wed Apr 21, 2021 7:47 pm
wheelman wrote: Wed Apr 21, 2021 7:21 pm I have an off-topic question if you don't mind. How do you get Delfi 5.4 to play at 1500 ELO? Do you have a version different from the free version? Thank you.
Delfi supports UCI_Elo and UCI_LimitStrength

Code: Select all

; Delfi 5.4 - Winboard/UCI chess engine [MMX version]
uci
id name Delfi 5.4
id author Fabio Cavicchio
option name Hash type spin default 16 min 2 max 128
option name UCI_Elo type spin default 2600 min 1000 max 2600
option name UCI_LimitStrength type check default false
uciok
So you can do:
setoption name UCI_LimitStrength value true
setoption name UCI_Elo value 1500

I get delfi.zip from here.
From the readme in Delfi:

Code: Select all

Easy levels:
To set a easy level modify the file Delfi.ini, (standard version
is limited to 1000 ELO or full strength).
Thanks for this info, I will remove Delfi in the list then.
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: UCI_Elo 1500 engines and FIDE Elo

Post by lkaufman »

MikeB wrote: Thu Apr 22, 2021 5:09 am
lkaufman wrote: Wed Apr 21, 2021 6:24 am
MikeB wrote: Tue Apr 20, 2021 5:25 pm
Ferdy wrote: Tue Apr 20, 2021 12:02 pm Maia Lichess 1546 has a blitz Lichess rating of around 1546. This engine is run with maia-1100.pb.gz net at node 1 on a gauntlet test below.

The formula to get FIDE Elo from Lichess Blitz Elo is,

Code: Select all

FIDE rating = 65 + [0.87 x Lichess Blitz Rating]
based from the regression in 2019.

Maia FIDE Elo = 65 + 0.87 x 1546 = 1410

Maia gauntlet bullet at TC 60s+100ms and is set at FIDE Elo 1410.

Code: Select all

   # Player                                    :  FIDE Elo  Points  Played  Points(%)
   1 Rybka v2.3.2a UCI_Elo 1500                :      2217    99.0     100       99.0
   2 Minic 2.51 UCI_Elo 1500                   :      2145    98.5     100       98.5
   3 Cheese 2.1 UCI_Elo 1500                   :      2094    98.0     100       98.0
   4 Honey X5i UCI_Elo 1500                    :      2054    97.5     100       97.5
   5 Cheng 4.39 UCI_Elo 1500                   :      2054    97.5     100       97.5
   6 Ufim v8.02 UCI_Elo 1500                   :      2021    97.0     100       97.0
   7 Amyan 1.72 UCI_Elo 1500                   :      1910    94.5     100       94.5
   8 Wasp 4.5 UCI_Elo 1500                     :      1840    92.0     100       92.0
   9 MadChess 3.0 UCI_Elo 1500                 :      1817    91.0     100       91.0
  10 Deuterium v2021.1.38.29.4 UCI_Elo 1500    :      1753    87.5     100       87.5
  11 Rhetoric 1.4.3 UCI_Elo 1500               :      1737    86.5     100       86.5
  12 Discocheck 5.2 UCI_Elo 1500               :      1730    86.0     100       86.0
  13 Arasan 21.1 UCI_Elo 1500                  :      1716    85.0     100       85.0
  14 Rodent IV 022 UCI_Elo 1500                :      1716    85.0     100       85.0
  15 Deuterium v2019.2.37.73 UCI_Elo 1500      :      1599    74.5     100       74.5
  16 Danasah 7.9 UCI_Elo 1500                  :      1599    74.5     100       74.5
  17 Stockfish 13 UCI_Elo 1500                 :      1539    67.5     100       67.5
  18 Hiarcs 14 UCI_Elo 1500                    :      1449    55.5     100       55.5
  19 Maia Lichess 1546                         :      1410   312.5    1900       16.4
  20 Deuterium v2014.2.33.276 UCI_Elo 1500     :      1171    20.5     100       20.5
The closest engines at FIDE Elo 1500 within 100 Elo are Stockfish, Hiarcs, Maia, Danasah and Deuterium v2019.2.37.73.
Looks like several engines are tuning to CCRL 1500 which is significantly stronger than 1500 FIDE . about 1890 +/- 100
Does this last sentence mean that on average, an engine with a CCRL blitz rating of 1500 should be an even match for a human with a FIDE rating of about 1890 if they are playing blitz chess? If so what is the time limit assumed for the human vs engine match? I suppose it is based on the average blitz game played between humans and engines on Lichess, is that correct? If so can you estimate the average time limit of such human vs engine games? Time limit makes a huge difference in engine vs human play; a human might be hundreds of elo stronger against engines at game in ten minutes than at game in three minutes. This estimate of about four hundred elo gap between CCRL and FIDE ratings in blitz might be about right at some time control in that range.
I discovered this prior to LiChess became big, but yes I am talking Blitz Chess - around 3 3 maybe. I' am a 1600 player, and few years, when playing Shadow Blue ( about 1700 CCRL) for calibrating my Honey engines, - I realized immediately that it was not 1700 USCF, SO I dug deeper and came across this post with a lot of good info

http://talkchess.com/forum3/viewtopic.p ... 2&#p661409

So in my Honey Engines I let the user to choose CCRL (for the programmers) or FIDE ( for humans).

Convert CCRL to FIDE:

(CCRL-Ra * 10) / 7) - 1200 = FIDE-RA

Convert FIDE to CCRL:

(FIDE-Ra+1200)*7/10=CCRL-Ra

.. at 2800 , they are about the same ... (2800 *10 /7 ) - 1200 = 2800

Most my Elo testing of engines have been around 3 3. I don't play well faster than that ,and longer times control take too long for me.

(note any number i state above could easily be off a hundred Elo either way - Was never looking for greater precision, just ball park #'s.
Your CCRL to FIDE conversion formula looks about right if you are assuming that the games are played at standard time limits like 40 moves in 2 hours or so, since the scales were designed to be about the same at 2800 level based on standard games between World Champions and top engines nearly twenty years ago. But in blitz (say 3' + 3") a 2800 CCRL blitz engine would win nearly every game from the top humans with 2800+ FIDE ratings (standard,rapid, or blitz ratings), we know this from multiple sources. So if these are blitz ratings, the formula is way off; 2800 FIDE is maybe something like 2300 CCRL blitz (my estimate). Can you clarify this point?
Komodo rules!
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: UCI_Elo 1500 engines and FIDE Elo

Post by MikeB »

lkaufman wrote: Thu Apr 22, 2021 7:04 pm
MikeB wrote: Thu Apr 22, 2021 5:09 am
lkaufman wrote: Wed Apr 21, 2021 6:24 am
MikeB wrote: Tue Apr 20, 2021 5:25 pm
Ferdy wrote: Tue Apr 20, 2021 12:02 pm Maia Lichess 1546 has a blitz Lichess rating of around 1546. This engine is run with maia-1100.pb.gz net at node 1 on a gauntlet test below.

The formula to get FIDE Elo from Lichess Blitz Elo is,

Code: Select all

FIDE rating = 65 + [0.87 x Lichess Blitz Rating]
based from the regression in 2019.

Maia FIDE Elo = 65 + 0.87 x 1546 = 1410

Maia gauntlet bullet at TC 60s+100ms and is set at FIDE Elo 1410.

Code: Select all

   # Player                                    :  FIDE Elo  Points  Played  Points(%)
   1 Rybka v2.3.2a UCI_Elo 1500                :      2217    99.0     100       99.0
   2 Minic 2.51 UCI_Elo 1500                   :      2145    98.5     100       98.5
   3 Cheese 2.1 UCI_Elo 1500                   :      2094    98.0     100       98.0
   4 Honey X5i UCI_Elo 1500                    :      2054    97.5     100       97.5
   5 Cheng 4.39 UCI_Elo 1500                   :      2054    97.5     100       97.5
   6 Ufim v8.02 UCI_Elo 1500                   :      2021    97.0     100       97.0
   7 Amyan 1.72 UCI_Elo 1500                   :      1910    94.5     100       94.5
   8 Wasp 4.5 UCI_Elo 1500                     :      1840    92.0     100       92.0
   9 MadChess 3.0 UCI_Elo 1500                 :      1817    91.0     100       91.0
  10 Deuterium v2021.1.38.29.4 UCI_Elo 1500    :      1753    87.5     100       87.5
  11 Rhetoric 1.4.3 UCI_Elo 1500               :      1737    86.5     100       86.5
  12 Discocheck 5.2 UCI_Elo 1500               :      1730    86.0     100       86.0
  13 Arasan 21.1 UCI_Elo 1500                  :      1716    85.0     100       85.0
  14 Rodent IV 022 UCI_Elo 1500                :      1716    85.0     100       85.0
  15 Deuterium v2019.2.37.73 UCI_Elo 1500      :      1599    74.5     100       74.5
  16 Danasah 7.9 UCI_Elo 1500                  :      1599    74.5     100       74.5
  17 Stockfish 13 UCI_Elo 1500                 :      1539    67.5     100       67.5
  18 Hiarcs 14 UCI_Elo 1500                    :      1449    55.5     100       55.5
  19 Maia Lichess 1546                         :      1410   312.5    1900       16.4
  20 Deuterium v2014.2.33.276 UCI_Elo 1500     :      1171    20.5     100       20.5
The closest engines at FIDE Elo 1500 within 100 Elo are Stockfish, Hiarcs, Maia, Danasah and Deuterium v2019.2.37.73.
Looks like several engines are tuning to CCRL 1500 which is significantly stronger than 1500 FIDE . about 1890 +/- 100
Does this last sentence mean that on average, an engine with a CCRL blitz rating of 1500 should be an even match for a human with a FIDE rating of about 1890 if they are playing blitz chess? If so what is the time limit assumed for the human vs engine match? I suppose it is based on the average blitz game played between humans and engines on Lichess, is that correct? If so can you estimate the average time limit of such human vs engine games? Time limit makes a huge difference in engine vs human play; a human might be hundreds of elo stronger against engines at game in ten minutes than at game in three minutes. This estimate of about four hundred elo gap between CCRL and FIDE ratings in blitz might be about right at some time control in that range.
I discovered this prior to LiChess became big, but yes I am talking Blitz Chess - around 3 3 maybe. I' am a 1600 player, and few years, when playing Shadow Blue ( about 1700 CCRL) for calibrating my Honey engines, - I realized immediately that it was not 1700 USCF, SO I dug deeper and came across this post with a lot of good info

http://talkchess.com/forum3/viewtopic.p ... 2&#p661409

So in my Honey Engines I let the user to choose CCRL (for the programmers) or FIDE ( for humans).

Convert CCRL to FIDE:

(CCRL-Ra * 10) / 7) - 1200 = FIDE-RA

Convert FIDE to CCRL:

(FIDE-Ra+1200)*7/10=CCRL-Ra

.. at 2800 , they are about the same ... (2800 *10 /7 ) - 1200 = 2800

Most my Elo testing of engines have been around 3 3. I don't play well faster than that ,and longer times control take too long for me.

(note any number i state above could easily be off a hundred Elo either way - Was never looking for greater precision, just ball park #'s.
Your CCRL to FIDE conversion formula looks about right if you are assuming that the games are played at standard time limits like 40 moves in 2 hours or so, since the scales were designed to be about the same at 2800 level based on standard games between World Champions and top engines nearly twenty years ago. But in blitz (say 3' + 3") a 2800 CCRL blitz engine would win nearly every game from the top humans with 2800+ FIDE ratings (standard,rapid, or blitz ratings), we know this from multiple sources. So if these are blitz ratings, the formula is way off; 2800 FIDE is maybe something like 2300 CCRL blitz (my estimate). Can you clarify this point?
ok, to clarify, the formula was for was for standard games/time controls. I see what you are saying.
Image
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: UCI_Elo 1500 engines and FIDE Elo

Post by MikeB »

I never played Maia Lichess before and your post inspired me to give it a try.

I would call this one "never give up", I had the advantage , threw it away, , almost resigned, and thought well maybe I can get a draw since Maia does not play endings well at all , and yes, then Maia threw the game back to me at the end,

[pgn][Event "Rated Blitz game"]
[Site "https://lichess.org/mhOXln2R"]
[Date "2021.04.23"]
[White "MichaelB7"]
[Black "maia1"]
[Result "1-0"]
[UTCDate "2021.04.23"]
[UTCTime "03:30:27"]
[WhiteElo "1538"]
[BlackElo "1534"]
[WhiteRatingDiff "+22"]
[BlackRatingDiff "-5"]
[BlackTitle "BOT"]
[Variant "Standard"]
[TimeControl "60+10"]
[ECO "C34"]
[Opening "King's Gambit Accepted: Schallopp Defense"]
[Termination "Normal"]
[Annotator "lichess.org"]

1. e4 { [%clk 0:01:00] } 1... e5 { [%clk 0:01:00] } 2. f4 { [%clk 0:01:08] } 2... exf4 { [%clk 0:01:10] } 3. Nf3 { [%clk 0:01:16] } 3... Nf6 { [%clk 0:01:18] } { C34 King's Gambit Accepted: Schallopp Defense } 4. Bc4 { [%clk 0:01:15] } 4... Nxe4 { [%clk 0:01:28] } 5. Bxf7+ { [%clk 0:01:19] } 5... Kxf7 { [%clk 0:01:36] } 6. Ne5+ { [%clk 0:01:25] } 6... Ke8 { [%clk 0:01:44] } 7. Qh5+ { [%clk 0:01:31] } 7... g6 { [%clk 0:01:51] } 8. Nxg6 { [%clk 0:01:38] } 8... Nf6 { [%clk 0:01:57] } 9. Qe5+ { [%clk 0:01:22] } 9... Be7 { [%clk 0:02:00] } 10. Nxh8 { [%clk 0:01:17] } 10... d6 { [%clk 0:02:07] } 11. Qxf4 { [%clk 0:01:12] } 11... Kd7 { [%clk 0:02:16] } 12. Nf7 { [%clk 0:01:11] } 12... Qf8 { [%clk 0:02:22] } 13. Ng5 { [%clk 0:00:51] } 13... Nd5 { [%clk 0:02:29] } 14. Qg4+ { [%clk 0:00:43] } 14... Kd8 { [%clk 0:02:32] } 15. Qg3 { [%clk 0:00:11] } 15... Bxg5 { [%clk 0:02:39] } 16. Qxg5+ { [%clk 0:00:19] } 16... Ne7 { [%clk 0:02:46] } 17. d3 { [%clk 0:00:24] } 17... Nc6 { [%clk 0:02:50] } 18. Rf1 { [%clk 0:00:30] } 18... Qe8 { [%clk 0:02:54] } 19. Nc3 { [%clk 0:00:35] } 19... Nd4 { [%clk 0:02:57] } 20. Qd2 { [%clk 0:00:15] } 20... Nef5+ { [%clk 0:03:04] } 21. Ne2 { [%clk 0:00:23] } 21... Nxe2 { [%clk 0:03:10] } 22. Qxe2 { [%clk 0:00:31] } 22... Qxe2+ { [%clk 0:03:17] } 23. Kxe2 { [%clk 0:00:39] } 23... Nd4+ { [%clk 0:03:21] } 24. Kf2 { [%clk 0:00:41] } 24... Nxc2 { [%clk 0:03:29] } 25. Rb1 { [%clk 0:00:49] } 25... Bf5 { [%clk 0:03:36] } 26. Bg5+ { [%clk 0:00:53] } 26... Kd7 { [%clk 0:03:44] } 27. Kg1 { [%clk 0:01:00] } 27... Bxd3 { [%clk 0:03:51] } 28. Rf7+ { [%clk 0:01:08] } 28... Kc6 { [%clk 0:03:52] } 29. Rc1 { [%clk 0:01:17] } 29... Re8 { [%clk 0:03:58] } 30. h3 { [%clk 0:01:22] } 30... Re1+ { [%clk 0:03:59] } 31. Rxe1 { [%clk 0:01:29] } 31... Nxe1 { [%clk 0:04:05] } 32. Rxh7 { [%clk 0:01:36] } 32... Bxh7 { [%clk 0:04:10] } 33. Kf2 { [%clk 0:01:08] } 33... Nd3+ { [%clk 0:04:15] } 34. Ke3 { [%clk 0:01:16] } 34... Nxb2 { [%clk 0:04:20] } 35. g4 { [%clk 0:01:21] } 35... Nc4+ { [%clk 0:04:26] } 36. Kd4 { [%clk 0:01:29] } 36... Ne5 { [%clk 0:04:29] } 37. Bf6 { [%clk 0:01:36] } 37... Nf3+ { [%clk 0:04:32] } 38. Ke3 { [%clk 0:01:41] } 38... Ng1 { [%clk 0:04:40] } 39. h4 { [%clk 0:01:48] } 39... Nh3 { [%clk 0:04:43] } 40. g5 { [%clk 0:01:52] } 40... Bg6 { [%clk 0:04:49] } 41. Bd4 { [%clk 0:01:40] } 41... Kd5 { [%clk 0:04:54] } 42. Bxa7 { [%clk 0:01:35] } 42... c5 { [%clk 0:04:59] } 43. a4 { [%clk 0:01:34] } 43... c4 { [%clk 0:05:03] } 44. Kf3 { [%clk 0:01:35] } 44... c3 { [%clk 0:05:09] } 45. Kg3 { [%clk 0:01:36] } 45... c2 { [%clk 0:05:15] } 46. Be3 { [%clk 0:01:43] } 46... Bf5 { [%clk 0:05:19] } 47. g6 { [%clk 0:01:47] } 47... Bxg6 { [%clk 0:05:25] } 48. Kxh3 { [%clk 0:01:56] } 48... Ke4 { [%clk 0:05:29] } 49. Bc1 { [%clk 0:01:56] } 49... Kd3 { [%clk 0:05:32] } 50. Kg4 { [%clk 0:02:05] } 50... Ke2 { [%clk 0:05:34] } 51. h5 { [%clk 0:02:13] } 51... Kd1 { [%clk 0:05:35] } 52. Bg5 { [%clk 0:02:14] } 52... c1=Q { [%clk 0:05:37] } 53. Bxc1 { [%clk 0:02:23] } 53... Kxc1 { [%clk 0:05:40] } 54. hxg6 { [%clk 0:02:31] } 54... d5 { [%clk 0:05:44] } 55. g7 { [%clk 0:02:38] } 55... d4 { [%clk 0:05:50] } 56. g8=Q { [%clk 0:02:45] } 56... d3 { [%clk 0:05:53] } 57. Qc4+ { [%clk 0:02:44] } 57... Kd2 { [%clk 0:05:57] } 58. Kf3 { [%clk 0:02:48] } 58... Ke1 { [%clk 0:06:00] } 59. Ke3 { [%clk 0:02:44] } 59... d2 { [%clk 0:06:08] } 60. Qc3 { [%clk 0:02:51] } 60... Kd1 { [%clk 0:06:13] } 61. Qxd2# { [%clk 0:02:49] } { White wins by checkmate. } 1-0[/pgn]
Image
User avatar
pedrox
Posts: 1056
Joined: Fri Mar 10, 2006 6:07 am
Location: Basque Country (Spain)

Re: UCI_Elo 1500 engines and FIDE Elo

Post by pedrox »

MikeB wrote: Thu Apr 22, 2021 5:09 am
lkaufman wrote: Wed Apr 21, 2021 6:24 am
MikeB wrote: Tue Apr 20, 2021 5:25 pm
Ferdy wrote: Tue Apr 20, 2021 12:02 pm Maia Lichess 1546 has a blitz Lichess rating of around 1546. This engine is run with maia-1100.pb.gz net at node 1 on a gauntlet test below.

The formula to get FIDE Elo from Lichess Blitz Elo is,

Code: Select all

FIDE rating = 65 + [0.87 x Lichess Blitz Rating]
based from the regression in 2019.

Maia FIDE Elo = 65 + 0.87 x 1546 = 1410

Maia gauntlet bullet at TC 60s+100ms and is set at FIDE Elo 1410.

Code: Select all

   # Player                                    :  FIDE Elo  Points  Played  Points(%)
   1 Rybka v2.3.2a UCI_Elo 1500                :      2217    99.0     100       99.0
   2 Minic 2.51 UCI_Elo 1500                   :      2145    98.5     100       98.5
   3 Cheese 2.1 UCI_Elo 1500                   :      2094    98.0     100       98.0
   4 Honey X5i UCI_Elo 1500                    :      2054    97.5     100       97.5
   5 Cheng 4.39 UCI_Elo 1500                   :      2054    97.5     100       97.5
   6 Ufim v8.02 UCI_Elo 1500                   :      2021    97.0     100       97.0
   7 Amyan 1.72 UCI_Elo 1500                   :      1910    94.5     100       94.5
   8 Wasp 4.5 UCI_Elo 1500                     :      1840    92.0     100       92.0
   9 MadChess 3.0 UCI_Elo 1500                 :      1817    91.0     100       91.0
  10 Deuterium v2021.1.38.29.4 UCI_Elo 1500    :      1753    87.5     100       87.5
  11 Rhetoric 1.4.3 UCI_Elo 1500               :      1737    86.5     100       86.5
  12 Discocheck 5.2 UCI_Elo 1500               :      1730    86.0     100       86.0
  13 Arasan 21.1 UCI_Elo 1500                  :      1716    85.0     100       85.0
  14 Rodent IV 022 UCI_Elo 1500                :      1716    85.0     100       85.0
  15 Deuterium v2019.2.37.73 UCI_Elo 1500      :      1599    74.5     100       74.5
  16 Danasah 7.9 UCI_Elo 1500                  :      1599    74.5     100       74.5
  17 Stockfish 13 UCI_Elo 1500                 :      1539    67.5     100       67.5
  18 Hiarcs 14 UCI_Elo 1500                    :      1449    55.5     100       55.5
  19 Maia Lichess 1546                         :      1410   312.5    1900       16.4
  20 Deuterium v2014.2.33.276 UCI_Elo 1500     :      1171    20.5     100       20.5
The closest engines at FIDE Elo 1500 within 100 Elo are Stockfish, Hiarcs, Maia, Danasah and Deuterium v2019.2.37.73.
Looks like several engines are tuning to CCRL 1500 which is significantly stronger than 1500 FIDE . about 1890 +/- 100
Does this last sentence mean that on average, an engine with a CCRL blitz rating of 1500 should be an even match for a human with a FIDE rating of about 1890 if they are playing blitz chess? If so what is the time limit assumed for the human vs engine match? I suppose it is based on the average blitz game played between humans and engines on Lichess, is that correct? If so can you estimate the average time limit of such human vs engine games? Time limit makes a huge difference in engine vs human play; a human might be hundreds of elo stronger against engines at game in ten minutes than at game in three minutes. This estimate of about four hundred elo gap between CCRL and FIDE ratings in blitz might be about right at some time control in that range.
I discovered this prior to LiChess became big, but yes I am talking Blitz Chess - around 3 3 maybe. I' am a 1600 player, and few years, when playing Shadow Blue ( about 1700 CCRL) for calibrating my Honey engines, - I realized immediately that it was not 1700 USCF, SO I dug deeper and came across this post with a lot of good info

http://talkchess.com/forum3/viewtopic.p ... 2&#p661409

So in my Honey Engines I let the user to choose CCRL (for the programmers) or FIDE ( for humans).

Convert CCRL to FIDE:

(CCRL-Ra * 10) / 7) - 1200 = FIDE-RA

Convert FIDE to CCRL:

(FIDE-Ra+1200)*7/10=CCRL-Ra

.. at 2800 , they are about the same ... (2800 *10 /7 ) - 1200 = 2800

Most my Elo testing of engines have been around 3 3. I don't play well faster than that ,and longer times control take too long for me.

(note any number i state above could easily be off a hundred Elo either way - Was never looking for greater precision, just ball park #'s.
I think the formulas are reversed. Where it says CCRL-Ra it should say FIDE-Ra and where it says FIDE-Ra it should say CCRL-Ra.

FIDE = (0.7 x CCRL) + 840
CCRL = (FIDE - 840) / 0.7

In my case I found that at the bottom of the list this was not well enforced. I now use FIDE = (0.9 x CCRL) + 440

Some time ago I tried to find an equivalence between the Basque Elo and the FIDE Elo, in principle there is not much difference. In the study I noticed an interesting thing, for example if I took players in the Basque list of 1700 points, I found in the FIDE list that these players could have Elos as 1900 points and Elos as 1100, an incredible difference. The average is something like 1511. By this I mean that no matter how well you calibrate your Elo you will always find people who will think that the level of play with the selected Elo is too high or too low even if you calibrate too much.

https://sites.google.com/site/danasah/c ... -elo-vasco (spanish)
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: UCI_Elo 1500 engines and FIDE Elo

Post by lkaufman »

pedrox wrote: Sat Apr 24, 2021 12:05 am
MikeB wrote: Thu Apr 22, 2021 5:09 am
lkaufman wrote: Wed Apr 21, 2021 6:24 am
MikeB wrote: Tue Apr 20, 2021 5:25 pm
Ferdy wrote: Tue Apr 20, 2021 12:02 pm Maia Lichess 1546 has a blitz Lichess rating of around 1546. This engine is run with maia-1100.pb.gz net at node 1 on a gauntlet test below.

The formula to get FIDE Elo from Lichess Blitz Elo is,

Code: Select all

FIDE rating = 65 + [0.87 x Lichess Blitz Rating]
based from the regression in 2019.

Maia FIDE Elo = 65 + 0.87 x 1546 = 1410

Maia gauntlet bullet at TC 60s+100ms and is set at FIDE Elo 1410.

Code: Select all

   # Player                                    :  FIDE Elo  Points  Played  Points(%)
   1 Rybka v2.3.2a UCI_Elo 1500                :      2217    99.0     100       99.0
   2 Minic 2.51 UCI_Elo 1500                   :      2145    98.5     100       98.5
   3 Cheese 2.1 UCI_Elo 1500                   :      2094    98.0     100       98.0
   4 Honey X5i UCI_Elo 1500                    :      2054    97.5     100       97.5
   5 Cheng 4.39 UCI_Elo 1500                   :      2054    97.5     100       97.5
   6 Ufim v8.02 UCI_Elo 1500                   :      2021    97.0     100       97.0
   7 Amyan 1.72 UCI_Elo 1500                   :      1910    94.5     100       94.5
   8 Wasp 4.5 UCI_Elo 1500                     :      1840    92.0     100       92.0
   9 MadChess 3.0 UCI_Elo 1500                 :      1817    91.0     100       91.0
  10 Deuterium v2021.1.38.29.4 UCI_Elo 1500    :      1753    87.5     100       87.5
  11 Rhetoric 1.4.3 UCI_Elo 1500               :      1737    86.5     100       86.5
  12 Discocheck 5.2 UCI_Elo 1500               :      1730    86.0     100       86.0
  13 Arasan 21.1 UCI_Elo 1500                  :      1716    85.0     100       85.0
  14 Rodent IV 022 UCI_Elo 1500                :      1716    85.0     100       85.0
  15 Deuterium v2019.2.37.73 UCI_Elo 1500      :      1599    74.5     100       74.5
  16 Danasah 7.9 UCI_Elo 1500                  :      1599    74.5     100       74.5
  17 Stockfish 13 UCI_Elo 1500                 :      1539    67.5     100       67.5
  18 Hiarcs 14 UCI_Elo 1500                    :      1449    55.5     100       55.5
  19 Maia Lichess 1546                         :      1410   312.5    1900       16.4
  20 Deuterium v2014.2.33.276 UCI_Elo 1500     :      1171    20.5     100       20.5
The closest engines at FIDE Elo 1500 within 100 Elo are Stockfish, Hiarcs, Maia, Danasah and Deuterium v2019.2.37.73.
Looks like several engines are tuning to CCRL 1500 which is significantly stronger than 1500 FIDE . about 1890 +/- 100
Does this last sentence mean that on average, an engine with a CCRL blitz rating of 1500 should be an even match for a human with a FIDE rating of about 1890 if they are playing blitz chess? If so what is the time limit assumed for the human vs engine match? I suppose it is based on the average blitz game played between humans and engines on Lichess, is that correct? If so can you estimate the average time limit of such human vs engine games? Time limit makes a huge difference in engine vs human play; a human might be hundreds of elo stronger against engines at game in ten minutes than at game in three minutes. This estimate of about four hundred elo gap between CCRL and FIDE ratings in blitz might be about right at some time control in that range.
I discovered this prior to LiChess became big, but yes I am talking Blitz Chess - around 3 3 maybe. I' am a 1600 player, and few years, when playing Shadow Blue ( about 1700 CCRL) for calibrating my Honey engines, - I realized immediately that it was not 1700 USCF, SO I dug deeper and came across this post with a lot of good info

http://talkchess.com/forum3/viewtopic.p ... 2&#p661409

So in my Honey Engines I let the user to choose CCRL (for the programmers) or FIDE ( for humans).

Convert CCRL to FIDE:

(CCRL-Ra * 10) / 7) - 1200 = FIDE-RA

Convert FIDE to CCRL:

(FIDE-Ra+1200)*7/10=CCRL-Ra

.. at 2800 , they are about the same ... (2800 *10 /7 ) - 1200 = 2800

Most my Elo testing of engines have been around 3 3. I don't play well faster than that ,and longer times control take too long for me.

(note any number i state above could easily be off a hundred Elo either way - Was never looking for greater precision, just ball park #'s.
I think the formulas are reversed. Where it says CCRL-Ra it should say FIDE-Ra and where it says FIDE-Ra it should say CCRL-Ra.

FIDE = (0.7 x CCRL) + 840
CCRL = (FIDE - 840) / 0.7

In my case I found that at the bottom of the list this was not well enforced. I now use FIDE = (0.9 x CCRL) + 440

Some time ago I tried to find an equivalence between the Basque Elo and the FIDE Elo, in principle there is not much difference. In the study I noticed an interesting thing, for example if I took players in the Basque list of 1700 points, I found in the FIDE list that these players could have Elos as 1900 points and Elos as 1100, an incredible difference. The average is something like 1511. By this I mean that no matter how well you calibrate your Elo you will always find people who will think that the level of play with the selected Elo is too high or too low even if you calibrate too much.

https://sites.google.com/site/danasah/c ... -elo-vasco (spanish)
When converting from FIDE to CCRL ratings or vice-versa, we need different formulae depending on which ratings we are talking about. FIDE has standard, Rapid, and Blitz ratings; CCRL has only Rapid and Blitz ratings. What the formulae should tell us is what CCRL Rapid rating a player with a FIDE Rapid rating of (for example) 2000 would get if he played against CCRL engines at their specified rapid time control and hardware, and (using a completely different formula) what CCRL Blitz rating a player with a FIDE Blitz rating of (for example) 2000 would get if he played against CCRL engines at their specified blitz time control (2' + 1") and hardware. Probably the data is only available for online blitz play between humans and engines, which I gather is at an average of something like 3' + 3" per move. So are these formulae based on data from such blitz games? If they are, then it would be very strange, really ridiculous, if they predicted that a 2800 FIDE human (even a blitz rating) would get a 2800 CCRL rating playing against CCRL engines in blitz, even if it is 3' + 3" rather than 2' + 1". So, just how are these formulae calibrated? Do they just "assume" that 2800 is the same on both scales? If so that is absurd for blitz.
Komodo rules!
User avatar
pedrox
Posts: 1056
Joined: Fri Mar 10, 2006 6:07 am
Location: Basque Country (Spain)

Re: UCI_Elo 1500 engines and FIDE Elo

Post by pedrox »

lkaufman wrote: Sat Apr 24, 2021 1:34 am
pedrox wrote: Sat Apr 24, 2021 12:05 am
MikeB wrote: Thu Apr 22, 2021 5:09 am
lkaufman wrote: Wed Apr 21, 2021 6:24 am
MikeB wrote: Tue Apr 20, 2021 5:25 pm
Ferdy wrote: Tue Apr 20, 2021 12:02 pm Maia Lichess 1546 has a blitz Lichess rating of around 1546. This engine is run with maia-1100.pb.gz net at node 1 on a gauntlet test below.

The formula to get FIDE Elo from Lichess Blitz Elo is,

Code: Select all

FIDE rating = 65 + [0.87 x Lichess Blitz Rating]
based from the regression in 2019.

Maia FIDE Elo = 65 + 0.87 x 1546 = 1410

Maia gauntlet bullet at TC 60s+100ms and is set at FIDE Elo 1410.

Code: Select all

   # Player                                    :  FIDE Elo  Points  Played  Points(%)
   1 Rybka v2.3.2a UCI_Elo 1500                :      2217    99.0     100       99.0
   2 Minic 2.51 UCI_Elo 1500                   :      2145    98.5     100       98.5
   3 Cheese 2.1 UCI_Elo 1500                   :      2094    98.0     100       98.0
   4 Honey X5i UCI_Elo 1500                    :      2054    97.5     100       97.5
   5 Cheng 4.39 UCI_Elo 1500                   :      2054    97.5     100       97.5
   6 Ufim v8.02 UCI_Elo 1500                   :      2021    97.0     100       97.0
   7 Amyan 1.72 UCI_Elo 1500                   :      1910    94.5     100       94.5
   8 Wasp 4.5 UCI_Elo 1500                     :      1840    92.0     100       92.0
   9 MadChess 3.0 UCI_Elo 1500                 :      1817    91.0     100       91.0
  10 Deuterium v2021.1.38.29.4 UCI_Elo 1500    :      1753    87.5     100       87.5
  11 Rhetoric 1.4.3 UCI_Elo 1500               :      1737    86.5     100       86.5
  12 Discocheck 5.2 UCI_Elo 1500               :      1730    86.0     100       86.0
  13 Arasan 21.1 UCI_Elo 1500                  :      1716    85.0     100       85.0
  14 Rodent IV 022 UCI_Elo 1500                :      1716    85.0     100       85.0
  15 Deuterium v2019.2.37.73 UCI_Elo 1500      :      1599    74.5     100       74.5
  16 Danasah 7.9 UCI_Elo 1500                  :      1599    74.5     100       74.5
  17 Stockfish 13 UCI_Elo 1500                 :      1539    67.5     100       67.5
  18 Hiarcs 14 UCI_Elo 1500                    :      1449    55.5     100       55.5
  19 Maia Lichess 1546                         :      1410   312.5    1900       16.4
  20 Deuterium v2014.2.33.276 UCI_Elo 1500     :      1171    20.5     100       20.5
The closest engines at FIDE Elo 1500 within 100 Elo are Stockfish, Hiarcs, Maia, Danasah and Deuterium v2019.2.37.73.
Looks like several engines are tuning to CCRL 1500 which is significantly stronger than 1500 FIDE . about 1890 +/- 100
Does this last sentence mean that on average, an engine with a CCRL blitz rating of 1500 should be an even match for a human with a FIDE rating of about 1890 if they are playing blitz chess? If so what is the time limit assumed for the human vs engine match? I suppose it is based on the average blitz game played between humans and engines on Lichess, is that correct? If so can you estimate the average time limit of such human vs engine games? Time limit makes a huge difference in engine vs human play; a human might be hundreds of elo stronger against engines at game in ten minutes than at game in three minutes. This estimate of about four hundred elo gap between CCRL and FIDE ratings in blitz might be about right at some time control in that range.
I discovered this prior to LiChess became big, but yes I am talking Blitz Chess - around 3 3 maybe. I' am a 1600 player, and few years, when playing Shadow Blue ( about 1700 CCRL) for calibrating my Honey engines, - I realized immediately that it was not 1700 USCF, SO I dug deeper and came across this post with a lot of good info

http://talkchess.com/forum3/viewtopic.p ... 2&#p661409

So in my Honey Engines I let the user to choose CCRL (for the programmers) or FIDE ( for humans).

Convert CCRL to FIDE:

(CCRL-Ra * 10) / 7) - 1200 = FIDE-RA

Convert FIDE to CCRL:

(FIDE-Ra+1200)*7/10=CCRL-Ra

.. at 2800 , they are about the same ... (2800 *10 /7 ) - 1200 = 2800

Most my Elo testing of engines have been around 3 3. I don't play well faster than that ,and longer times control take too long for me.

(note any number i state above could easily be off a hundred Elo either way - Was never looking for greater precision, just ball park #'s.
I think the formulas are reversed. Where it says CCRL-Ra it should say FIDE-Ra and where it says FIDE-Ra it should say CCRL-Ra.

FIDE = (0.7 x CCRL) + 840
CCRL = (FIDE - 840) / 0.7

In my case I found that at the bottom of the list this was not well enforced. I now use FIDE = (0.9 x CCRL) + 440

Some time ago I tried to find an equivalence between the Basque Elo and the FIDE Elo, in principle there is not much difference. In the study I noticed an interesting thing, for example if I took players in the Basque list of 1700 points, I found in the FIDE list that these players could have Elos as 1900 points and Elos as 1100, an incredible difference. The average is something like 1511. By this I mean that no matter how well you calibrate your Elo you will always find people who will think that the level of play with the selected Elo is too high or too low even if you calibrate too much.

https://sites.google.com/site/danasah/c ... -elo-vasco (spanish)
When converting from FIDE to CCRL ratings or vice-versa, we need different formulae depending on which ratings we are talking about. FIDE has standard, Rapid, and Blitz ratings; CCRL has only Rapid and Blitz ratings. What the formulae should tell us is what CCRL Rapid rating a player with a FIDE Rapid rating of (for example) 2000 would get if he played against CCRL engines at their specified rapid time control and hardware, and (using a completely different formula) what CCRL Blitz rating a player with a FIDE Blitz rating of (for example) 2000 would get if he played against CCRL engines at their specified blitz time control (2' + 1") and hardware. Probably the data is only available for online blitz play between humans and engines, which I gather is at an average of something like 3' + 3" per move. So are these formulae based on data from such blitz games? If they are, then it would be very strange, really ridiculous, if they predicted that a 2800 FIDE human (even a blitz rating) would get a 2800 CCRL rating playing against CCRL engines in blitz, even if it is 3' + 3" rather than 2' + 1". So, just how are these formulae calibrated? Do they just "assume" that 2800 is the same on both scales? If so that is absurd for blitz.
Let's imagine that we want to organise a match between a GM and an engine and we want it to be evenly matched.

GM Elo = 2515 (standar)

With Kai's formula we could look for an engine from the CCRL list 40/15.

CCRL = (FIDE-840)/0.7 = 2392. In this Elo for example plays CT800 1.40 64-bit

The computer we have for the match is an i7-4770k, which matches the reference used by CCRL for the 40/15 time control. Let's consider for example a standard control something like 40/120.

What are the timings that would need to be set in the GUI for the GM and for the engine?

1. Human --> 40/120, Engine --> 40/120
or
2. Human --> 40/120, Engine --> 40/15
or
3. Human --> 40/15, Engine --> 40/15

Maybe the second option? In the second option the human has 8 times more time.

If we now play blitz for example 3'+3'', maybe the engine should be configured with 8 times less time? something like 22s + 375ms

Does this make any sense?

In the versions limited by strength for Elo FIDE you could divide the number of nps by 8 and use the same time for both.