Computer ELO ratings compared to human ELO ratings ?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Henk
Posts: 7221
Joined: Mon May 27, 2013 10:31 am

Computer ELO ratings compared to human ELO ratings ?

Post by Henk »

If it is possible that humans can win from computers in chess games
than I severely doubt if these computer ELO ratings are correct.

If a human player has 500 or less ELO than a computer program than winning chances are practically zero.

I found somewhere:

computer-428 elo=human elo
or some say computer-200 ~= human elo


Of course if you know the weaknesses of your opponent your winning chances are better.

Or is it the undo or takeback button in the user interface that makes humans win from the best computer programs ?!
User avatar
hgm
Posts: 27860
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Computer ELO ratings compared to human ELO ratings ?

Post by hgm »

According to the logistic Elo model you should score 5% against someone who is 500 Elo stronger. So an occasional win would be normal.
Sven
Posts: 4052
Joined: Thu May 15, 2008 9:57 pm
Location: Berlin, Germany
Full name: Sven Schüle

Re: Computer ELO ratings compared to human ELO ratings ?

Post by Sven »

Henk wrote:I found somewhere:

computer-428 elo=human elo
or some say computer-200 ~= human elo
If you found that "somewhere" then please show the link. However, I don't believe it since it is utter nonsense. You can easily figure out why by also looking up "somewhere" how the ELO rating system works.
Henk
Posts: 7221
Joined: Mon May 27, 2013 10:31 am

Re: Computer ELO ratings compared to human ELO ratings ?

Post by Henk »

http://www.ascotti.org/programming/chess/elo.htm

Yes you're right if the difference in ELO rating is greater than 700 ELO than winning chances are practically zero.
Henk
Posts: 7221
Joined: Mon May 27, 2013 10:31 am

Re: Computer ELO ratings compared to human ELO ratings ?

Post by Henk »

Henk wrote:http://www.ascotti.org/programming/chess/elo.htm

Yes you're right if the difference in ELO rating is greater than 700 ELO than winning chances are practically zero.
It can never happen that the best human player wins from the best chess program 6 times in a row or more the chances will be less than 0.000001
Uri Blass
Posts: 10410
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: Computer ELO ratings compared to human ELO ratings ?

Post by Uri Blass »

Henk wrote:
Henk wrote:http://www.ascotti.org/programming/chess/elo.htm

Yes you're right if the difference in ELO rating is greater than 700 ELO than winning chances are practically zero.
It can never happen that the best human player wins from the best chess program 6 times in a row or more the chances will be less than 0.000001
I disagree.
The best chess program may be deteministic or almost deterministic and in this case the best human player may memorize some comp-comp games and simply repeat the games from his memory.

He may need more than one game because the program has some opening book but memorizing 1000 games against a copy of the program may give good chances to win 6-0.

Uri
Henk
Posts: 7221
Joined: Mon May 27, 2013 10:31 am

Re: Computer ELO ratings compared to human ELO ratings ?

Post by Henk »

Uri Blass wrote:
Henk wrote:
Henk wrote:http://www.ascotti.org/programming/chess/elo.htm

Yes you're right if the difference in ELO rating is greater than 700 ELO than winning chances are practically zero.
It can never happen that the best human player wins from the best chess program 6 times in a row or more the chances will be less than 0.000001
I disagree.
The best chess program may be deteministic or almost deterministic and in this case the best human player may memorize some comp-comp games and simply repeat the games from his memory.

He may need more than one game because the program has some opening book but memorizing 1000 games against a copy of the program may give good chances to win 6-0.

Uri
I don't know how variation is implemented in these chess programs.
If you add a small random number to the eval() and select randomly if more than one 'best move' candidates have almost identical values.

Maybe if you implement more randomness performance of the chess program drops?
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Computer ELO ratings compared to human ELO ratings ?

Post by Vinvin »

Henk wrote:http://www.ascotti.org/programming/chess/elo.htm

Yes you're right if the difference in ELO rating is greater than 700 ELO than winning chances are practically zero.
Don't forget the opening preparation that could have a big impact on the results.
Sven
Posts: 4052
Joined: Thu May 15, 2008 9:57 pm
Location: Berlin, Germany
Full name: Sven Schüle

Re: Computer ELO ratings compared to human ELO ratings ?

Post by Sven »

Henk wrote:
Henk wrote:http://www.ascotti.org/programming/chess/elo.htm

Yes you're right if the difference in ELO rating is greater than 700 ELO than winning chances are practically zero.
It can never happen that the best human player wins from the best chess program 6 times in a row or more the chances will be less than 0.000001
We simply don't know the approximate ELO rating of the best chess program that it would have in a human ELO rating list, we can only guess. All ratings within a rating list are relative to all other players in that rating pool itself but are unrelated to players outside the pool. This is one of several reasons why today human ratings and computer chess ratings are not directly comparable.

Apart from that, I certainly agree that a 6-0 result of the best human player against the best engine is very unlikely. But the same applies to any other two strong chess players, especially if we consider today's draw rates, so why is that so interesting for you?
overlord
Posts: 198
Joined: Sun Jun 03, 2012 6:46 pm
Location: Trinec, Czech Republic

Re: Computer ELO ratings compared to human ELO ratings ?

Post by overlord »

It would be interesting to see some of top chess engines participatng in top human events.Anyway,default engines ELO ratings are rather overestimated.