ELO progression measured by year

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

ELO progression measured by year

Post by Rebel »

ELO progression measured by year based on CCRL 40/20 games which were played that year. ELO numbers are based on the average rating of the 100 best engines and splitted into a (S)ingle (P)rocessor and (M)ulti (P)rocessor list, follow the orange links to view the details. Furthermore the statistic of the opening lines shows the quality of the randomness.

...

http://rebel13.nl/misc/stats.html
duncan
Posts: 12038
Joined: Mon Jul 07, 2008 10:50 pm

Re: ELO progression measured by year

Post by duncan »

Rebel wrote:ELO progression measured by year based on CCRL 40/20 games which were played that year. ELO numbers are based on the average rating of the 100 best engines and splitted into a (S)ingle (P)rocessor and (M)ulti (P)rocessor list, follow the orange links to view the details. Furthermore the statistic of the opening lines shows the quality of the randomness.

...

http://rebel13.nl/misc/stats.html
very useful. thanks.

were there hardware changes during those years?
mjlef
Posts: 1494
Joined: Thu Mar 30, 2006 2:08 pm

Re: ELO progression measured by year

Post by mjlef »

Do you have the same thing for the top 1 to 3 engines? I think averaging over 100 engines is going to make the progress look much slower than it was, at least for the stronger programs.
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: ELO progression measured by year

Post by Rebel »

duncan wrote:
Rebel wrote:ELO progression measured by year based on CCRL 40/20 games which were played that year. ELO numbers are based on the average rating of the 100 best engines and splitted into a (S)ingle (P)rocessor and (M)ulti (P)rocessor list, follow the orange links to view the details. Furthermore the statistic of the opening lines shows the quality of the randomness.

...

http://rebel13.nl/misc/stats.html
very useful. thanks.

were there hardware changes during those years?
That's a good question that only can be answered by the CCRL folks. If they provide information I could add an extra column to the table.
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: ELO progression measured by year

Post by Rebel »

mjlef wrote:Do you have the same thing for the top 1 to 3 engines? I think averaging over 100 engines is going to make the progress look much slower than it was, at least for the stronger programs.
I made a start doing so, it's only for the years 2006-2008 currently, it's a lot of work. But interesting enough to finish it. Also the progress for the best engine will be measured.

http://rebel13.nl/misc/stats.html
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: ELO progression measured by year

Post by Ozymandias »

Rebel wrote:That's a good question that only can be answered by the CCRL folks. If they provide information I could add an extra column to the table.
They adapt the TC to even out HW speed, so what machine each tester is using, becomes irrelevant.
duncan
Posts: 12038
Joined: Mon Jul 07, 2008 10:50 pm

Re: ELO progression measured by year

Post by duncan »

Rebel wrote:ELO progression measured by year based on CCRL 40/20 games which were played that year. ELO numbers are based on the average rating of the 100 best engines and splitted into a (S)ingle (P)rocessor and (M)ulti (P)rocessor list, follow the orange links to view the details. Furthermore the statistic of the opening lines shows the quality of the randomness.

...

http://rebel13.nl/misc/stats.html
the increase for best program for the period

single
2921 - Rybka 2.2 64-bit
3352 - asmFish 051117 64-bit

431 increase

multiple
3002 - Rybka 2.1 64-bit 4CPU
3426 - asmFish 051117 64-bit 4CPU

424 increase


for top 3

single

2921 - Rybka 2.2 64-bit
2779 - Fritz 10
2776 - Hiarcs 11

average 2825


3352 - asmFish 051117 64-bit
3341 - Houdini 6 64-bit
3327 - SugaR XPrO 1.3 64-bit

average 3340

increase 515

multiple

3002 - Rybka 2.1 64-bit 4CPU
2864 - Hiarcs 11 4CPU
2855 - Rybka 1.1 32-bit

average 2907


3426 - asmFish 051117 64-bit 4CPU
3414 - SugaR XPrO 1.2 64-bit 4CPU
3411 - Houdini 6 64-bit 4CPU

average 3417

increase 510
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: ELO progression measured by year

Post by Rebel »

Ozymandias wrote:
Rebel wrote:That's a good question that only can be answered by the CCRL folks. If they provide information I could add an extra column to the table.
They adapt the TC to even out HW speed, so what machine each tester is using, becomes irrelevant.
I see, so basically they are running a 40/40 list based on the hardware of 2006?
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: ELO progression measured by year

Post by Ozymandias »

"Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU."

Note it's either "40/40" or "40/4", "40/20" would be CEGT.
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: ELO progression measured by year

Post by Rebel »