Year 2021 Top 20

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Dann Corbit, Harvey Williamson

Kris Storm
Posts: 3
Joined: Tue Sep 29, 2020 3:04 pm
Full name: Kris Storm

Year 2021 Top 20

Post by Kris Storm »

This took more or less 50 nights of computer power.

Code: Select all

   # PLAYER           :  RATING  ERROR   POINTS  PLAYED   (%)  CFS(%)      W      D      L  D(%)
   1 Stockfish1231    :     395      6  10135.5   12500  81.1     100   7982   4307    211  34.5
     SF14.1           :     372      6  13317.0   16500  80.7     100  10505   5624    371  34.1
     CF14             :     352      5  14443.5   18000  80.2     100  11368   6151    481  34.2
     SF14             :     340      5  25042.0   31000  80.8     100  19955  10174    871  32.8
     FatTitz1.1       :     314      5  11248.0   15500  72.6     100   8004   6488   1008  41.9
   2 Dragon2.6        :     296      6   9202.0   13000  70.8     100   6362   5680    958  43.7
     SF13             :     277      5  23466.0   31000  75.7      53  17764  11404   1832  36.8
     FatFritz2.1      :     277      6  11522.5   14500  79.5     100   9139   4767    594  32.9
     SF12             :     216      5  21751.0   31000  70.2     100  15746  12010   3244  38.7
   3 Fire8            :     124      5  18897.0   31000  61.0     100  12949  11896   6155  38.4
   4 Berserk8         :      81      5   9477.0   17500  54.2     100   6096   6762   4642  38.6
   5 Ethereal12.75    :      72      4  17198.5   31000  55.5      99  10911  12575   7514  40.6
     SF11             :      68      4  17048.5   31000  55.0     100  11474  11149   8377  36.0
   6 Revenge2         :      49      6   5915.0   13500  43.8      95   2987   5856   4657  43.4
     SF10             :      44      4  16254.5   31000  52.4      78  10949  10611   9440  34.2
   7 Slow2.8          :      42      5   9474.0   18500  51.2      99   5705   7538   5257  40.7
   8 Koivisto7        :      36      5   9894.5   20500  48.3      96   6053   7683   6764  37.5
   9 Rubi2.2          :      21      4  15515.5   31500  49.3     100   9444  12143   9913  38.5
     Houdini6         :       0   ----  14744.5   31000  47.6     100   9652  10185  11163  32.9
     SF9              :     -11      4  14361.5   31000  46.3     100   9091  10541  11368  34.0
     SF8              :     -55      4  12871.0   31000  41.5      87   7402  10938  12660  35.3
  10 Nemorino6        :     -58      5  12783.0   31000  41.2     100   6915  11736  12349  37.9
  11 Seer2.4          :     -77      5   6218.5   17000  36.6     100   3392   5653   7955  33.3
  12 Igel3            :     -92      4  11667.0   31000  37.6     100   5950  11434  13616  36.9
  13 Arasan23.2       :    -131      6   5357.0   15000  35.7     100   2921   4872   7207  32.5
  14 Wasp5            :    -215      6   3708.0   16500  22.5     100   1574   4268  10658  25.9
  15 Weiss2           :    -225      4   7396.5   27500  26.9      72   3839   7115  16546  25.9
  16 Gogobello3       :    -227      5   6844.0   26500  25.8     100   2865   7958  15677  30.0
  17 Zahak9           :    -257      6   3122.5   16500  18.9     100   1325   3595  11580  21.8
  18 Minic3.14        :    -294      6   3480.5   18000  19.3     100   1404   4153  12443  23.1
  19 Clover2.4        :    -313      5   4861.0   26500  18.3     100   2167   5388  18945  20.3
  20 Halogen10        :    -337      5   4747.5   28000  17.0     100   1792   5911  20297  21.1
cutechess-cli-12.exe -tournament gauntlet -rounds 250 -games 2 -repeat -concurrency 15 ^
-pgnout resXX.pgn -ratinginterval 10 -recover -tb C:\Chess\Syzygy -resultformat wide ^
-openings file=Balsa_v110221.pgn format=pgn order=random plies=16 ^
-resign movecount=3 score=400 -draw movenumber=34 movecount=8 score=20 ^
-engine ................................................
-engine ................................................
-each proto=uci tc=10+0.1 option.Hash=256 option.Threads=1
Top
RubiChess
Posts: 562
Joined: Fri Mar 30, 2018 7:20 am
Full name: Andreas Matthies

Re: Year 2021 Top 20

Post by RubiChess »

Hi Kris.

Good first post.

It seems that your PC favors engines without NN(UE) a little, that would explain Ethereal 12.75 > Revenge2, Slow2.8, Rubi2.2.
Can you tell us something about your hardware and which binaries (especially for Rubi) you used?

Regards, Andreas
Top
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Year 2021 Top 20

Post by Frank Quisinsky »

Hi,

place 14 would be great ...

But many engines missed:

1. Booot
2. rofChade NN (dev. version available)
3. Lc0
4. xiphos

Hard times to hold a place in TOP-20.
The new Rodent 1.0 is stronger as Wasp.
Scorpio is stronger as Wasp.
Wasp can be stronger as xiphos with version 5.20.

Place 20 for Wasp should be right.

But very interesting to see.
Thank you!

Best
Frank
Top
Kris Storm
Posts: 3
Joined: Tue Sep 29, 2020 3:04 pm
Full name: Kris Storm

Re: Year 2021 Top 20

Post by Kris Storm »

RubiChess wrote: ↑Thu Jan 06, 2022 8:31 am Hi Kris.

Good first post.

It seems that your PC favors engines without NN(UE) a little, that would explain Ethereal 12.75 > Revenge2, Slow2.8, Rubi2.2.
Can you tell us something about your hardware and which binaries (especially for Rubi) you used?

Regards, Andreas
Hi! Thanks for your interest. My hardware is Ryzen7 Zen2
Ethereal 12.75 that I used was first (and free) NNUE version (10-10-2020) with nn-62ef826d1a6d net
RubiChess2.2 (7-7-2021) avx2 with nn-fb50f1a2b1-20210705 net
Top
Kris Storm
Posts: 3
Joined: Tue Sep 29, 2020 3:04 pm
Full name: Kris Storm

Re: Year 2021 Top 20

Post by Kris Storm »

Frank Quisinsky wrote: ↑Thu Jan 06, 2022 9:23 am Hi,

place 14 would be great ...

But many engines missed:

1. Booot
2. rofChade NN (dev. version available)
3. Lc0
4. xiphos

Hard times to hold a place in TOP-20.
The new Rodent 1.0 is stronger as Wasp.
Scorpio is stronger as Wasp.
Wasp can be stronger as xiphos with version 5.20.

Place 20 for Wasp should be right.

But very interesting to see.
Thank you!

Best
Frank
Hi! You're right: some engines missed. Maybe I should name the post Top 20 NNUE engines.
Anyway I will test Booot 6.5 and Rodent 1.0
rofChade NN is not ready yet (IPMan was testing it in December) and I don't have dev version
Xiphos is not developed since 2019

Lc0 and Scorpio as GPU engines are not scalling well with STC. And for me always was not clear what conditions are fair.
When I first tested Lc0 on GTX1070 it was worse then SF after I started testing on RTX2070 and it was better.
Now I have RTX3070 which is $1000 card and Ryzen7-2700X CPU which is $200. So I quit with testing GPU engines at all.

Regards Kris
Top
RubiChess
Posts: 562
Joined: Fri Mar 30, 2018 7:20 am
Full name: Andreas Matthies

Re: Year 2021 Top 20

Post by RubiChess »

Kris Storm wrote: ↑Thu Jan 06, 2022 1:27 pm
RubiChess wrote: ↑Thu Jan 06, 2022 8:31 am Hi Kris.

Good first post.

It seems that your PC favors engines without NN(UE) a little, that would explain Ethereal 12.75 > Revenge2, Slow2.8, Rubi2.2.
Can you tell us something about your hardware and which binaries (especially for Rubi) you used?

Regards, Andreas
Hi! Thanks for your interest. My hardware is Ryzen7 Zen2
Ethereal 12.75 that I used was first (and free) NNUE version (10-10-2020) with nn-62ef826d1a6d net
RubiChess2.2 (7-7-2021) avx2 with nn-fb50f1a2b1-20210705 net
Ah, okay. Then it is probably not the official Ethereal 12.75 from the github but the worlds-fastest implementation of NNUE that Andrew did at some point.
Top
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Year 2021 Top 20

Post by Frank Quisinsky »

Hi Kris,

I understand ...
So Rodent 1.0 NN is missed only ...

:-)

Thank you again!
A new idea ... CPU NN engines only.
Why not!

Best
Frank
Top

Return to “Computer Chess Club: Tournaments and Matches”