83rd Amateur Series Division 6

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

83rd Amateur Series Division 6

Post by Graham Banks »

83RD AMATEUR SERIES (Division 6)

Intel i5 Quad
ChessGUI
256mb hash each
3-4-5 piece tablebases
Ponder off
ChessGUI.cgb book
40 moves in 25 minutes repeating (adapted for the CCRL)
4 cycles 44 rounds
All engines 64-bit where available
The top engine will gain automatic promotion and the bottom engine will be relegated. Any other changes of division will be at my discretion and may not necessarily involve playoff matches. This will be the final series that Arminius is eligible to play in, until a new version is released.
Participants

Mayhem 2.5 64-bit
Arminius 2018-12-23 64-bit
GreKo 2020.03 64-bit
DanaSah 8.3
ECE 20.1 64-bit
Fridolin 3.10 64-bit
OliThink 5.9.2 64-bit
K2 0.95
Shallow 2020-09-09 64-bit
Drosophila 1.6 64-bit
Velvet 1.1.0 64-bit
Delocto 0.61n 64-bit


Games and standings will be available after every six rounds from the following link:
http://kirill-kryukov.com/chess/discuss ... =7&t=12609

If you install TLCV (Tom's Live Chess Viewer) on your computer, you can watch the games live move by move. You'll also be able to chat to others following the tournament in the chatroom there.
http://kirill-kryukov.com/chess/discuss ... p?id=42959
Host - GrahamCCRL.dyndns.org Port - 16001

Linux users can use Livius:
https://github.com/kmar/livius

There is also a Livius windows version.
It has live pv boards as a nice addition.
http://www.crabaware.com/livius/
gbanksnz at gmail.com
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: 83rd Amateur Series Division 6

Post by Graham Banks »

83RD AMATEUR SERIES (Division 6)

Intel i5 Quad
ChessGUI
256mb hash each
3-4-5 piece tablebases
Ponder off
ChessGUI.cgb book
40 moves in 25 minutes repeating (adapted for the CCRL)
4 cycles 44 rounds
All engines 64-bit where available
The top engine will gain automatic promotion and the bottom engine will be relegated. Any other changes of division will be at my discretion and may not necessarily involve playoff matches. This will be the final series that Arminius is eligible to play in, until a new version is released.
Standings after Round 6

4.5 - OliThink 5.9.2 64-bit
4.5 - K2 0.95
3.5 - ECE 20.1 64-bit
3.5 - Fridolin 3.10 64-bit
3.0 - Arminius 2018-12-23 64-bit
3.0 - Velvet 1.1.0 64-bit
3.0 - Drosophila 1.6 64-bit
3.0 - Delocto 0.61n 64-bit
2.5 - DanaSah 8.30
2.0 - Mayhem 2.5 64-bit
2.0 - GreKo 2020.03 64-bit
1.5 - Shallow 2020-09-09 64-bit


Games and standings will be available after every six rounds from the following link:
http://kirill-kryukov.com/chess/discuss ... =7&t=12609

If you install TLCV (Tom's Live Chess Viewer) on your computer, you can watch the games live move by move. You'll also be able to chat to others following the tournament in the chatroom there.
http://kirill-kryukov.com/chess/discuss ... p?id=42959
Host - GrahamCCRL.dyndns.org Port - 16001

Linux users can use Livius:
https://github.com/kmar/livius

There is also a Livius windows version.
It has live pv boards as a nice addition.
http://www.crabaware.com/livius/
gbanksnz at gmail.com
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: 83rd Amateur Series Division 6

Post by Graham Banks »

83RD AMATEUR SERIES (Division 6)

Intel i5 Quad
ChessGUI
256mb hash each
3-4-5 piece tablebases
Ponder off
ChessGUI.cgb book
40 moves in 25 minutes repeating (adapted for the CCRL)
4 cycles 44 rounds
All engines 64-bit where available
The top engine will gain automatic promotion and the bottom engine will be relegated. Any other changes of division will be at my discretion and may not necessarily involve playoff matches. This will be the final series that Arminius is eligible to play in, until a new version is released.
Standings after Round 12

8.0 - OliThink 5.9.2 64-bit
8.0 - Drosophila 1.6 64-bit
7.5 - K2 0.95
6.5 - Fridolin 3.10 64-bit
6.0 - ECE 20.1 64-bit
6.0 - Velvet 1.1.0 64-bit
5.5 - Mayhem 2.5 64-bit
5.5 - Delocto 0.61n 64-bit
5.5 - DanaSah 8.30
5.0 - GreKo 2020.03 64-bit
5.0 - Arminius 2018-12-23 64-bit
3.5 - Shallow 2020-09-09 64-bit


Games and standings will be available after every six rounds from the following link:
http://kirill-kryukov.com/chess/discuss ... =7&t=12609

If you install TLCV (Tom's Live Chess Viewer) on your computer, you can watch the games live move by move. You'll also be able to chat to others following the tournament in the chatroom there.
http://kirill-kryukov.com/chess/discuss ... p?id=42959
Host - GrahamCCRL.dyndns.org Port - 16001

Linux users can use Livius:
https://github.com/kmar/livius

There is also a Livius windows version.
It has live pv boards as a nice addition.
http://www.crabaware.com/livius/
gbanksnz at gmail.com
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: 83rd Amateur Series Division 6

Post by Graham Banks »

83RD AMATEUR SERIES (Division 6)

Intel i5 Quad
ChessGUI
256mb hash each
3-4-5 piece tablebases
Ponder off
ChessGUI.cgb book
40 moves in 25 minutes repeating (adapted for the CCRL)
4 cycles 44 rounds
All engines 64-bit where available
The top engine will gain automatic promotion and the bottom engine will be relegated. Any other changes of division will be at my discretion and may not necessarily involve playoff matches. This will be the final series that Arminius is eligible to play in, until a new version is released.
Standings after Round 18

11.0 - K2 0.95
10.5 - OliThink 5.9.2 64-bit
10.5 - Velvet 1.1.0 64-bit
10.0 - ECE 20.1 64-bit
10.0 - Drosophila 1.6 64-bit
9.0 - Mayhem 2.5 64-bit
9.0 - Arminius 2018-12-23 64-bit
9.0 - Delocto 0.61n 64-bit
8.0 - GreKo 2020.03 64-bit
8.0 - DanaSah 8.30
7.5 - Fridolin 3.10 64-bit
5.5 - Shallow 2020-09-09 64-bit


Games and standings will be available after every six rounds from the following link:
http://kirill-kryukov.com/chess/discuss ... =7&t=12609

If you install TLCV (Tom's Live Chess Viewer) on your computer, you can watch the games live move by move. You'll also be able to chat to others following the tournament in the chatroom there.
http://kirill-kryukov.com/chess/discuss ... p?id=42959
Host - GrahamCCRL.dyndns.org Port - 16001

Linux users can use Livius:
https://github.com/kmar/livius

There is also a Livius windows version.
It has live pv boards as a nice addition.
http://www.crabaware.com/livius/
gbanksnz at gmail.com
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: 83rd Amateur Series Division 6

Post by Graham Banks »

83RD AMATEUR SERIES (Division 6)

Intel i5 Quad
ChessGUI
256mb hash each
3-4-5 piece tablebases
Ponder off
ChessGUI.cgb book
40 moves in 25 minutes repeating (adapted for the CCRL)
4 cycles 44 rounds
All engines 64-bit where available
The top engine will gain automatic promotion and the bottom engine will be relegated. Any other changes of division will be at my discretion and may not necessarily involve playoff matches. This will be the final series that Arminius is eligible to play in, until a new version is released.
Standings after Round 24

14.5 - Velvet 1.1.0 64-bit
14.0 - OliThink 5.9.2 64-bit
14.0 - ECE 20.1 64-bit
14.0 - K2 0.95
14.0 - Drosophila 1.6 64-bit
13.0 - Mayhem 2.5 64-bit
11.0 - Arminius 2018-12-23 64-bit
10.0 - GreKo 2020.03 64-bit
10.0 - DanaSah 8.30
10.0 - Shallow 2020-09-09 64-bit
10.0 - Delocto 0.61n 64-bit
9.5 - Fridolin 3.10 64-bit


Games and standings will be available after every six rounds from the following link:
http://kirill-kryukov.com/chess/discuss ... =7&t=12609

If you install TLCV (Tom's Live Chess Viewer) on your computer, you can watch the games live move by move. You'll also be able to chat to others following the tournament in the chatroom there.
http://kirill-kryukov.com/chess/discuss ... p?id=42959
Host - GrahamCCRL.dyndns.org Port - 16001

Linux users can use Livius:
https://github.com/kmar/livius

There is also a Livius windows version.
It has live pv boards as a nice addition.
http://www.crabaware.com/livius/
gbanksnz at gmail.com
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: 83rd Amateur Series Division 6

Post by Graham Banks »

83RD AMATEUR SERIES (Division 6)

Intel i5 Quad
ChessGUI
256mb hash each
3-4-5 piece tablebases
Ponder off
ChessGUI.cgb book
40 moves in 25 minutes repeating (adapted for the CCRL)
4 cycles 44 rounds
All engines 64-bit where available
The top engine will gain automatic promotion and the bottom engine will be relegated. Any other changes of division will be at my discretion and may not necessarily involve playoff matches. This will be the final series that Arminius is eligible to play in, until a new version is released.
Standings after Round 30

19.0 - Velvet 1.1.0 64-bit
17.5 - ECE 20.1 64-bit
17.0 - OliThink 5.9.2 64-bit
16.5 - K2 0.95
16.0 - Mayhem 2.5 64-bit
15.0 - Arminius 2018-12-23 64-bit
15.0 - Drosophila 1.6 64-bit
13.0 - GreKo 2020.03 64-bit
13.0 - DanaSah 8.30
13.0 - Shallow 2020-09-09 64-bit
13.0 - Fridolin 3.10 64-bit
12.0 - Delocto 0.61n 64-bit


Games and standings will be available after every six rounds from the following link:
http://kirill-kryukov.com/chess/discuss ... =7&t=12609

If you install TLCV (Tom's Live Chess Viewer) on your computer, you can watch the games live move by move. You'll also be able to chat to others following the tournament in the chatroom there.
http://kirill-kryukov.com/chess/discuss ... p?id=42959
Host - GrahamCCRL.dyndns.org Port - 16001

Linux users can use Livius:
https://github.com/kmar/livius

There is also a Livius windows version.
It has live pv boards as a nice addition.
http://www.crabaware.com/livius/
gbanksnz at gmail.com
OliverBr
Posts: 725
Joined: Tue Dec 18, 2007 9:38 pm
Location: Munich, Germany
Full name: Dr. Oliver Brausch

Re: 83rd Amateur Series Division 6

Post by OliverBr »

Graham Banks wrote: Thu Jan 07, 2021 1:39 am Standings after Round 30

19.0 - Velvet 1.1.0 64-bit
17.5 - ECE 20.1 64-bit
17.0 - OliThink 5.9.2 64-bit
16.5 - K2 0.95
16.0 - Mayhem 2.5 64-bit
15.0 - Arminius 2018-12-23 64-bit
15.0 - Drosophila 1.6 64-bit
13.0 - GreKo 2020.03 64-bit
13.0 - DanaSah 8.30
13.0 - Shallow 2020-09-09 64-bit
13.0 - Fridolin 3.10 64-bit
12.0 - Delocto 0.61n 64-bit
Hmmm, something is still strange.
K2 (0.95/0.96) was a main sparring partner of OliThink.
They played more millions games and OliThink 5.9.1 beats K2 quite easily with an ELO diff of about 130.

Code: Select all

delocto         uci     -5      0.6     https://github.com/moterink/Delocto
drosophila      uci     -260    1.6     https://github.com/gustafullberg/drosophila
k2              xb+uci  -130    0.96    https://github.com/serg-meus/k2
olithink5       xboard  0       5.9.1   https://github.com/olithink/OliThink
Of course I never do 25 minutes for 40 moves, because I need quickly many games.
But changing time controls never affected the results against K2.

This is a general observation that other engines do much better in those tournaments compared to my results.
What could this be?

PS: With Drosophia it's an ELO diff of about 260 and yet Drosophila has 15 points and OliThink 17...
PPS: Delocto???
Chess Engine OliThink: http://brausch.org/home/chess
OliThink GitHub:https://github.com/olithink
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: 83rd Amateur Series Division 6

Post by Graham Banks »

OliverBr wrote: Thu Jan 07, 2021 10:13 pm
Graham Banks wrote: Thu Jan 07, 2021 1:39 am Standings after Round 30

19.0 - Velvet 1.1.0 64-bit
17.5 - ECE 20.1 64-bit
17.0 - OliThink 5.9.2 64-bit
16.5 - K2 0.95
16.0 - Mayhem 2.5 64-bit
15.0 - Arminius 2018-12-23 64-bit
15.0 - Drosophila 1.6 64-bit
13.0 - GreKo 2020.03 64-bit
13.0 - DanaSah 8.30
13.0 - Shallow 2020-09-09 64-bit
13.0 - Fridolin 3.10 64-bit
12.0 - Delocto 0.61n 64-bit
Hmmm, something is still strange.
K2 (0.95/0.96) was a main sparring partner of OliThink.
They played more millions games and OliThink 5.9.1 beats K2 quite easily with an ELO diff of about 130.

Code: Select all

delocto         uci     -5      0.6     https://github.com/moterink/Delocto
drosophila      uci     -260    1.6     https://github.com/gustafullberg/drosophila
k2              xb+uci  -130    0.96    https://github.com/serg-meus/k2
olithink5       xboard  0       5.9.1   https://github.com/olithink/OliThink
Of course I never do 25 minutes for 40 moves, because I need quickly many games.
But changing time controls never affected the results against K2.

This is a general observation that other engines do much better in those tournaments compared to my results.
What could this be?

PS: With Drosophia it's an ELO diff of about 260 and yet Drosophila has 15 points and OliThink 17...
PPS: Delocto???
Small sample size, plus the unpredictability that tournaments can throw up.
OliThink 5.9.2 64-bit is performing around 2750 Elo in CCRL after a small number of games, but the gauntlet I'm starting today will sort out how accurate that rating is.
gbanksnz at gmail.com
OliverBr
Posts: 725
Joined: Tue Dec 18, 2007 9:38 pm
Location: Munich, Germany
Full name: Dr. Oliver Brausch

Re: 83rd Amateur Series Division 6

Post by OliverBr »

Graham Banks wrote: Thu Jan 07, 2021 11:30 pm Small sample size, plus the unpredictability that tournaments can throw up.
OliThink 5.9.2 64-bit is performing around 2750 Elo in CCRL after a small number of games, but the gauntlet I'm starting today will sort out how accurate that rating is.
Thank you so much, Graham! You are such a huge support for the chess programmer community!

You are right about the small sample size, but there is a pattern that I observe since quite some time in other tourneys, too.

Actually I am running a Gauntlet, too, on my 32-core Linux server with 32 concurrent games. It's the same time control as yours, 25 minutes for 40 games and ponder off.
Differences: I am using 3moves book with thousands of opening, no tablebases at all, machines use their default hash size.

So there are not that many games, the error is still quite large. It's running for 12 hours and this is an intermediate result :

Code: Select all

   # PLAYER            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  CFS(%)
   1 OliThink 5.9.2    :       0   ----   145.0     198  73.2  119   52   27  26.3     100
   2 Delocto 0.6       :    -121     75    22.5      66  34.1   12   21   33  31.8      93
   3 K2 v.0.96dev      :    -202     77    16.5      66  25.0    8   17   41  25.8      75
   4 Drosophila 1.6    :    -241     86    14.0      66  21.2    7   14   45  21.2     ---

White advantage = 80.18 +/- 24.87
Draw rate (equal opponents) = 33.23 % +/- 4.29
Of course we have to consider the fact that OliThink has been developed on that very Linux server, so it's optimizied for that.
Other than that, there is notable difference in terms of performance which I cannot explain.
Chess Engine OliThink: http://brausch.org/home/chess
OliThink GitHub:https://github.com/olithink
JohnWoe
Posts: 491
Joined: Sat Mar 02, 2013 11:31 pm

Re: 83rd Amateur Series Division 6

Post by JohnWoe »

Thank you for testing Mayhem!

Nice to see Mayhem playing good games. Especially nice wins against Olithink :lol:
These results are pretty much what I got testing Mayhem 2.5 vs Glaurung 2.2. The games were really hard fought and score ~50%.

Anyway Mayhem 2.7 is going to be much stronger. It has the most important EGTB 4 - 7 men internally. Null move bug is fixed...