Chesslogik 2008 OS Blitz Chess Engine Championship

[kranium]

Chesslogik 2008 OS Blitz Chess Engine Championship

Testing and Qualification:
Sat. Nov. 23 / Sun. Nov. 24, 2008

Play begins:
Monday Nov. 25, 2008 at 12:00 CET

Tournament Length:
approx. 30 days

Tournament Entry:
All existing OS (open-source) chess engines
rated at least 2500 ELO or above
Closed source, private, and commercial
programs may not participate.

Tournament Details:
Round Robin
2 games per pairing
Time Control: 2/1 (2 min. + 1 sec. increment)
1 CPU/processor/thread
Pondering is on
No opening book
128 MB hash
114 participants

Tournament Director:
Kranium

Broadcast:
The tournament is being broadcast live...to receive the broadcasts:
Simply download and install TLCV (Tom's Live Chess Viewer)
Use host www.chesslogik.com port 16000 and click 'Connect'.

List of Participants:
Arasan 10.4
Arasan 6.3
Arasan 7.4
Arasan 8.4
Arasan 9.5
BBChess 1.01
BBChess 1.1
BBChess 1.2a
BBChess 1.3a
Booot 4.12.111
Booot 4.13.1
Booot 4.14.013
Brutus 4.8
Brutus 5.4
Brutus 6.1
Crafty 12.1
Crafty 13.1
Crafty 14.0
Crafty 15.5
Crafty 16.0
Crafty 17.0
Crafty 18.1
Crafty 19.0
Crafty 20.0
Crafty 21.4
Crafty 22.0
Crafty 22.4
Cyclone 1.0
Cyclone 1.0 beta
Cyclone 2.0
Cyclone 2.1
Cyclone 2.2
Cyclops 1.0
Cyclops 2.0
Cyrano 0.1e
Cyrano 0.2c
Cyrano 0.3
Cyrano 0.4
Cyrano 0.5
Cyrano 0.6b17
Danasah 1.00
Danasah 2.00
Danasah 3.00
Danasah 3.97b
Delfi 4.5
Delfi 5.0
Delfi 5.1
Delfi 5.2
Fruit 1.0
Fruit 1.5
Fruit 2.0
Fruit 2.1
Gambit Fruit 1.0 beta 1
Gambit Fruit 1.0 beta 1.1a
Gambit Fruit 1.0 beta 2
Gambit Fruit 1.0 beta 3
Gambit Fruit 1.0 beta 4b
Gambit Fruit 1.0 beta 4bx
Glaurung 042008
Glaurung 080420
Glaurung 1.0.1
Glaurung 2.0
Glaurung 2-epsilon/2
Glaurung 2-epsilon/4
Glaurung 2-epsilon/5
Glaurung 2.1
Glaurung Lodz 2007
Grapefruit 1.0 b1j
Grapefruit 1.0 c1e
Grapefruit 1.0 alpha 1
Grapefruit 1.0 alpha 2
Grapefruit 1.0 alpha 3
Kiwi 0.1b
Kiwi 0.2b
Kiwi 0.3c
Kiwi 0.4d
Kiwi 0.5d
Kiwi 0.6d
Pepito 1.55
Pepito 1.59
Scorpio 1.81
Scorpio 1.91
Scorpio 2.02
Sloppy 0.1.0
Sloppy 0.2.0
Stockfish 1.01
Strelka 2.0b
Toga II 0.93
Toga II 1.0
Toga II 1.1
Toga II 1.2
Toga II 1.2 beta2a
Toga II 1.21
Toga II 1.21a
Toga II 1.3.1
Toga II 1.3.4
Toga II 1.3x4
Toga II 1.4 Checkov Beta_3
Toga II 1.4 WHMlearnCFS13
Toga II 1.4 beta4a
Toga II 1.4 beta5c
Toga II 1.4.1SE
Toga II 1.4.1SE6
Toga II 1.4.2JD
Toga II 1.4.3JD beta
Toga II 3.1.2SE
Toga II 3.1.2SE Checkov beta 3
Toga II CMLX 1.4 beta5d
Typhoon 1.00 304
Typhoon 1.00 320
Typhoon 1.00 340
Typhoon 1.00 358
Viper 0.1

Notes:
I'm intending to start this tommorrow at 12 noon sharp CET time
It should take about 30 days to finish..
I'll post interim results here once per week.
Games can be selected and immediately downloaded (emailed via the TLCV interface).

Prize money:
1 € cash prize for 1st place
.50 € cents cash prize for 2nd place
.25 € cash prize for 3rd place


Norm

[Graham Banks]

Nice idea Norm.
Should be a good tournament.
Are you sure you can afford to fork out such a generous amount of prizemoney?

[kranium]

Nice idea Norm.
Should be a good tournament.
Are you sure you can afford to fork out such a generous amount of prizemoney?

Hi Graham,
thanks for your positive comments...

i congratulate you and all dedicated testers (who do this all the time) for your dedication and fine work...
building this tourney has given me a better appreciation for the sheer amount of (somewhat tedious) config work that is necessary.

regarding the tourney:
i have replaced viper 0.1 at the last minute with romichess Pk3 because of occasional 'illegal move' forfeits.
(my only guess for this behavior is that maybe viper is not happy being run under with winboard and polyglot?).
also- there have been a couple minor last minute changes to the exact crafty versions that are participating.

PS - the tournament is expected to run ~ 40 days, expected finish date 1/2/2009. (that's Jan 2 not July 1 like they write dates here in the EU!).

Norm

[swami]

Cool Open source engine tournament, Norm. You have listed all the possible stronger open source engines.

Cyclone 45.5/53 in GBT 1 gauntlet... I will post the final results in the evening.

[Michael Sherwin]

Thanks!

For an interesting demonstration (because there are no books to be used) please consider including RomiChess P3k twice. One instance with learning enabled (the default) and one with learning disabled. To disable learning run Romi from the command line and type "learn_off", "book_off" and "quit". The flags that disable the book and learning are stored into the learn.dat file itself. So, deleting the learn.dat file will put Romi back to the defaults.

Edit: "learn_on", "book_on" and "quit" will also set Romi back to the defaults.

[kranium]

Thanks!

For an interesting demonstration (because there are no books to be used) please consider including RomiChess P3k twice. One instance with learning enabled (the default) and one with learning disabled. To disable learning run Romi from the command line and type "learn_off", "book_off" and "quit". The flags that disable the book and learning are stored into the learn.dat file itself. So, deleting the learn.dat file will put Romi back to the defaults.

Edit: "learn_on", "book_on" and "quit" will also set Romi back to the defaults.

Ok Michael...good idea.

In addition to adding this 2nd RomiChess, I've decided to be thorough and included all open-source engines...

the following 20 engines are now also participating in the tournament:

1 Amundsen 0.65.1
2 Amy 0.8.3
3 Amy 0.8.7
4 BibiChess 0.5
5 Crafty 22.5
6 Diablo 0.5.1
7 Exchess 5.01 beta
8 Feuerstein 0.4.5.2
9 GreKo 6.1
10 Lime 6.6
11 Micro-Max 4.8
12 Natwarlal 0.14
13 Phalanx XXII
14 Prophet 2.0
15 Romichess P3k (no learn)
16 Sage 2.2a
17 Sage 3.53
18 Thor's Hammer 2.28
19 Xpdnt 080927
20 ZCT 0.3.2445

I believe every OS program is now inlcuded, if I've missed one, please let me know.

Norm

[krazyken]

Beowulf
Gullydeckel
GnuChess
Mediocre
Olithink
RatteteChess
resp
Witz


and quite a number of much weaker ones..

[kranium]

thanks Kenny,

i guess most aren't being tested anymore, i.e.
they don't show up on the CCRL open source list...

if any of these are still in active development, i'm very much interested inincluding it.

I believe Olithink is...
i'll check out the rest..
thx!

Norm

[kranium]

the tournament is ~ 50% complete
(50% of the pairings are complete)
halfway results: (after ~ 8450 games)

1 Cyclone 2.1 118.0/130
2 Cyclone 2.2 111.5/130
3 Grapefruit 1.0 c1e 111.0/130
4 Toga II 1.4 beta5c 111.0/130
5 Grapefruit 1.0 alpha 3 110.5/130
6 Toga II 1.4.3JD beta 110.0/130
7 Grapefruit 1.0 alpha 1 109.5/130
8 Toga II 1.4.1SE6 108.5/130
9 Cyclops 1.0 108.5/130
10 Cyclone 2.0 108.5/130
11 Cyclops 2.0 107.5/130
12 Toga II 1.4.2JD 107.0/130
13 Grapefruit 1.0 b1j 106.5/130
14 Toga II 1.3.1 106.5/130
15 Cyclone 1.0 105.5/130
16 Toga II 1.3x4 105.0/130
17 Toga II CMLX 1.4 beta5d 105.0/129
18 Grapefruit 1.0 alpha 2 104.0/130
19 Toga II 1.4.1SE 104.0/130
20 Toga II 3.1.2SE 102.0/130
21 Cyclone 1.0 beta 101.5/130
22 Toga II 1.21a 100.0/130
23 Toga II 1.3.4 100.0/130
24 Toga II 1.4 WHMlearnCFS13 99.5/127
25 Toga II 1.21 99.0/130
26 Toga II 1.4 beta4a 96.5/130
27 Delfi 5.1 96.0/130
28 Delfi 5.2 94.0/130
29 Toga II 3.1.2SE Checkov beta 3 94.0/130
30 Strelka 2.0b 93.0/130
31 Toga II 1.1 93.0/130
32 Toga II 1.2 beta2a 93.0/130
33 Toga II 1.4 Checkov Beta_3 93.0/130
34 Fruit 2.1 90.0/130
35 Delfi 5.0 88.5/130
36 Gambit Fruit 1.0 beta 4bx 87.0/130
37 Toga II 1.2 86.5/130
38 Delfi 4.5 85.0/130
39 Glaurung 1.2.1 84.0/130
40 Cyrano 0.6b17 84.0/131
41 Scorpio 2.02 83.0/130
42 SlowChess Blitz WV2.1 82.5/130
43 Gambit Fruit 1.0 Beta 1 81.0/130
44 Glaurung 2-epsilon/5 80.5/130
45 Glaurung 2-epsilon/2 80.0/130
46 Toga II 0.93 79.5/130
47 Gambit Fruit 1.0 Beta 2 79.5/130
48 Gambit Fruit 1.0 Beta 1.1a 79.5/130
49 Crafty 22.7 79.5/130
50 Glaurung 2-epsilon/4 79.0/130
51 Fruit 2.0 77.5/130
52 Glaurung 071001 76.0/130
53 Gambit Fruit 1.0 Beta 3 76.0/130
54 Glaurung Lodz 2007 75.5/130
55 Crafty 21.4 75.5/130
56 Toga II 1.0 75.0/130
57 Cyrano 0.5 75.0/132
58 Pepito v1.59 73.5/130
59 Pepito v1.55 73.5/130
60 Crafty 22.0 73.5/130
61 Crafty 18.1 72.5/130
62 Crafty 20.0 72.5/130
63 Glaurung 1.0.1 71.5/130
64 Scorpio 1.91 71.0/129
65 SlowChess Blitz 0.4 70.5/130
66 Crafty 19.0 70.5/130
67 Danasah 3.00 70.5/130
68 Fruit 1.5 69.0/130
69 Booot 4.14.0 69.0/130
70 Crafty 20.10 67.5/130
71 Scorpio 1.81 64.0/130
72 Arasan 8.4 62.0/130
73 Arasan 10.4 61.0/130
74 Cyrano 0.4 60.5/131
75 Diablo 0.5.1 58.0/130
76 Amy 0.8.7 57.5/130
77 Booot 4.13.1 57.5/130
78 Typhoon 1.00 358 57.5/130
79 Sloppy 0.2.0 57.0/129
80 Booot 4.12.1 57.0/130
81 Arasan 9.5 56.5/130
82 Danasah 3.97b 55.0/130
83 Fruit 1.0 51.5/130
84 Arasan 7.4 50.5/130
85 Typhoon 1.00 320 49.5/128
86 Kiwi 0.6d 47.0/130
87 Arasan 6.3 47.0/130
88 Xpdnt 080927 46.0/130
89 Cyrano 0.3 46.0/130
90 Typhoon 1.00 304 45.0/128
91 Resp 0.1.9 41.5/130
92 Danasah 2.00 41.0/130
93 Romichess P3k 40.0/130
94 Exchess 5.01 beta 40.0/130
95 Typhoon 1.00 340 40.0/126
96 SlowChess 2.82a 39.5/130
97 Thor's Hammer 2.28 39.5/130
98 Brutus 6.1 38.5/130
99 BBChess 1.3a 37.5/130
100 Romichess P3k - no learn 37.0/130
101 Phalanx XXII 36.5/130
102 Olithink 5.1.8 alpha 35.5/130
103 Natwarlal 0.14 35.5/130
104 Feuerstein 0.4.5.2 33.0/130
105 BBChess 1.1 32.0/130
106 Kiwi 0.5d 31.5/130
107 Kiwi 0.4d 30.5/130
108 GreKo 6.1 29.5/130
109 Sage 3.53 27.5/130
110 Kiwi 0.3c 27.5/130
111 BBChess 1.2a 26.0/130
112 Prophet 2.0 25.0/130
113 Lime 6.6 25.0/130
114 Amundsen 0.65.1 24.5/132
115 Beowulf 2.4 24.5/130
116 ZCT 0.3.2445 24.5/130
117 Rattatechess 1.0-rc1 Bologna 2 22.0/130
118 Glaurung 2.1 21.5/130
119 Witz alpha 21 20.5/130
120 OliThink 4.1.1 19.5/130
121 Glaurung 080420 19.5/130
122 Glaurung 2.0 19.0/130
123 Gullydeckel 2.16.pl1 17.5/130
124 Sage 2.2a 16.5/130
125 BibiChess 0.5 15.0/130
126 Stockfish 1.01 14.0/130
127 Mediocre 0.332 11.5/130
128 Smash 1.03 10.5/130
129 Micro-Max 4.8 9.5/130
130 Lime 4.8 3.5/130

[Jouni]

So nobody has still beaten Toga II 1.4 beta5c significantly. Respect to
Thomas Gaksch!

Jouni