005 - CCLS Season 02 - Entry League (64 engines)

[CMCanavessi]

I don't have, but after the current league ends, I'll test jumbo and cheese and let you know. It's pretty easy to replicate the probem.

[CMCanavessi]

Standings after round 27/126:

Code: Select all

Score	Engine
26.5/27	WyldChess 1.51 x64
26.0/27	Critter 1.6a x64
23.5/27	Zurichess Neuchatel x64
23.5/27	Toga II 4.01 x64
23.0/27	Atlas 3.91 x64
23.0/27	Dirty Apr 30 2017 x64
23.0/27	ECE-X3 x64
22.0/27	The Baron 3.42 x64
22.0/27	Gaviota v1.0 x64
22.0/27	E.T.Chess 13/01/2008 x32
21.5/27	Shield 2.1 x64
21.0/27	ChessBrainVB 3.61 x32
21.0/27	Alaric 707 x32
20.5/27	Fruit 2.1 x32
20.5/27	Marvin 2.2.0 x64
20.0/27	Gogobello 1.4 x64
20.0/27	GreKo 2017 x64
19.0/27	Jonny 4.00 x32
18.5/27	Counter 2.1.0 x64
17.5/27	Pharaon 3.5.1 x32
17.5/27	Devel 1.8090 x32
17.5/27	Schooner v1.8 x64
17.0/27	RomiChess P3n x64
16.5/27	DanaSah 7.00 x32
14.5/27	Monolith 0.3 x64
14.5/27	MadChess 2.2 x64
14.5/27	Betsabe II 1.75 x32
14.5/27	Dimitri 3.93 x32
14.0/27	Chispa 4.0.3 x32
14.0/27	FireFly v2.7.2 x64
14.0/27	CmcChess 2.6 x64
13.5/27	Nemeton 1.61 x32
13.5/27	Orion 0.4 x64
13.0/27	EveAnn 1.72 x32
12.5/27	Absolute Zero 2.4.7.2 x64
12.0/27	Popochin v4.0 x64
11.5/27	Bumblebee 1.0.36898e1 x64
11.5/27	Isa 2.0.61 x64
11.5/27	Galjoen 0.37.2.1 x64
11.0/27	RubiChess 0.7 x64
11.0/27	Dumb 1.0 x64
10.5/27	Snowy 0.2 x64
10.0/27	Vice 1.1 x32
10.0/27	Prophet v3.0 20170909 x64
10.0/27	CPW-Engine 1.1 x64
9.5/27	GopherCheck 0.2.3 x64
9.5/27	Waxman 2017 x32
9.0/27	Dorpsgek Dillinger x64
9.0/27	CT800 V1.12 x64
9.0/27	Zevra v1.8.1 r594 x64
7.5/27	Embla 1.0.1 x64
7.5/27	RamJet 0.14 x64
5.5/27	RataAeroespacial 0.2.1 x32
5.5/27	Skiull 0.3 x64
5.5/27	Sayuri 2017.12.16 x64
4.0/27	HoiChess 0.21.0 x64
3.5/27	Pulse 1.6.1 x64
3.5/27	TSCP 1.81 x32
3.0/27	Pwned v1.3 x64
2.5/27	Ceibo v0.3.65 x64
2.0/27	Sabrina 3.1.25 x64
2.0/27	Supra 26.0 Pro x64
2.0/27	Shallow Blue 1.1.0 x64
0.0/27	Dragontooth 0.2 Bahamut x64

Full crosstable here: https://pastebin.com/6GXfs3V0

[Patrice Duhamel]

I don't have, but after the current league ends, I'll test jumbo and cheese and let you know. It's pretty easy to replicate the probem.

I found the problem, pondering doesn't work well since version 1.9.
In UCI mode sometimes bestmove is sent twice, and pondering doesn't work in Winboard mode.

[CMCanavessi]

I don't have, but after the current league ends, I'll test jumbo and cheese and let you know. It's pretty easy to replicate the probem.

I found the problem, pondering doesn't work well since version 1.9.
In UCI mode sometimes bestmove is sent twice, and pondering doesn't work in Winboard mode.

That's great! Can we expect a bugfix/new version soon? I will definitely include it in Season 3 if it works well.

[CMCanavessi]

Round 32 has just finished. That's half the first round robin complete (25% of all games played) and the standings are starting to take a more expected shape/order, with one exception: WyldChess
WyldChess is in 2nd place only because the level of oposition it has faced so far is a joke compared to the rest of the engines. It has gotten 30 points in 32 matches, but now it will start to go down as it faces all the top engines. Just to give perspective, it hasn't played against any engine in current top 28 positions. In the elo performance rating, it's in position 17 though, which is much more reasonable.
For the 2nd half of the first round robin, I expect it to get no more than 12 or 13 points out of 32 games. We'll see...

On the other hand, Critter is way ahead of the rest (as expected).


Current standings:

Code: Select all

Score	Engine
31.0/32	Critter 1.6a x64
30.0/32	WyldChess 1.51 x64
28.5/32	Zurichess Neuchatel x64
28.5/32	Toga II 4.01 x64
28.0/32	Atlas 3.91 x64
28.0/32	Dirty Apr 30 2017 x64
27.0/32	The Baron 3.42 x64
27.0/32	Gaviota v1.0 x64
26.5/32	Shield 2.1 x64
25.5/32	ChessBrainVB 3.61 x32
25.0/32	GreKo 2017 x64
25.0/32	E.T.Chess 13/01/2008 x32
25.0/32	Gogobello 1.4 x64
25.0/32	Alaric 707 x32
24.5/32	Fruit 2.1 x32
24.5/32	ECE-X3 x64
24.0/32	Marvin 2.2.0 x64
23.0/32	Jonny 4.00 x32
22.5/32	Counter 2.1.0 x64
22.5/32	Devel 1.8090 x32
22.0/32	Pharaon 3.5.1 x32
22.0/32	Schooner v1.8 x64
21.5/32	DanaSah 7.00 x32
20.5/32	RomiChess P3n x64
19.0/32	Monolith 0.3 x64
18.5/32	Nemeton 1.61 x32
18.0/32	Betsabe II 1.75 x32
17.5/32	MadChess 2.2 x64
17.0/32	EveAnn 1.72 x32
16.5/32	Orion 0.4 x64
16.0/32	Dimitri 3.93 x32
16.0/32	FireFly v2.7.2 x64
15.5/32	Chispa 4.0.3 x32
15.5/32	Absolute Zero 2.4.7.2 x64
14.5/32	Bumblebee 1.0.36898e1 x64
14.0/32	CmcChess 2.6 x64
13.5/32	Dumb 1.0 x64
12.5/32	GopherCheck 0.2.3 x64
12.5/32	RubiChess 0.7 x64
12.5/32	Isa 2.0.61 x64
12.5/32	CPW-Engine 1.1 x64
12.5/32	Popochin v4.0 x64
12.5/32	Galjoen 0.37.2.1 x64
12.0/32	Prophet v3.0 20170909 x64
11.5/32	Zevra v1.8.1 r594 x64
11.0/32	Dorpsgek Dillinger x64
10.5/32	Snowy 0.2 x64
10.0/32	CT800 V1.12 x64
10.0/32	Vice 1.1 x32
9.5/32	Waxman 2017 x32
8.5/32	Embla 1.0.1 x64
7.5/32	RamJet 0.14 x64
5.5/32	RataAeroespacial 0.2.1 x32
5.5/32	Skiull 0.3 x64
5.5/32	Sayuri 2017.12.16 x64
4.0/32	HoiChess 0.21.0 x64
4.0/32	Pulse 1.6.1 x64
4.0/32	TSCP 1.81 x32
3.0/32	Pwned v1.3 x64
2.5/32	Ceibo v0.3.65 x64
2.0/32	Sabrina 3.1.25 x64
2.0/32	Supra 26.0 Pro x64
2.0/32	Shallow Blue 1.1.0 x64
0.0/32	Dragontooth 0.2 Bahamut x64

Full crosstable here: https://pastebin.com/QdZun3C6

[Patrice Duhamel]

That's great! Can we expect a bugfix/new version soon? I will definitely include it in Season 3 if it works well.

I don't know if I will find the time to fix this and release a bugfix version soon.
And for a new version, my goal was to release a new version next year.

When your Season 3 start ?

[CMCanavessi]

That's great! Can we expect a bugfix/new version soon? I will definitely include it in Season 3 if it works well.

I don't know if I will find the time to fix this and release a bugfix version soon.
And for a new version, my goal was to release a new version next year.

When your Season 3 start ?

I think it about 2 months. From your tests, if I disable ponder will the bad behaviour go away? I could use it that way, but it would lose a little bit of elo.

[Patrice Duhamel]

I think it about 2 months. From your tests, if I disable ponder will the bad behaviour go away? I could use it that way, but it would lose a little bit of elo.

Yes it works without pondering.
I will try to find the time to fix it.

[CMCanavessi]

I think it about 2 months. From your tests, if I disable ponder will the bad behaviour go away? I could use it that way, but it would lose a little bit of elo.

Yes it works without pondering.
I will try to find the time to fix it.

That would be awesome!

[CMCanavessi]

Standings after 40/126 rounds:

Code: Select all

Score	Engine
38.5/40	Critter 1.6a x64
37.5/40	WyldChess 1.51 x64
36.5/40	Zurichess Neuchatel x64
36.5/40	Toga II 4.01 x64
36.0/40	Atlas 3.91 x64
36.0/40	Dirty Apr 30 2017 x64
35.0/40	The Baron 3.42 x64
35.0/40	Gaviota v1.0 x64
34.5/40	Shield 2.1 x64
33.5/40	ChessBrainVB 3.61 x32
32.5/40	Gogobello 1.4 x64
32.5/40	Fruit 2.1 x32
32.5/40	ECE-X3 x64
32.0/40	GreKo 2017 x64
31.5/40	Alaric 707 x32
31.0/40	E.T.Chess 13/01/2008 x32
31.0/40	Marvin 2.2.0 x64
30.5/40	Jonny 4.00 x32
30.0/40	Devel 1.8090 x32
30.0/40	Pharaon 3.5.1 x32
29.0/40	Counter 2.1.0 x64
29.0/40	DanaSah 7.00 x32
28.0/40	Schooner v1.8 x64
24.5/40	Monolith 0.3 x64
23.5/40	RomiChess P3n x64
23.5/40	Betsabe II 1.75 x32
22.5/40	Nemeton 1.61 x32
21.0/40	Orion 0.4 x64
20.5/40	MadChess 2.2 x64
20.0/40	CmcChess 2.6 x64
19.0/40	EveAnn 1.72 x32
18.5/40	Bumblebee 1.0.36898e1 x64
18.0/40	Dimitri 3.93 x32
17.5/40	FireFly v2.7.2 x64
17.0/40	Absolute Zero 2.4.7.2 x64
16.5/40	Chispa 4.0.3 x32
16.0/40	Snowy 0.2 x64
14.5/40	RubiChess 0.7 x64
14.0/40	Isa 2.0.61 x64
13.5/40	Prophet v3.0 20170909 x64
13.5/40	Galjoen 0.37.2.1 x64
13.5/40	Dumb 1.0 x64
13.5/40	Popochin v4.0 x64
13.0/40	GopherCheck 0.2.3 x64
13.0/40	CPW-Engine 1.1 x64
12.5/40	RamJet 0.14 x64
12.0/40	Dorpsgek Dillinger x64
12.0/40	Vice 1.1 x32
11.5/40	Zevra v1.8.1 r594 x64
11.0/40	CT800 V1.12 x64
11.0/40	Waxman 2017 x32
9.0/40	Embla 1.0.1 x64
8.0/40	Skiull 0.3 x64
7.5/40	Sayuri 2017.12.16 x64
6.5/40	HoiChess 0.21.0 x64
5.5/40	RataAeroespacial 0.2.1 x32
4.5/40	Ceibo v0.3.65 x64
4.5/40	Pwned v1.3 x64
4.0/40	Pulse 1.6.1 x64
4.0/40	TSCP 1.81 x32
4.0/40	Shallow Blue 1.1.0 x64
3.0/40	Supra 26.0 Pro x64
2.5/40	Sabrina 3.1.25 x64
2.0/40	Dragontooth 0.2 Bahamut x64

Full crosstable: https://pastebin.com/Y05VntgC


Cheers!