CCRL 40/4 - A new number one

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Uri Blass
Posts: 10282
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: CCRL 40/4 - A new number one

Post by Uri Blass »

Shaun wrote:Latest update here

Rybka 2.3.2 beta2 results after 305 games

http://computerchess.org.uk/ccrl/404.live/

Shaun
I see that movei00.8.423 is not there.
I wonder if you started to test it.

I am going to test some personalities to see if I can suggest some improvement to the default personality.

Uri
GS

Re: CCRL 40/4 - A new number one

Post by GS »

Uri Blass wrote:
Shaun wrote:Latest update here

Rybka 2.3.2 beta2 results after 305 games

http://computerchess.org.uk/ccrl/404.live/

Shaun
I see that movei00.8.423 is not there.

Uri
Movei versions after 00.8.403 are not freely available, right?
At least Leos site doesn't show me something newer.

Regards,
Guenther
Uri Blass
Posts: 10282
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: CCRL 40/4 - A new number one

Post by Uri Blass »

GS wrote:
Uri Blass wrote:
Shaun wrote:Latest update here

Rybka 2.3.2 beta2 results after 305 games

http://computerchess.org.uk/ccrl/404.live/

Shaun
I see that movei00.8.423 is not there.

Uri
Movei versions after 00.8.403 are not freely available, right?
At least Leos site doesn't show me something newer.

Regards,
Guenther
Right

Uri
Shaun
Posts: 322
Joined: Wed Mar 08, 2006 9:55 pm
Location: Brighton - UK

Re: CCRL 40/4 - A new number one

Post by Shaun »

Test running should have the results early next week.

Shaun

P.S. its ahead of 421
pichy
Posts: 2564
Joined: Thu Mar 09, 2006 3:04 am

Re: CCRL 40/4 - A new number one

Post by pichy »

Uri Blass wrote:
GS wrote:
Uri Blass wrote:
Shaun wrote:Latest update here

Rybka 2.3.2 beta2 results after 305 games

http://computerchess.org.uk/ccrl/404.live/

Shaun
I see that movei00.8.423 is not there.

Uri
Movei versions after 00.8.403 are not freely available, right?
At least Leos site doesn't show me something newer.

Regards,
Guenther
Right

Uri
I believe that it is time to release your last free version of Movei with your latest improvement of movilitydivider 64. I am rerunning the match with your latest personality:

knight_square_table 210 345 345 345 345 345 345 210 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 220 320 340 340 340 340 320 220 bishop_square_table 355 355 355 355 355 355 355 355 300 355 355 355 355 355 355 300 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 mobilitydivider 64 bigpositional_opening 135 bigpositional_endgame 135


PS: I had the wrong movei_changes423, but now that I corrected it with your personality, movei423 is really strong :wink:


Engine Score Mo Ru Co Wi Al Pe S-B
1: Movei00_8_423 6.0/6 ·· 1 1 1 11 1 14.00
2: Ruffian_105 3.0/6 0 ·· 1 1 = =0 7.25
3: Colossus2007b 3.0/6 0 0 ·· 01 1 1 6.00
4: WildCat_7 2.5/6 0 0 10 ·· = 1 5.50
5: AlaricWB704 2.0/6 00 = 0 = ·· 1 4.25
6: Petir439 1.5/6 0 =1 0 0 0 ·· 4.50

18 of 60 games played
Name of the tournament: Arena tournament
Site/ Country: Jorge, United States
Level: Tournament 40/1
Hardware: AMD Athlon(tm) Processor 1202 MHz with 512MB Memory
Operating system: Microsoft Windows XP Professional Service Pack 2 (Build 2600)
PGN-File: C:\Program Files\Arena\Arena.pgn
Website:
E-Mail Address:
Uri Blass
Posts: 10282
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: CCRL 40/4 - A new number one

Post by Uri Blass »

pichy wrote:
Uri Blass wrote:
GS wrote:
Uri Blass wrote:
Shaun wrote:Latest update here

Rybka 2.3.2 beta2 results after 305 games

http://computerchess.org.uk/ccrl/404.live/

Shaun
I see that movei00.8.423 is not there.

Uri
Movei versions after 00.8.403 are not freely available, right?
At least Leos site doesn't show me something newer.

Regards,
Guenther
Right

Uri
I believe that it is time to release your last free version of Movei with your latest improvement of movilitydivider 64. I am rerunning the match with your latest personality:

knight_square_table 210 345 345 345 345 345 345 210 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 345 220 320 340 340 340 340 320 220 bishop_square_table 355 355 355 355 355 355 355 355 300 355 355 355 355 355 355 300 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 355 mobilitydivider 64 bigpositional_opening 135 bigpositional_endgame 135


PS: I had the wrong movei_changes423, but now that I corrected it with your personality, movei423 is really strong :wink:


Engine Score Mo Ru Co Wi Al Pe S-B
1: Movei00_8_423 6.0/6 ·· 1 1 1 11 1 14.00
2: Ruffian_105 3.0/6 0 ·· 1 1 = =0 7.25
3: Colossus2007b 3.0/6 0 0 ·· 01 1 1 6.00
4: WildCat_7 2.5/6 0 0 10 ·· = 1 5.50
5: AlaricWB704 2.0/6 00 = 0 = ·· 1 4.25
6: Petir439 1.5/6 0 =1 0 0 0 ·· 4.50

18 of 60 games played
Name of the tournament: Arena tournament
Site/ Country: Jorge, United States
Level: Tournament 40/1
Hardware: AMD Athlon(tm) Processor 1202 MHz with 512MB Memory
Operating system: Microsoft Windows XP Professional Service Pack 2 (Build 2600)
PGN-File: C:\Program Files\Arena\Arena.pgn
Website:
E-Mail Address:
Thanks but I certainly do not plan to release a version based on 6 games.
6/6 is clearly misleading picture about movei playing strength(probably a similiar thing happened to glaurung when it got 3.5/6 against rybka2.3.2beta2).


I am going to make more tests.

Even if I release a new version I probably do not plan to make it free.
I do not believe that there is a big improvement relative to 421 or 423 and I will be surprised if there is more than a 30 elo improvement relative to them.

Uri
Shaun
Posts: 322
Joined: Wed Mar 08, 2006 9:55 pm
Location: Brighton - UK

Re: CCRL 40/4 - A new number one

Post by Shaun »

Shaun wrote:Test running should have the results early next week.

Shaun

P.S. its ahead of 421
Here are the Movei results so far:

Code: Select all

CCRL-40in4min-15  2007

Movei 0.08.423   - Arasan 9.2 CCRL            21.0 - 1.0    +20/-0/=2    95.45%
Movei 0.08.423   - E.T.Chess 18.11.05         12.0 - 10.0    +7/-5/=10    54.55%
Movei 0.08.423   - Naum 2.0 (32 bit)          6.5 - 15.5    +3/-12/=7    29.55%
Movei 0.08.423   - Petir 3.99d                16.5 - 5.5    +14/-3/=5    75.00%
Movei 0.08.423   - Pseudo 0.7c                10.5 - 11.5    +7/-8/=7    47.73%
Movei 0.08.423   - Scorpio 1.8.1 (32 bit)     10.5 - 11.5    +6/-7/=9    47.73%
Movei 0.08.423   - Scorpio 1.8.2 (32 bit)     8.0 - 14.0    +5/-11/=6    36.36%
Movei 0.08.423   - The Baron 1.7.0            13.5 - 8.5    +10/-5/=7    61.36%
Movei 0.08.423   - Thinker 4.7a               12.0 - 10.0    +7/-5/=10    54.55%
Movei 0.08.423   - WildCat 6                  13.0 - 9.0    +10/-6/=6    59.09%
Movei 0.08.423   - Scorpio 1.9JA (32 bit)     9.0 - 13.0    +6/-10/=6    40.91%
Movei 0.08.423   - Pro Deo 1.1                8.0 - 14.0    +3/-9/=10    36.36%
Movei 0.08.423   - Pro Deo 1.2                10.5 - 11.5    +6/-7/=9    47.73%
Movei 0.08.423   - SlowChess Blitz WV2.1      16.0 - 6.0    +12/-2/=8    72.73%
Movei 0.08.423   - WildCat 7                  8.0 - 14.0    +3/-9/=10    36.36%
Movei 0.08.423   - Ufim 8.02 CCRL             8.5 - 12.5    +7/-11/=3    40.48%
Shaun
Shaun
Posts: 322
Joined: Wed Mar 08, 2006 9:55 pm
Location: Brighton - UK

Re: CCRL 40/4 - A new number one

Post by Shaun »

Harvey Williamson wrote:
Shaun wrote:Hi Harvey,

We already exclude betas from our pure list

http://computerchess.org.uk/ccrl/404.li ... _pure.html

So 2.3.2 beta2 is not there

Shaun

P.S. H11.2 give me something that will give Rybka slightly less of an easy time :lol:
Yes but - Best is what people browsing your lists for the 1st time will look at - they wont understand what pure means. If Vas releases anything its tested in days. Loop releases 2 official engines this week - how long till they are fully both tested?
Hi again Harvey,

Code: Select all

4 Loop M1-T 64-bit 4CPU 2963 +22 −22 54.8% −32.7 36.5% 657 
Currently it does not look like it is worth testing the versions seperately on my Core 2 Duos - although I can't comment on 64-bit AMD.

Previous test.

Loop M1-P 64-bit 2CPU and Loop M1-P 64-bit 2CPU compared.

On my Core 2 Duo Loop M1-P 64-bit 2CPU appears to be 0.7% faster - I looked at kN/s as that is all you can do when more than 1 core.

I am will run a 100 game blitz gauntlet between the versions as a double check?

Shaun

Code: Select all

Loop M1-P 64-bit 2CPU 

rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1

Analysis by Loop M1-P 64-bit 2CPU:

1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 d7-d5 
  ²  (0.26)   Depth: 6   00:00:00  8kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 d7-d5 4.Bc1-f4 
  ²  (0.28)   Depth: 7   00:00:00  15kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 d7-d5 4.Bc1-f4 Bc8-f5 
  ²  (0.26)   Depth: 8   00:00:00  33kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 d7-d5 4.Qd1-d3 Qd8-d6 5.Bc1-g5 
  =  (0.07)   Depth: 9   00:00:00  78kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 d7-d5 4.Bc1-f4 Bc8-f5 5.Nc3-b5 Ra8-c8 
  ²  (0.33)   Depth: 10   00:00:00  232kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 d7-d5 4.e2-e3 Bc8-f5 5.Bf1-d3 Bf5xd3 6.Qd1xd3 e7-e6 
  =  (0.19)   Depth: 11   00:00:00  399kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 d7-d5 4.e2-e3 e7-e6 5.Bf1-d3 Bf8-d6 6.0-0 0-0 
  ²  (0.26)   Depth: 12   00:00:00  1151kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 d7-d5 4.e2-e3 e7-e6 5.Bf1-d3 Bf8-d6 6.0-0 0-0 7.Nf3-g5 
  =  (0.15)   Depth: 13   00:00:01  2271kN
1.e2-e4 Ng8-f6 2.e4-e5 Nf6-d5 3.Ng1-f3 Nb8-c6 4.c2-c4 Nd5-b6 5.c4-c5 Nb6-d5 6.Nb1-c3 Nd5-f4 7.d2-d4 
  =  (0.23)   Depth: 13   00:00:03  9724kN
1.e2-e4 Ng8-f6 2.e4-e5 Nf6-d5 3.Ng1-f3 d7-d6 4.d2-d4 Bc8-g4 5.Bf1-c4 d6xe5 6.h2-h3 Bg4xf3 7.Qd1xf3 e7-e6 8.d4xe5 
  ²  (0.26)   Depth: 14   00:00:05  18305kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 e7-e6 4.e2-e3 Bf8-b4 5.Bf1-d3 Nf6-d5 6.Bc1-d2 Bb4xc3 7.b2xc3 0-0 8.0-0 
  ²  (0.35)   Depth: 14   00:00:05  18306kN
1.Ng1-f3 Ng8-f6 2.d2-d4 d7-d5 3.e2-e3 Nb8-c6 4.Nb1-c3 Bc8-d7 5.Bf1-d3 Nc6-b4 6.0-0 h7-h5 7.Bd3-e2 h5-h4 
  ²  (0.36)   Depth: 14   00:00:05  18441kN
1.Ng1-f3 Ng8-f6 2.Nb1-c3 Nb8-c6 3.d2-d4 d7-d5 4.Bc1-f4 Nf6-h5 5.Bf4-d2 e7-e6 6.e2-e3 Bf8-d6 7.Bf1-d3 0-0 8.0-0 
  =  (0.19)   Depth: 15   00:00:08  27559kN
1.e2-e4 Ng8-f6 2.e4-e5 Nf6-d5 3.Ng1-f3 d7-d6 4.d2-d4 Nb8-c6 5.Bf1-c4 d6xe5 6.Nf3xe5 Nc6xe5 7.d4xe5 e7-e6 8.0-0 Bf8-c5 
  =  (0.23)   Depth: 15   00:00:13  48548kN
1.e2-e4 e7-e5 2.Ng1-f3 Nb8-c6 3.Bf1-b5 Ng8-f6 4.d2-d3 Bf8-c5 5.Nb1-c3 0-0 6.Nc3-a4 Bc5-e7 7.0-0 d7-d6 8.Bc1-e3 Bc8-e6 
  ²  (0.28)   Depth: 16   00:00:39  149mN
1.e2-e4 e7-e5 2.Ng1-f3 Nb8-c6 3.Bf1-b5 Ng8-f6 4.0-0 Bf8-c5 5.c2-c3 0-0 6.d2-d4 Bc5-b6 7.d4xe5 Nf6xe4 8.Qd1-d5 Ne4xf2 
  ²  (0.35)   Depth: 17   00:01:02  239mN
1.e2-e4 e7-e5 2.Ng1-f3 Ng8-f6 3.Nf3xe5 d7-d6 4.Ne5-f3 Nf6xe4 5.d2-d3 Ne4-f6 6.Nb1-c3 Nb8-c6 7.d3-d4 d6-d5 8.Bf1-d3 Bf8-d6 
  ²  (0.28)   Depth: 18   00:01:55  443mN
1.e2-e4 e7-e5 2.Ng1-f3 Ng8-f6 3.Nf3xe5 d7-d6 4.Ne5-f3 Nf6xe4 5.Bf1-b5+ c7-c6 6.Bb5-e2 d6-d5 7.d2-d3 Ne4-f6 8.Nb1-c3 Bf8-d6 
  ²  (0.31)   Depth: 19   00:03:39  852mN
1.e2-e4 e7-e5 2.Ng1-f3 Ng8-f6 3.Nf3xe5 d7-d6 4.Ne5-f3 Nf6xe4 5.d2-d3 Ne4-f6 6.Nb1-c3 Nb8-c6 7.d3-d4 d6-d5 8.Bf1-d3 Bf8-d6 
  ²  (0.27)   Depth: 20   00:07:03  1657mN

(Brewer, N/A 07.06.2007)

25 min 3890kN/s

Loop M1-P 64-bit 2CPU

rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1

Analysis by Loop M1-T 64-bit 2CPU:

1.Nb1-c3 Nb8-c6 2.Ng1-f3 Ng8-f6 3.d2-d4 d7-d5 
  ²  (0.26)   Depth: 6   00:00:00  9kN
1.Nb1-c3 Nb8-c6 2.Ng1-f3 Ng8-f6 3.d2-d4 d7-d5 4.Bc1-f4 
  ²  (0.28)   Depth: 7   00:00:00  21kN
1.Nb1-c3 Nb8-c6 2.Ng1-f3 Ng8-f6 3.d2-d4 d7-d5 4.Bc1-f4 Bc8-f5 
  ²  (0.26)   Depth: 8   00:00:00  40kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 d7-d5 4.Qd1-d3 Qd8-d6 5.Bc1-g5 
  =  (0.07)   Depth: 9   00:00:00  122kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 d7-d5 4.Bc1-f4 Bc8-f5 5.Nc3-b5 Ra8-c8 
  ²  (0.33)   Depth: 10   00:00:00  267kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 d7-d5 4.e2-e3 Bc8-f5 5.Bf1-d3 Bf5xd3 6.Qd1xd3 e7-e6 
  =  (0.19)   Depth: 11   00:00:00  507kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 d7-d5 3.d2-d4 e7-e6 4.e2-e3 Bf8-d6 5.Bf1-d3 Nb8-c6 6.0-0 0-0 
  ²  (0.26)   Depth: 12   00:00:00  1217kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 d7-d5 3.d2-d4 e7-e6 4.e2-e3 Bf8-d6 5.Bf1-d3 Nb8-c6 6.0-0 0-0 7.Nf3-g5 
  =  (0.15)   Depth: 13   00:00:00  2798kN
1.Nb1-c3 Ng8-f6 2.Ng1-f3 Nb8-c6 3.d2-d4 e7-e6 4.e2-e3 Bf8-b4 5.Bf1-d3 Nf6-d5 6.Bc1-d2 Bb4xc3 7.b2xc3 0-0 8.0-0 
  ²  (0.35)   Depth: 14   00:00:02  9528kN
1.Ng1-f3 Ng8-f6 2.d2-d4 d7-d5 3.e2-e3 Nb8-c6 4.Nb1-c3 Bc8-d7 5.Bf1-d3 Nc6-b4 6.0-0 h7-h5 7.Bd3-e2 h5-h4 
  ²  (0.36)   Depth: 14   00:00:04  14948kN
1.Ng1-f3 Ng8-f6 2.Nb1-c3 d7-d5 3.d2-d4 e7-e6 4.Bc1-g5 h7-h6 5.Bg5xf6 Qd8xf6 6.e2-e4 Bf8-b4 7.e4xd5 e6xd5 8.Bf1-b5+ Nb8-c6 
  =  (0.16)   Depth: 15   00:00:07  26733kN
1.Nb1-c3 Ng8-f6 2.e2-e4 Nb8-c6 3.Ng1-f3 e7-e5 4.Bf1-b5 Bf8-b4 5.0-0 0-0 6.Bb5xc6 d7xc6 7.Nf3xe5 Rf8-e8 8.d2-d4 Bb4xc3 
  =  (0.18)   Depth: 15   00:00:09  32739kN
1.e2-e4 Ng8-f6 2.e4-e5 Nf6-d5 3.Ng1-f3 d7-d6 4.d2-d4 Nb8-c6 5.Bf1-c4 d6xe5 6.Nf3xe5 Nc6xe5 7.d4xe5 e7-e6 8.0-0 Bf8-c5 
  =  (0.23)   Depth: 15   00:00:15  54496kN
1.e2-e4 Ng8-f6 2.e4-e5 Nf6-d5 3.Ng1-f3 d7-d6 4.d2-d4 Nb8-c6 5.Bf1-b5 Bc8-f5 6.0-0 a7-a6 7.Bb5-d3 Bf5xd3 8.Qd1xd3 d6xe5 
  ²  (0.33)   Depth: 16   00:00:24  89435kN
1.e2-e4 e7-e5 2.Ng1-f3 Nb8-c6 3.Bf1-b5 Ng8-f6 4.d2-d3 Bf8-c5 5.0-0 0-0 6.Bb5xc6 d7xc6 7.Nf3xe5 Rf8-e8 8.Ne5-f3 Nf6-g4 
  ²  (0.33)   Depth: 17   00:01:25  323mN
1.e2-e4 e7-e5 2.Ng1-f3 Nb8-c6 3.Bf1-b5 Ng8-f6 4.0-0 Bf8-c5 5.c2-c3 0-0 6.d2-d4 Bc5-b6 7.d4xe5 Nf6xe4 8.Nb1-d2 Bb6xf2+ 
  =  (0.23)   Depth: 18   00:02:08  491mN
1.e2-e4 e7-e6 2.d2-d4 d7-d5 3.e4xd5 e6xd5 4.Bf1-b5+ Bc8-d7 5.Qd1-e2+ Bf8-e7 6.Ng1-f3 Ng8-f6 7.0-0 0-0 8.Nb1-c3 Nb8-c6 
  ²  (0.31)   Depth: 19   00:07:51  1805mN
1.e2-e4 e7-e6 2.d2-d4 d7-d5 3.e4xd5 e6xd5 4.Bf1-b5+ Nb8-c6 5.Qd1-e2+ Bf8-e7 6.Ng1-f3 Ng8-f6 7.Nf3-e5 Bc8-d7 8.Bb5xc6 b7xc6 
  ²  (0.27)   Depth: 20   00:12:09  2812mN
1.e2-e4 e7-e6 2.d2-d4 d7-d5 3.e4xd5 e6xd5 4.Bf1-b5+ c7-c6 5.Bb5-d3 Bf8-d6 6.Ng1-f3 Nb8-a6 7.0-0 Ng8-e7 8.a2-a3 0-0 
  =  (0.24)   Depth: 21   00:25:16  5881mN

(Brewer, N/A 07.06.2007)


42 min 3864kN/s
P.P.S Any news on H11.2????
Spock

Re: CCRL 40/4 - A new number one

Post by Spock »

Harvey Williamson wrote: Loop releases 2 official engines this week - how long till they are fully both tested?
There is no consistency amongst authors these days as to what is a beta and what isn't. That's the problem

# Glaurung 2 - ε/3
quote from Tord
Glaurung 2 - ε/3, the latest development version of the program which will eventually be released as Glaurung 2
There is no "beta" in the name, but clearly it is one. No doubt about it. Development version = beta.

In my book the 2 Loops are betas. The decision to use threads or processes in SMP programming is a fundamental choice the author has to make. He or she would normally test it themselves and release ONE to the public. Indeed in future I doubt we'll see a "T" and a "P" - they will make their choice and stick with it. In my book it is slightly naughty to have released the two and rely on the testing community to do the work they should have done themselves

So - what is a beta and what isn't ? We can't just look for the word "beta" that is clear

In conclusion - it is hard to tell any more...

As for endless testing of Rybka betas - well you could always give us a Hiarcs beta and I'm sure we'd test it :D