Crafty-22.2 is available

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Crafty-22.2 is available

Post by bob »

Werner wrote:
Peter Skinner wrote:I would like to state that 22.2 is _significantly_ better than the previous best version of 21.7.

In my own testing and confirmed by the way we internally test, 22.2 has become stronger than Fruit 2.1,
Whow, that´s a surprise: about 130 elos better than version 22.1 8-)

and here an example from my running tournament:

[Event "Bug-1"]
[Site "AMD64-X2"]
[Date "2008.11.16"]
[Round "2"]
[White "Crafty 22.2 x64 1CPU"]
[Black "BugChess2 v.1.6.3"]
[Result "1-0"]
[BlackElo "2200"]
[Time "21:32:29"]
[WhiteElo "2200"]
[TimeControl "40/900:40/900:40/900"]
[Termination "adjudication"]
[PlyCount "58"]
[WhiteType "program"]
[BlackType "program"]

1. e4 c5 2. Nf3 d6 3. d4 cxd4 4. Nxd4 Nf6 5. Nc3 a6 6. Be3 e6 7. f3 b5 8.
g4 h6 9. Qd2 Nbd7 10. O-O-O Bb7 11. a3 {+0.15/13 17} d5 {0.00/13 20} 12.
exd5 {+0.20/15 17} Nxd5 {0.00/13 30} 13. Nxd5 {+0.18/14 20} Bxd5 {-0.04/13
19} 14. h4 {+0.07/13 17} e5 {+0.11/13 30} 15. Re1 {+0.22/12 18} Rc8
{-0.15/13 76} 16. Bd3 {+0.61/13 17} Nc5 {-0.24/13 33} 17. Bf4 {-0.13/12 19}
f6 {+0.03/13 28} 18. Bxe5 {+0.23/13 17} fxe5 {0.00/13 22} 19. Rxe5+
{+0.01/11 18} Kf7 {0.00/14 40} 20. Bf5 {+0.01/12 18} Rc7 {0.00/13 26} 21.
b4 {+0.01/12 18} Bxf3 {0.00/13 28} 22. bxc5 {+0.01/12 23} Bxh1 {-3.89/13
151} 23. Qd3 {+1.53/12 18} Kf6 {-4.33/11 129} 24. Re1 {+6.30/11 18} g5
{-7.34/11 25} 25. Bh7 {+9.91/12 37} Rhxh7 {-7.91/12 19} 26. hxg5+
{+10.82/12 18} hxg5 {-7.94/13 5} 27. Rf1+ {+12.61/14 18} Kg7 {-12.26/14 24}
28. Ne6+ {+15.72/15 18} Kg8 {-15.81/14 85} 29. Qxd8 {+15.89/15 21} Rhf7
{-19.77/13 20} 30. ... {1-0 Arena Entscheidung} 1-0
Let me temper Peter's glowing comments with a stipulation that Crafty has been beating fruit 2.1 consistently using the new test scheme, which is no opening book, 3981 starting positions from move 15 in a large collection of good PGN games. Testing with books might produce different results, so the improvement is in the engine, rather than in the book. Books can greatly affect game results obviously...

Caveat emptor...
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Crafty-22.2 is available: Problems

Post by bob »

glorfindel wrote:It is good news that crafty is getting stronger, and fortunately with 22.2 I can take back moves in analysis mode with 4 threads running without a crash and with smpnice=1.

My problem is now in positions from the endgame TBs:
1. In analysis mode (in XBoard) I can see no output about the best move or the score. I only see depth 0 score +0.00.
2. If I play out a position from the endgame TBs against crafty and I take back a move, crafty crashes immediately like this:

Code: Select all

79230 >first : remove
xboard: Error: first chess program (/usr/games/bin/crafty) exited unexpectedly
GameEnds(0, (null), 2)
I managed to crash Crafty 2 times out of 2 in a K+2P v K+P ending, 2 times out of 2 in a K+B+P v K+N ending, but in a K+R+B v K+R ending it refused to crash and worked normally.

I used the Makefile provided, target linux-amd64, only with NUMA disabled.
if you add "noise 0" to your crafty.rc I think this will go away. It is interface issue with analysis mode where I don't send the interface updates until N nodes have been searched, and in egtb positions it is possible we never search N nodes if N is the 1,000,000 node default value...

I'll try to find a decent workaround that doesn't flood the interface when it is not an EGTB position, which is the issue.
swami
Posts: 6662
Joined: Thu Mar 09, 2006 4:21 am

Re: Crafty-22.2 is available: Problems

Post by swami »

Thanks, Bob. I will wait for Jim's compile although I will try Peter's and Dann's compile as well.

is this the exact ACCA version or something more was added? bug fix or something?
glorfindel

Re: Crafty-22.2 is available: Problems

Post by glorfindel »

bob wrote:if you add "noise 0" to your crafty.rc I think this will go away
Yes, I can see the output now, but the crash is still there when I take back a move.
peter
Posts: 3412
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Crafty-22.2 is available: Problems

Post by peter »

glorfindel wrote:
bob wrote:if you add "noise 0" to your crafty.rc I think this will go away
Yes, I can see the output now, but the crash is still there when I take back a move.
It's the same for me in Shredder and Fritz GUI but only taking back moves manually in analyze mode, not in automatic game
regards
Peter.
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Crafty-22.2 is available

Post by kranium »

Werner wrote:
Peter Skinner wrote:I would like to state that 22.2 is _significantly_ better than the previous best version of 21.7.

In my own testing and confirmed by the way we internally test, 22.2 has become stronger than Fruit 2.1,
Whow, that´s a surprise: about 130 elos better than version 22.1 8-)

Let me temper Peter's glowing comments with a stipulation that Crafty has been beating fruit 2.1 consistently using the new test scheme, which is no opening book, 3981 starting positions from move 15 in a large collection of good PGN games. Testing with books might produce different results, so the improvement is in the engine, rather than in the book. Books can greatly affect game results obviously...

Caveat emptor...
Congrats to Prof. Hyatt and anyone else working on Crafty...
extremely gratifying to see such progress on a great engine!
(i personally would like nothing more than to see Crafty go right to the top!)

Norm
trojanfoe

Re: Crafty-22.2 is available

Post by trojanfoe »

Peter Skinner wrote:
Damir wrote:that's the source, but where is the engine ?
I just compiled Win32 and Win64 exe's on my website:

http://www.webkikr.net
Peter, Crafty is crashing my laptop (32-bit Windows XP) after starting a game from the command prompt with default options (no .rc file):

Code: Select all

C:\TEMP>crafty-22.2-win32.exe
EPD Kit revision date: 1996.04.21
unable to open book file [./book.bin].
book is disabled
unable to open book file [./books.bin].

Initializing multiple threads.
System is SMP, not NUMA.

Crafty v22.2 (1 cpus)

White(1): e2e4
              time used:   2.41
              time surplus   0.00  time limit 30.00 (+0.00) (3:30)
              depth   time  score   variation (1)
               11     0.44   0.26   1. ... Nc6 2. Nc3 Nf6 3. Nf3 e5 4.
                                    Bb5 <HT>
               11     0.44   2/20*  1. ...
C:\TEMP>
I realise that I am probably not following the XBoard protocol, but it does seem to want to work before crashing...
maschmdt
Posts: 13
Joined: Sat Feb 23, 2008 8:07 pm

Re: Crafty-22.2 is available

Post by maschmdt »

Hi crafty fans,

same problem on vista ultimate 64 after typing "go" or "analyze". At least i get: "Fatal Exception: c0000005" from vista. Wb2Uci works quite fine (First long game first draw against Hoshad with rybka on playchess).

Congrats to Robert "Bob" Hyatt and the whole Crafty team for this fine release!
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Crafty-22.2 is available: Problems

Post by bob »

swami wrote:Thanks, Bob. I will wait for Jim's compile although I will try Peter's and Dann's compile as well.

is this the exact ACCA version or something more was added? bug fix or something?
Everything is identical except for the personality code. I had not fixed that code so that all the newer scoring terms were saved and loaded (if you diff option.c from 22.1 vs 22.2 you will see what was changed there). Engine-wise nothing has changed at all, except now the personality save / personality load / personality list commands all work correctly and save everything and restore it properly...
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Crafty-22.2 is available: Problems

Post by bob »

glorfindel wrote:
bob wrote:if you add "noise 0" to your crafty.rc I think this will go away
Yes, I can see the output now, but the crash is still there when I take back a move.
If you can send me an email explaining exactly how to re-create this, I'll give it a look. I don't use "analyze mode" much at all so that code has not changed in quite a while. If there was a bug there in older versions, it is certainly still there...