Critte 0.90 released

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

swami
Posts: 6640
Joined: Thu Mar 09, 2006 4:21 am

Re: Critte 0.90 released

Post by swami »

Matthias Gemuh wrote:
IGarcia wrote:
I have been reading in forums that critter 0.9 is probably the best tactical engine now. I think if this is true it will get a nice STS score.

...

Ignacio.
What a paradox ! An engine scoring well in a strategic testsuite because of tactics. :D

Matthias.



:) Well, It's certainly possible for an engine to improve the strength in both the strategy and tactics.

Most EPD's in STS have immediate short term advantage in strategy. It could be called tactical Strategy (or threatening moves).

Strategy has numerous elements. A lot of them are ordinary plans with no significant plus in evaluation -- they are ignored. Only those plans with definite plus in evaluation are recorded in STS.
Jouni
Posts: 3293
Joined: Wed Mar 08, 2006 8:15 pm

Re: Critte 0.90 released

Post by Jouni »

I have tested Critter 0.90 in STS test. In 2 CPU / 64b / 10s it solved 1138/1300 - good result. For comparison Houdini 1174, Rybka 4 1141 and Stockfish 1107.

Jouni
swami
Posts: 6640
Joined: Thu Mar 09, 2006 4:21 am

Re: Critte 0.90 released

Post by swami »

Results of STS 1-13 for
Critter 0.90 :
Single CPU, Q6600, 32 bits, Arena 2.5 beta

Code: Select all

STS 01: 94
STS 02: 80
STS 03: 84
STS 04: 89
STS 05: 86
STS 06: 84
STS 07: 83
STS 08: 74
STS 09: 79
STS 10: 85
STS 11: 84
STS 12: 83
STS 13: 84
Total:

Code: Select all

1089/1300

I had sent the logfile to Gailhac to see if STS Stat could be made to work with scores from STS 13 taken into account.


Critter 0.80

Image

In comparison with Critter 0.70

Image

http://sites.google.com/site/strategict ... st-results

1000 Positions
10 seconds per position
Hardware: Q6600, 32 bits, 2 GB RAM, 2.4 GHZ. Arena 2.01 GUI.
Last edited by swami on Fri Dec 03, 2010 4:19 pm, edited 1 time in total.
Jouni
Posts: 3293
Joined: Wed Mar 08, 2006 8:15 pm

Re: Critte 0.90 released

Post by Jouni »

After installing 3-4 Gaviota bases Critter is the best in all endgamesuites I have. E.g. in EET (2CPU):

00:00:01
00:00:01
00:00:00
00:00:02
00:00:08
00:00:01
00:00:00
00:00:03
00:00:04
00:00:00
00:00:00
00:00:00
00:01:00
00:00:00
00:01:00
00:00:38
00:00:16
00:00:01
00:00:01
00:00:02
00:00:01
00:00:00
00:00:01
00:00:00
00:00:00
00:00:02
00:00:52
00:00:00
00:00:00
00:01:00
00:01:00
00:01:00
00:00:01
00:01:00
00:00:02
00:00:00
00:00:00
00:00:00
00:00:00
00:00:00
00:00:02
00:01:00
00:00:01
00:00:00
00:00:03
00:00:02
00:00:01
00:00:24
00:00:01
00:00:00
00:00:00
00:00:05
00:00:03
00:00:06
00:00:05
00:00:50
00:00:00
00:00:34
00:00:00
00:00:16
00:01:01
00:00:02
00:01:00
00:00:06
00:00:02
00:01:00
00:00:03
00:00:02
00:00:02
00:00:00
00:01:00
00:00:00
00:00:24
00:00:03
00:00:02
00:00:43
00:00:00
00:00:25
00:00:13
00:00:00
00:00:01
00:00:01
00:00:01
00:00:11
00:00:32
00:00:18
00:00:01
00:00:00
00:00:01
00:00:10
00:00:00
00:00:02
00:00:08
00:00:04
00:01:00
00:00:00
00:00:02
00:00:01
00:00:01
00:00:00

solved 89/100

Jouni
IGarcia
Posts: 543
Joined: Mon Jul 05, 2010 10:27 pm

Re: Critte 0.90 released

Post by IGarcia »

Matthias Gemuh wrote:
IGarcia wrote:
I have been reading in forums that critter 0.9 is probably the best tactical engine now. I think if this is true it will get a nice STS score.

...

Ignacio.
What a paradox ! An engine scoring well in a strategic testsuite because of tactics. :D

Matthias.
Yes, Critter its good in tactical and im expecting a good strategic result.
I am try to express is if the engine is getting better in one thing, probably its geting better in overal, because better optimal code, etc...

Maybe i do too much simplification on my post.

I really dislike to express my self in a language like "english". And mistakes on interpretation and expressions happens. Like the bugs in programas (not speaking on your GUI).

We have to live with this issues and try to get better every day.

Im offtopic :lol:
Jouni
Posts: 3293
Joined: Wed Mar 08, 2006 8:15 pm

Re: Critte 0.90 released

Post by Jouni »

Swaminathan, what's the reason to test with single cpu in Q6600 :?

Jouni
Damir
Posts: 2801
Joined: Mon Feb 11, 2008 3:53 pm
Location: Denmark
Full name: Damir Desevac

Re: Critte 0.90 released

Post by Damir »

maybe because the strength of an engine is best noticed when using single

CPU ? :lol: :lol:
swami
Posts: 6640
Joined: Thu Mar 09, 2006 4:21 am

Re: Critte 0.90 released

Post by swami »

Jouni wrote:Swaminathan, what's the reason to test with single cpu in Q6600 :?

Jouni
It's because I have tested many engines in single CPU. It's for comparison purposes, besides I just wanted to analyze the data later - to see which specific EPD correlates with rating on single CPU, and how much it contributes as per measure of elo.

I will test it with 4 CPU's few days later.
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: Critte 0.90 released

Post by Milos »

Jouni wrote:Swaminathan, what's the reason to test with single cpu in Q6600 :?
Because time to fixed depth is practically a random number in SMP and you would need to run 20 times each test to average the values. Otherwise results are just meaningless.
Jouni
Posts: 3293
Joined: Wed Mar 08, 2006 8:15 pm

Re: Critte 0.90 released

Post by Jouni »

With 1300 positions randomness is definitely insignificant!

Jouni