Critter teaser

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Ajedrecista
Posts: 2124
Joined: Wed Jul 13, 2011 9:04 pm
Location: Madrid, Spain.

Re: Critter teaser

Post by Ajedrecista »

Hello again:
rvida wrote:
Ajedrecista wrote:Hello Richard!
...
1330 games are a nice amount and I tried to find (with the only help of pencil, paper and Derive 6) the uncertainty of this test with ~ 95.45% confidence (2-sigma confidence)
...
... a lot of math ...
...
Your math skills seem to be well beyond my level, I am not able to comment.
Ajedrecista wrote: Just for curiosity: the previous development version was Critter 1.1.36 (if I remember well) and finally Critter 1.2 was released; now, with Critter 1.3.53c development version... the next public release will be Critter 1.4?
Do not read too much into version numbers. They are quite arbitrary. I made up a scheme where odd numers (1.1, 1.3, ...) are meant to be development versions, even numbers (1.0, 1.2, 1.4, ...) to be public releases.

IIRC the last beta version before 1.2 release was 1.1.49.
Here I explain a little how I calculate those intervals:

http://www.talkchess.com/forum/viewtopi ... 31&t=41090

Sedat Canbaz thought I was not wrong, so a good start is a good start! This time, with number of draws unknown, I calculated a general standard variation in function of the draw ratio (D) with pencil and paper (for removing the errors I made), then used Derive 6 for representate the graph and pick the values of uncertainties at certain draw ratios (0%, 5%, 10%, ...). I am sure that BayesElo and EloStat give (more less) the values I posted, so no need of do all what I did. My intention was to be orientative.

Referring to Critter 1.1.49, maybe I was confused with Open Critter 1.1.36 and 1.1.37 (hoping no mistakes again). I sometimes have good memory, but not always, as everybody can see. Thanks for sharing your numeration scheme: I agree that the number version is secondary, but knowing it is also interesting. Good luck with Critter 1.4!

Regards from Spain.

Ajedrecista.
MM
Posts: 766
Joined: Sun Oct 16, 2011 11:25 am

Re: Critter teaser

Post by MM »

rvida wrote:Hi,

I have just answered some PMs about the status of Critter development. I thought I might post in public as well.

New version is due to be released next month. Not sure about exact ELO improvement, though its performance should be pretty close to H1.5.
To give an idea, here is a quick copy&paste from the results of current test run:

Code: Select all

1.3.53c

Critter dev 64-bit - Critter 1.2 64-bit SSE4    116.0 - 106.0  52.25%

		
Critter dev 64-bit - Stockfish 2.1.1 JA 64bit   132.0 -  90.0  59.46%		
Critter dev 64-bit - Komodo64 3 SSE             128.0 -  94.0  57.66%		
Critter dev 64-bit - Rybka 4 x64                121.5 -  99.5  54.98%		
Critter dev 64-bit - IvanHoe 9.50b x64          131.0 -  91.0  59.01%		
Critter dev 64-bit - Houdini 1.5 x64            107.5 - 113.5  48.64%		
                                                736.0 - 594.0  55.34%		

1330 out of 2100 games played
Level: 40 Moves in 1 min 
40/1, 1 core, ponder off, without tablebases, Shredder classic default book
Non-PGO build without SSE4.

Richard
Hello Mr Vida,

did you plan to try to find more improvements before the next release? Anyway will you test your engine with SSE4 and/or at longer time control before realizing it? Do you think that your engine will be stronger at short or long time control? Sorry for so many questions but i'm very interest as you know :)

Thank you.

Best Regards
MM
User avatar
Marek Soszynski
Posts: 586
Joined: Wed May 10, 2006 7:28 pm
Location: Birmingham, England

Re: Critter teaser

Post by Marek Soszynski »

rvida wrote:
Marek Soszynski wrote:Any chance of Critter Linux using Gaviota tablebases?
Yes, Gaviota tablebases will be available on all supported platforms.
Thanks Richard!

I had thought Gaviota TBs would already be available, but they don't appear in the Scid 4.3 "Configure UCI engine" options for critter-12-64bit (Linux).

May we assume that http://www.vlasak.biz/critter/ is still the main website for Critter?
Marek Soszynski
MM
Posts: 766
Joined: Sun Oct 16, 2011 11:25 am

Re: Critter teaser

Post by MM »

Marek Soszynski wrote:
rvida wrote:
Marek Soszynski wrote:Any chance of Critter Linux using Gaviota tablebases?
Yes, Gaviota tablebases will be available on all supported platforms.
Thanks Richard!

I had thought Gaviota TBs would already be available, but they don't appear in the Scid 4.3 "Configure UCI engine" options for critter-12-64bit (Linux).

May we assume that http://www.vlasak.biz/critter/ is still the main website for Critter?
Hi, will next critter available for the latest android version?

Regards
MM
Jouni
Posts: 3651
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: Critter teaser

Post by Jouni »

Is next step trailer :) ?

BTW how is Critter development done - are You the only programmer/tester?

Jouni
MM
Posts: 766
Joined: Sun Oct 16, 2011 11:25 am

Re: Critter teaser

Post by MM »

Jouni wrote:Is next step trailer :) ?

BTW how is Critter development done - are You the only programmer/tester?

Jouni
+1
MM