[STS 1-10] Crafty 23.3

[swami]

http://sites.google.com/site/strategict ... st-results

1000 Positions
10 seconds per position
Hardware: Q6600, 32 bits, 2 GB RAM, 2.4 GHZ. Arena 2.01 GUI.

[bob]

http://sites.google.com/site/strategict ... st-results

1000 Positions
10 seconds per position
Hardware: Q6600, 32 bits, 2 GB RAM, 2.4 GHZ. Arena 2.01 GUI.

I could not connect the above result with the overall chart you gave. Not sure what the numbers mean in that light.

[swami]

Crafty 23.3 has 38 more correct answers relative to Crafty 23.0 (661/1000).

I believe that may translate to anywhere about 40-80 elo.

Engine's closer in scores with Crafty 23.3 are Colossus 2008b, Spike, Umko and Loop List.

[bob]

Crafty 23.3 has 38 more correct answers relative to Crafty 23.0 (661/1000).

I believe that may translate to anywhere about 40-80 elo.

Engine's closer in scores with Crafty 23.3 are Colossus 2008b, Spike, Umko and Loop List.

What I meant was that given the score you quoted, I could not find a 23.3 on your posted list with that score???

I see a score of 699 in your post, but no 699 + crafty-23.3 on the list you gave a link to.

[swami]

Oh, I forgot to add it to the list. Thanks for pointing this out, I just updated the list.

[bob]

Oh, I forgot to add it to the list. Thanks for pointing this out, I just updated the list.

Now you have _two_ crafty-23.3's in your list. Also "not good".

[swami]

Oh, I forgot to add it to the list. Thanks for pointing this out, I just updated the list.

Now you have _two_ crafty-23.3's in your list. Also "not good".

Ah, It was a typo. I must have typed in 669 when I added the Crafty 23.3 to the list yesterday. When you pointed out that you couldn't find the result in that list, I had thought that I had forgotten to add Crafty 23.3 to the list. At the time, I must have been multi-tasking!

I just left the one with 699 in the list, and deleted the other one with 669. Cheers!

[Matthias Gemuh]

Hi Swami,

have you ever compared the STS result list based on best move with a result list based on total scores ?

My logic tells me that a result list based on total scores correlates better with Elo strength.

A result list based on best move merely classifies engines according to aggressiveness or fastest wins, not Elo strength.

Matthias.

[swami]

Hi Mathias, I haven't done any research as to the results.

But I just have same opinion as you after hundreds of tests and closely following the results. I believe the result list based on the total scores has consistently correlated with the elo strength of the engines by far.

It would make sense to have different column in site to list the total score as well as best move score. I will update the site in few days time.