STS re-re-re-re-re-visited

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

peter
Posts: 3385
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: STS re-re-re-re-re-visited

Post by peter »

Rebel wrote: Sun Oct 23, 2022 8:37 am I want people to give a choice which engine they trust most. I am definitely in favor of Lc0.
I'd say it depends on the position, but if I do favour LC0's choice over SF's now and then too, (most of the time with enough hardware- time they become the same anyhow, not the evals, but the moves of first choice) )then I choose LC0's move. If I yet couldn't decide for one of two moves (often enough they transpose sooner or later e.g.), then I'd give same amount of points to both moves,
regards
Peter.
Pvt. Ryan
Posts: 52
Joined: Mon Sep 12, 2022 3:50 am
Location: Christchurch, NZ
Full name: Ray Bongalon

Re: STS re-re-re-re-re-visited

Post by Pvt. Ryan »

How to use the options CPUs, etc apart from THREADS? Cheers
Ferdy
Posts: 4846
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: STS re-re-re-re-re-visited

Post by Ferdy »

There is sts positions analyzed by sf15 at 60s with multipv 10 on a single core using cpu i7-2600K cpu (3.4 Ghz).
User avatar
Rebel
Posts: 7299
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: STS re-re-re-re-re-visited

Post by Rebel »

Ferdy wrote: Mon Oct 24, 2022 4:43 am There is sts positions analyzed by sf15 at 60s with multipv 10 on a single core using cpu i7-2600K cpu (3.4 Ghz).
Did a quick run with the 6 per-installed engines.

Code: Select all

    EPD  : epd\sts-sf15-ferdy.epd
    Time : 100ms
                                                Max   Total   Time   Hash          
    Engine           Score   Found  Pos   ELO  Score   Rate    ms     Mb  Cpu      
 1  Berserk 9        13452   1025  1500  4041  14973  89.8%    100    64    1
 2  Koivisto 8.0     13436   1037  1500  4036  14973  89.7%    100    64    1
 3  Rebel 15.1       13237   1001  1500  3978  14973  88.4%    100    64    1
 4  Seer 2.5.0       12985    957  1500  3901  14973  86.7%    100    64    1
 5  Toga 4           11575    753  1500  3478  14973  77.3%    100    64    1
 6  Fruit 2.1        11017    678  1500  3312  14973  73.6%    100    64    1

                                    Created with MEA
                                          by
                                       Ferdinand
                                         Mosca
My move bonus point calculation is a bit different than yours. First move is always 10, for remaining moves the score difference with the first move is divided by 5. Moves with a score difference is > 50 are not listed.

For @Srdja, the Ferdy EPD also contains long moves, g1f3 instead of Nf3.
90% of coding is debugging, the other 10% is writing bugs.
smatovic
Posts: 3222
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: STS re-re-re-re-re-visited

Post by smatovic »

Thx Ferdy, thx Ed, I can parse that .epd, cool.

--
Srdja
User avatar
Rebel
Posts: 7299
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: STS re-re-re-re-re-visited

Post by Rebel »

Pvt. Ryan wrote: Sun Oct 23, 2022 11:24 pm How to use the options CPUs, etc apart from THREADS? Cheers
Threads = CPU's = Cores, all the same.
90% of coding is debugging, the other 10% is writing bugs.
Pvt. Ryan
Posts: 52
Joined: Mon Sep 12, 2022 3:50 am
Location: Christchurch, NZ
Full name: Ray Bongalon

Re: STS re-re-re-re-re-visited

Post by Pvt. Ryan »

Rebel wrote: Mon Oct 24, 2022 9:40 am
Pvt. Ryan wrote: Sun Oct 23, 2022 11:24 pm How to use the options CPUs, etc apart from THREADS? Cheers
Threads = CPU's = Cores, all the same.
I'm referring to the line 'set THREADS=1'. Are you able to use 'set CPUs=1' or 'set MaxThreads=1' instead? Cheers.
Ferdy
Posts: 4846
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: STS re-re-re-re-re-visited

Post by Ferdy »

Rebel wrote: Mon Oct 24, 2022 6:22 am
Ferdy wrote: Mon Oct 24, 2022 4:43 am There is sts positions analyzed by sf15 at 60s with multipv 10 on a single core using cpu i7-2600K cpu (3.4 Ghz).
Did a quick run with the 6 per-installed engines.

Code: Select all

    EPD  : epd\sts-sf15-ferdy.epd
    Time : 100ms
                                                Max   Total   Time   Hash          
    Engine           Score   Found  Pos   ELO  Score   Rate    ms     Mb  Cpu      
 1  Berserk 9        13452   1025  1500  4041  14973  89.8%    100    64    1
 2  Koivisto 8.0     13436   1037  1500  4036  14973  89.7%    100    64    1
 3  Rebel 15.1       13237   1001  1500  3978  14973  88.4%    100    64    1
 4  Seer 2.5.0       12985    957  1500  3901  14973  86.7%    100    64    1
 5  Toga 4           11575    753  1500  3478  14973  77.3%    100    64    1
 6  Fruit 2.1        11017    678  1500  3312  14973  73.6%    100    64    1

                                    Created with MEA
                                          by
                                       Ferdinand
                                         Mosca
My move bonus point calculation is a bit different than yours. First move is always 10, for remaining moves the score difference with the first move is divided by 5. Moves with a score difference is > 50 are not listed.

For @Srdja, the Ferdy EPD also contains long moves, g1f3 instead of Nf3.
I have added STS1-STS15_LAN_v5.epd. Its max point is 100 instead of 10. The weakness of max 10-point system that I see in STS1-STS15_LAN_v4.epd is that the range is too narrow and it has difficulties differentiating engines that are close in strength.

I describe the interpolation that I use in the repository.
chessica
Posts: 915
Joined: Thu Aug 11, 2022 11:30 pm
Full name: Esmeralda Pinto

Re: STS re-re-re-re-re-visited

Post by chessica »

EPD : epd\sts-sf15.epd
Time : 100ms
Solving Max Total Time Hash
Engine Score Used Time Found Pos Time Score Rate ms Mb Cpu CCRL
1 Toga 4 9070 00:04:10.0 705 1500 00:00:00.0 15000 60.5% 100 64 1 0
2 Toga 4 9068 00:04:10.0 703 1500 00:00:00.0 15000 60.5% 100 64 1 0
3 Toga 4 9046 00:04:10.0 700 1500 00:00:00.0 15000 60.3% 100 64 1 0
4 Toga 4 9041 00:04:10.0 704 1500 00:00:00.0 15000 60.3% 100 64 1 0
5 Toga 4 9039 00:04:10.0 701 1500 00:00:00.0 15000 60.3% 100 64 1 0
6 Toga 4 9038 00:04:10.0 701 1500 00:00:00.0 15000 60.3% 100 64 1 0
7 Toga 4 9025 00:04:10.0 699 1500 00:00:00.0 15000 60.2% 100 64 1 0
8 Toga 4 9018 00:04:10.0 700 1500 00:00:00.0 15000 60.1% 100 64 1 0
9 Toga 4 8998 00:04:10.0 696 1500 00:00:00.0 15000 60.0% 100 64 1 0
10 Toga 4 8994 00:04:10.0 699 1500 00:00:00.0 15000 60.0% 100 64 1 0
11 Toga 4 8988 00:04:10.0 697 1500 00:00:00.0 15000 59.9% 100 64 1 0
12 Toga 4 8958 00:04:10.0 691 1500 00:00:00.0 15000 59.7% 100 64 1 0

Created with MEA
by
Ferdinand
Mosca
Dann Corbit
Posts: 12777
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: STS re-re-re-re-re-visited

Post by Dann Corbit »

I reran the 1497 distinct positions at 1 minute per position using multi-pv using two Nvidia 2080 Super GPUs and LC0-29.2 with the 300MB weights file:
d0ed346c32fbcc9eb2f0bc7e957d188c8ae428ee3ef7291fd5aa045fc6ef4ded

The results are found in this file:
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.