https://github.com/amchess/ShashChess/releases/tag/18.1
18.1
Nnue eval aligned with the classical one: it's crucial on Shashchess and I proposed
it also to the official community to avoid misleading evaluations by the gui.
There is a great boost in strength as the tests will show.
Stockfish patch
Author: SFisGOD
Date: Tue Aug 31 12:56:19 2021 +0200
Timestamp: 1630407379
Update default net to nn-735bba95dec0.nnue
ShashChess
Moderators: hgm, Rebel, chrisw
-
- Posts: 511
- Joined: Sun Apr 26, 2020 11:40 pm
- Full name: Brian D. Smith
Re: ShashChess
I've noticed on the two most recent SFisGOD nets (in Stockfish) something odd.
I compare each with Stockfish Development version from 8/05 version in analysis (don't care about game play) for 'best moves' and more often than not, the SFisGOD nets are far slower to find and settle on a 'best' move which 8/05 has decided on earlier at less ply.
I compare each with Stockfish Development version from 8/05 version in analysis (don't care about game play) for 'best moves' and more often than not, the SFisGOD nets are far slower to find and settle on a 'best' move which 8/05 has decided on earlier at less ply.
-
- Posts: 511
- Joined: Sun Apr 26, 2020 11:40 pm
- Full name: Brian D. Smith
Re: ShashChess
EDIT - which reminds me - does anyone know of a board/forum where people discuss (only) Stockfish Development versions?Cornfed wrote: ↑Sun Sep 05, 2021 2:58 am I've noticed on the two most recent SFisGOD nets (in Stockfish) something odd.
I compare each with Stockfish Development version from 8/05 version in analysis (don't care about game play) for 'best moves' and more often than not, the SFisGOD nets are far slower to find and settle on a 'best' move which 8/05 has decided on earlier at less ply.
-
- Posts: 3186
- Joined: Sat Feb 16, 2008 7:38 am
- Full name: Peter Martan
Re: ShashChess
Thanks for the new version!amchess wrote: ↑Sun Sep 05, 2021 12:26 am https://github.com/amchess/ShashChess/releases/tag/18.1
18.1
Nnue eval aligned with the classical one: it's crucial on Shashchess and I proposed
it also to the official community to avoid misleading evaluations by the gui.
There is a great boost in strength as the tests will show.
Stockfish patch
Author: SFisGOD
Date: Tue Aug 31 12:56:19 2021 +0200
Timestamp: 1630407379
Update default net to nn-735bba95dec0.nnue
There are SC18 compiles together with 18.1 ones in download, which makes the anyhow big data even double. Non- embedded compiles would spare much download- time btw., but that's complaining on a really high level.
Another thing I noticed, bmi2 compile is faster with bench- command in console over avx2, which is unusual for my Ryzen 5950. So I installed both and in SMP the thing changes. Command bench will be single-threaded, I guess, can that be just inverted by multi- threading?
Thanks again regards
Last edited by peter on Sun Sep 05, 2021 8:42 am, edited 3 times in total.
Peter.
-
- Posts: 41455
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: ShashChess
Discord?Cornfed wrote: ↑Sun Sep 05, 2021 3:31 amEDIT - which reminds me - does anyone know of a board/forum where people discuss (only) Stockfish Development versions?Cornfed wrote: ↑Sun Sep 05, 2021 2:58 am I've noticed on the two most recent SFisGOD nets (in Stockfish) something odd.
I compare each with Stockfish Development version from 8/05 version in analysis (don't care about game play) for 'best moves' and more often than not, the SFisGOD nets are far slower to find and settle on a 'best' move which 8/05 has decided on earlier at less ply.
gbanksnz at gmail.com
-
- Posts: 3186
- Joined: Sat Feb 16, 2008 7:38 am
- Full name: Peter Martan
Re: ShashChess
Or to ask somewhat easier, how's the console- command for setting number of threads before bench?
Peter.
-
- Posts: 330
- Joined: Tue Dec 05, 2017 2:42 pm
Re: ShashChess
Sorry. I eliminated 18 builds. Thanks!peter wrote: ↑Sun Sep 05, 2021 8:28 amThanks for the new version!amchess wrote: ↑Sun Sep 05, 2021 12:26 am https://github.com/amchess/ShashChess/releases/tag/18.1
18.1
Nnue eval aligned with the classical one: it's crucial on Shashchess and I proposed
it also to the official community to avoid misleading evaluations by the gui.
There is a great boost in strength as the tests will show.
Stockfish patch
Author: SFisGOD
Date: Tue Aug 31 12:56:19 2021 +0200
Timestamp: 1630407379
Update default net to nn-735bba95dec0.nnue
There are SC18 compiles together with 18.1 ones in download, which makes the anyhow big data even double. Non- embedded compiles would spare much download- time btw., but that's complaining on a really high level.
Another thing I noticed, bmi2 compile is faster with bench- command in console over avx2, which is unusual for my Ryzen 5950. So I installed both and in SMP the thing changes. Command bench will be single-threaded, I guess, can that be just inverted by multi- threading?
Thanks again regards
-
- Posts: 330
- Joined: Tue Dec 05, 2017 2:42 pm
Re: ShashChess
Tests results:
LTC Match on positions based on characteristics
https://github.com/amchess/ShashChess/wiki/Matches
Hard positions test suite
https://github.com/amchess/ShashChess/w ... te-results
LTC Match on positions based on characteristics
https://github.com/amchess/ShashChess/wiki/Matches
Hard positions test suite
https://github.com/amchess/ShashChess/w ... te-results
-
- Posts: 533
- Joined: Sun Sep 06, 2020 4:40 am
- Full name: Connor McMonigle
Re: ShashChess
What's the point of a 20 game test? This is a meaningless result.amchess wrote: ↑Sun Sep 05, 2021 2:30 pm Tests results:
LTC Match on positions based on characteristics
https://github.com/amchess/ShashChess/wiki/Matches
Hard positions test suite
https://github.com/amchess/ShashChess/w ... te-results
-
- Posts: 330
- Joined: Tue Dec 05, 2017 2:42 pm
Re: ShashChess
No since it is an LTC test.
If I were to run 1000 games at long times (at least half an hour each), maybe on completely random opening positions, it would be the equivalent of at least 41 days!
There are so many patches to test and the development of a chess engine would be impossible.
Since the purpose of Shashchess is to be the best at long times, the criterion that is used, even in other branches of software engineering (testing strategy), is to use particularly significant samples. This concept is also used in statistics when we talk about "projections", for example, in the case of electoral surveys.
In our case, the chess concept of characteristic fits perfectly with this purpose: 20 games are played in one day and are based on the 10 characteristics (to simplify, center types), most common in chess. Since, if several positions share the same feature, they also share game plans, in this way, we can cover the range of possible situations without wasting too much time unnecessarily. We have explained this in the wiki.
If I were to run 1000 games at long times (at least half an hour each), maybe on completely random opening positions, it would be the equivalent of at least 41 days!
There are so many patches to test and the development of a chess engine would be impossible.
Since the purpose of Shashchess is to be the best at long times, the criterion that is used, even in other branches of software engineering (testing strategy), is to use particularly significant samples. This concept is also used in statistics when we talk about "projections", for example, in the case of electoral surveys.
In our case, the chess concept of characteristic fits perfectly with this purpose: 20 games are played in one day and are based on the 10 characteristics (to simplify, center types), most common in chess. Since, if several positions share the same feature, they also share game plans, in this way, we can cover the range of possible situations without wasting too much time unnecessarily. We have explained this in the wiki.